Login

Recent searches

No recent searches

Search options

Only available when logged in.
fosstodon.org is one of the many independent Mastodon servers you can use to participate in the fediverse.
Fosstodon is an invite only Mastodon instance that is open to those who are interested in technology; particularly free & open source software. If you wish to join, contact us for an invite.

Administered by:

Server stats:

9.9K
active users

fosstodon.org: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

#hybrid

8 posts8 participants0 posts today
Public
Habr

Mamba 2 + Transformer = Nemotron H

Nemotron-H реализует гибридную архитектуру Mamba-Transformer , где большая часть слоёв – это слои SSM (Structured State-Space Model) Mamba-2 , а небольшая доля – классические слои самовнимания (self-attention) трансформера, чередующиеся с полносвязными слоями (FFN). Структура модели продумана таким образом, чтобы использовать сильные стороны обоих подходов: SSM-слои обеспечивают эффективную работу с длинными последовательностями за счёт линейной (или даже постоянной) сложности по длине последовательности, а несколько слоёв самовнимания добавляют модели способность точного "склеивания" глобального контекста и превосходные навыки in-context learning . Начало заката эры Трансформеров? Или старт новой эры, эры архитектурного разнообразия? А что думаете вы?

habr.com/ru/articles/905908/

ХабрMamba 2 + Transformer = Nemotron HСодержание TL;DR Введение Дизайн гибридной архитектуры Методология обучения Сжатие модели с помощью MiniPuzzle Повышение производительности и эффективности Применение и универсальность Заключение...
#nvidia#mamba#transformers
Public
Emilia Jarochowska 🇺🇦🌱

As we watch a lot of funding for #research being cut, affecting vital projects and driving many talents away, I can't help seeing #academic #conferences as inappropriately decadent. Random example: this conference has an entire subpage about #sustainability: confer.co.nz/isc2026/ Does it mean #hybrid, you might ask? No. You fly to New Zealand, and pay an extra 400 - 6500 NZD if you want to attend a field trip: nearly a year's worth of a PhD student bursary in Poland. Who has this money in #sedimentology? Mostly researchers in the #fossilfuels industry.
Am I interested in the scientific content of the conference? Yes.
Am I ashamed by how sustainably and inclusively it is delivered? Also yes. I wish we scientists weren't so tone deaf sometimes.
#NicheRant #AskingForIt

Public
Mark

Russia intensifying hybrid attacks against Europe, Dutch intelligence says

Russia is stepping up its #hybrid attacks aimed at the #Netherlands and its #European allies, the Dutch military intelligence agency MIVD said on April 22.

The news follows multiple reports of damaged #undersea infrastructure in the #BalticSea, #arson and #sabotage attacks across #Europe, and other incidents seen as possible #Russian hybrid operations.

kyivindependent.com/russia-int

The Kyiv Independent · Russia intensifying hybrid attacks against Europe, Dutch intelligence says"We see that the Russian threat against Europe is increasing, including after a possible end of the war against Ukraine," MIVD director Peter Reesink said in the agency's annual report.
#HybridWar#RussianAggression#terrorism
ExploreLive feeds
About