TechNeura
401 subscribers
332 photos
24 videos
132 files
8.42K links
My profile: kargarisaac.com
Download Telegram
https://x.com/_xjdr/status/1997459906719547535
xjdr on X: "# Why Training MoEs is So Hard recently, i have found myself wanting a small, research focused training repo that i can do small experiments on quickly and easily. these experiments range from trying out new attention architectures (MLA, SWA, NSA, KDA - all pluggable) to https://t.co/lZMmaAWMT6" / X