ResearchSep 7, 2026 · 21:476 sources

H Company NeoMME 260M Matches 3.75B Model With 14x Fewer Parameters

From huggingnews.com

Image: huggingnews.com
AI;DR

H Company launched NeoMME, a family of 260 million and 800 million parameter multilingual encoders that match the performance of a 3.75 billion parameter model with 14 times fewer parameters, using a masked-diffusion text denoiser and NorMuon optimizer.

Read the sourceSign in to suggest

Sources

+ 4 more
  1. SUPPORT@tomaarsen“Their 800M model reaches 0.556”x.com
  2. SUPPORT@marktechpost“16,384-token context, enough for two 3840×2160 4K UHD images”x.com
  3. SUPPORT@lateinteraction“make NeoMME day-0 compatible with ST thanks to Tom's help”x.com
  4. SUPPORT@tonywu_71“NeoMME day-0 compatible with ST thanks to Tom's help”x.com

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today