ReleasesSep 1, 2026 · 18:472 sources

Tencent Open Sources 770B Parameter Hy4 AI Model With 1 Million Token Context

From huggingnews.com

Image: huggingnews.com
AI;DR

Tencent's Hunyuan team released the Hy4 preview open-weight AI model using a Mixture-of-Experts architecture with 770 billion total parameters and a 1 million token context window. The model features 256 routed experts and increased end-to-end throughput by 31.8% through operator fusion and communication optimizations. Tencent distributed the weights via HuggingFace and Github for coding and productivity applications.

Read the sourceSign in to suggest

Sources

+ 1 more
  1. SUPPORT@sudeepsriv“activates only around 49B for each token”x.com

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today