← Back to live feed1 story
Janas runs large LLMs by streaming experts from an SSD to exceed RAM limits, achieving 37 tokens per second from Qwen3-Next-80B on a 32 GB laptop.
Sign in to suggest
Key sources
- DISCUSSIONkhalidkhairnews.ycombinator.com
Janas runs large LLMs by streaming experts from an SSD to exceed RAM limits, achieving 37 tokens per second from Qwen3-Next-80B on a 32 GB laptop.