● InfraNov 10, 2026 · 02:201 source
I ran 120B MoE models on my 32GB M1 Max using under 16 GB
From mitln.github.io
A prototype was created to run gpt-oss-120b and Qwen3.5-122B-A10B on a MacBook Pro with an M1 Max and 32GB of RAM using a 16 GiB process-memory budget. On gpt-oss-120b, the engine averaged 7.84 tokens/s compared to 5.78 tokens/s for TUFF 10.2.2 in the same setup.
Read originalSign in to suggest