● InfraNov 10, 2026 · 02:201 source

I ran 120B MoE models on my 32GB M1 Max using under 16 GB

From mitln.github.io

AI;DR

A prototype was created to run gpt-oss-120b and Qwen3.5-122B-A10B on a MacBook Pro with an M1 Max and 32GB of RAM using a 16 GiB process-memory budget. On gpt-oss-120b, the engine averaged 7.84 tokens/s compared to 5.78 tokens/s for TUFF 10.2.2 in the same setup.

Read originalSign in to suggest
Read original