---
format: "aidr-story-markdown/v1"
id: "b9135d2e692e209f1177939e0d9b01c64aade683980402eb8f70eaa573dd30eb"
canonical_url: "https://aidr.today/b9135d2e?lang=en"
title: "Magnitude Runs Open Models 2x Faster Than Ollama"
lang: "en"
requested_lang: "en"
available_langs: ["en","vi"]
translation_fallback: null
fallback_fields: []
published_at: "2026-10-15T22:09:57.000Z"
category: "Open Source"
topics: ["inference","open-source"]
source_urls: ["https://marketbrief.now/ai/magnitude-runs-open-models-2x-faster-than-ollama-e9fd4535","https://huggingnews.com/ai/magnitude-runs-open-models-2x-faster-than-ollama-e9fd4535"]
summary: "Magnitude, a free open-source desktop app released by Tom Greenwald, automates GPU thread and memory configuration to run local AI models up to 2.19x faster than Ollama on Mac M4 Pro and 2.17x faster on DGX Spark. It supports Apple Silicon, Nvidia, AMD, and CPUs, uses a quantized KV cache to halve memory usage, and plans future updates including attention pruning and expert streaming."
---

# Magnitude Runs Open Models 2x Faster Than Ollama

> [Open the canonical story](<https://aidr.today/b9135d2e?lang=en>)

**Published:** 2026-10-15T22:09:57.000Z
**Category:** Open Source
**Topics:** inference, open\-source

## Summary

Magnitude, a free open\-source desktop app released by Tom Greenwald, automates GPU thread and memory configuration to run local AI models up to 2\.19x faster than Ollama on Mac M4 Pro and 2\.17x faster on DGX Spark\. It supports Apple Silicon, Nvidia, AMD, and CPUs, uses a quantized KV cache to halve memory usage, and plans future updates including attention pruning and expert streaming\.

## Sources

- [Story source](<https://marketbrief.now/ai/magnitude-runs-open-models-2x-faster-than-ollama-e9fd4535>)
- [Story source](<https://huggingnews.com/ai/magnitude-runs-open-models-2x-faster-than-ollama-e9fd4535>)