ModelsAug 18, 2026 · 21:29

Show HN: Shoehorn – Quantize any model down to run on your machine

From notactuallytreyanastasio.github.io

Image: notactuallytreyanastasio.github.io
AI;DR

Shoehorn is a tool that allows users to quantize any model to run on their machines. It uses a per-tensor quantization method designed to utilize 99.99% of a user's VRAM budget and is compatible with macOS, Linux, and Windows.

Read the sourceSign in to suggest

Sources

+ 1 more
  1. DISCUSSIONrhgraysoniinews.ycombinator.com

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today