Solves a per-tensor quantization that uses 99.99% of your exact VRAM budget — every spare megabyte spent where it buys the most quality. macOS, Linux, and Windows.

Sign in to suggest edits

Key sources

  1. DISCUSSIONrhgraysoniinews.ycombinator.com
Markdown