Run Q4 small language models entirely in the browser with WebGPU. Chat, benchmark, and compare PetitGPT, SmolLM2, and friends on-device.

Sign in to suggest edits

Key sources

  1. DISCUSSIONlogicalleenews.ycombinator.com
Markdown