● Open SourceNov 5, 2026 · 03:371 source

llama.cpp Releases v0.9.0 With Support for Native FP8 and Multi Node Tensor Parallelism

From marketbrief.now

AI;DR

llama.cpp releases v0.9.0 with support for native FP8 and Multi Node Tensor Parallelism. This update enables tensor parallels across multiple nodes via NCCL. The version also adds speech capabilities incorporating Chatterbox TTS and Nemotron 3.5 Transcribe.

Read originalSign in to suggest

Sources

#llm#open-source#frameworkMarkdownScore 0.73.6k tokens
Image: marketbrief.now
Read original