1

Local and Distributed Large LLM Inference with MLX and RDMA on Mac Studio

machinelearning.apple.com

Local and distributed inference for large language models such as Muse Spark Open can be performed using MLX and RDMA over Thunderbolt 5 on Mac Studio with M5 Ultra.

Sign in to suggest

Key sources

  1. SOURCEmachinelearning.apple.com
Markdown