ResearchAug 25, 2026 · 01:527 sources

Liquid AI and Artificial Analysis Launch Pipette With 10,000 Results as First Open Mobile AI Suite

From huggingnews.com

Image: huggingnews.com
AI;DR

Liquid AI and Artificial Analysis have launched Pipette, an open-source benchmarking suite featuring 10,000 results across 35 model classes and four device types. In testing on the iPhone 17 Pro and Galaxy S26 Ultra, Nanbeige4.2-3B and LFM2.5-2.6B tied for the highest average intelligence score. The suite includes clients for macOS, Windows, iOS, and Android to measure model quality, speed, and latency on target hardware.

Read the sourceSign in to suggest

Sources

+ 5 more
  1. SUPPORT@artificialanlys“When the context limit is raised to 64K (represented by dots in the image), Ling 3.0 Tiny takes the top spot at 66”x.com
  2. SUPPORT@artificialanlys“Qwen3.5 9B (Reasoning) spends 74.5M output tokens across one pass of the benchmark set and runs out of its 16K window on 29% of generations”x.com
  3. SUPPORT@artificialanlys“End-to-End Generation Time, measured as the total time to generate 256 output tokens after a 1,024 token input, spans 30x across the models we tested on an iPhone 17 Pro”x.com
  4. SUPPORT@artificialanlys“Peak memory at 4K context spans roughly 19x on the iPhone 17 Pro”x.com
  5. SUPPORT@artificialanlys“Falcon-H1R-7B takes MATH-500 at 97%”x.com

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today