ResearchAug 25, 2026 · 01:527 sources
Liquid AI and Artificial Analysis Launch Pipette With 10,000 Results as First Open Mobile AI Suite
From huggingnews.com
Liquid AI and Artificial Analysis have launched Pipette, an open-source benchmarking suite featuring 10,000 results across 35 model classes and four device types. In testing on the iPhone 17 Pro and Galaxy S26 Ultra, Nanbeige4.2-3B and LFM2.5-2.6B tied for the highest average intelligence score. The suite includes clients for macOS, Windows, iOS, and Android to measure model quality, speed, and latency on target hardware.
Read the sourceSign in to suggest
Sources
+ 5 more
- SUPPORT@artificialanlys“When the context limit is raised to 64K (represented by dots in the image), Ling 3.0 Tiny takes the top spot at 66”x.com
- SUPPORT@artificialanlys“Qwen3.5 9B (Reasoning) spends 74.5M output tokens across one pass of the benchmark set and runs out of its 16K window on 29% of generations”x.com
- SUPPORT@artificialanlys“End-to-End Generation Time, measured as the total time to generate 256 output tokens after a 1,024 token input, spans 30x across the models we tested on an iPhone 17 Pro”x.com
- SUPPORT@artificialanlys“Peak memory at 4K context spans roughly 19x on the iPhone 17 Pro”x.com
- SUPPORT@artificialanlys“Falcon-H1R-7B takes MATH-500 at 97%”x.com
One ranked edition, every morning
The stories that matter today. Free, cancel anytime.
Telegram @aidr_today