ToolsNov 17, 2026 · 20:526 sources
Qwen3.8-27B SWE-Bench Pro Score Hits 63% With New Pi Harness Adapter
From marketbrief.now
A new LoRA adapter for Alibaba's Qwen3.8-27B model increased its pass@1 score on the SWE-Bench Pro (Hard 51 subset) from 29% to 63% when used with the Pi harness. The adapter also raised the model's Terminal-Bench 2.1 pass@1 score from 40% to 56% while reducing the number of tool calls per task by 55% to 62%.
The team trained the adapter using reinforcement learning through TRL's AsyncGRPOTrainer and OpenEnv, employing real Pi sessions in a Hugging Face sandbox. The developers intend to release more harness-specific adapters in the coming days and will publish the full training recipe in a blog post this Friday.
Read the sourceSign in to suggest
Sources
One ranked edition, every morning
The stories that matter today. Free, cancel anytime.
Telegram @aidr_today