ToolsNov 17, 2026 · 20:526 sources

Qwen3.8-27B SWE-Bench Pro Score Hits 63% With New Pi Harness Adapter

From marketbrief.now

Image: marketbrief.now
AI;DR

A new LoRA adapter for Alibaba's Qwen3.8-27B model increased its pass@1 score on the SWE-Bench Pro (Hard 51 subset) from 29% to 63% when used with the Pi harness. The adapter also raised the model's Terminal-Bench 2.1 pass@1 score from 40% to 56% while reducing the number of tool calls per task by 55% to 62%.

The team trained the adapter using reinforcement learning through TRL's AsyncGRPOTrainer and OpenEnv, employing real Pi sessions in a Hugging Face sandbox. The developers intend to release more harness-specific adapters in the coming days and will publish the full training recipe in a blog post this Friday.

Read the sourceSign in to suggest

Sources

One ranked edition, every morning

The stories that matter today. Free, cancel anytime.

Telegram @aidr_today