Files
nisse/bench
dongarandClaude Opus 5.5 3b614bd918
CI / checks (push) Skipped
CI / checks (pull_request) Successful in 2m12s
CI / e2e (pull_request) Successful in 3m56s
Benchmark Qwen3.8-Flash-Next against qwen3.8-27b
Five runs per task through LiteLLM on the RTX 4090. qwen3.8-27b (thinking)
passed 36 of 40. Flash-Next was run thinking, at reasoning_effort low, and
with no thinking.

The first Flash-Next runs used non-git workspaces, where `git log` fails,
so their task hashes are older and the report marks them (old). On git
workspaces (#177), both thinking and lowthink passed 32 of 40; nothink
passed 12 of 40 on the old workspaces and was not rerun. qwen3.8-27b had no
git-caused failures, so it was not rerun.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01J5Utyfzw7gF7UhjRDEtjTk
2026-10-24 08:40:23 +00:00
..