Benchmark Qwen3.8-Flash-Next against qwen3.8-27b #180

Merged

dev-agent merged 1 commits from bench-flash-next into main

2026-10-24 13:10:31 +00:00

Author	SHA1	Message	Date
dongarandClaude Opus 5.5	3b614bd918	Benchmark Qwen3.8-Flash-Next against qwen3.8-27b CI / checks (push) Skipped CI / checks (pull_request) Successful in 2m12s Details CI / e2e (pull_request) Successful in 3m56s Details Five runs per task through LiteLLM on the RTX 4090. qwen3.8-27b (thinking) passed 36 of 40. Flash-Next was run thinking, at reasoning_effort low, and with no thinking. The first Flash-Next runs used non-git workspaces, where `git log` fails, so their task hashes are older and the report marks them (old). On git workspaces (#177), both thinking and lowthink passed 32 of 40; nothink passed 12 of 40 on the old workspaces and was not rerun. qwen3.8-27b had no git-caused failures, so it was not rerun. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01J5Utyfzw7gF7UhjRDEtjTk	2026-10-24 08:40:23 +00:00

Author

SHA1

Message

Date

dongarandClaude Opus 5.5

3b614bd918

Benchmark Qwen3.8-Flash-Next against qwen3.8-27b

CI / checks (push) Skipped

CI / checks (pull_request) Successful in 2m12s

Details

CI / e2e (pull_request) Successful in 3m56s

Details

Five runs per task through LiteLLM on the RTX 4090. qwen3.8-27b (thinking)
passed 36 of 40. Flash-Next was run thinking, at reasoning_effort low, and
with no thinking.

The first Flash-Next runs used non-git workspaces, where `git log` fails,
so their task hashes are older and the report marks them (old). On git
workspaces (#177), both thinking and lowthink passed 32 of 40; nothink
passed 12 of 40 on the old workspaces and was not rerun. qwen3.8-27b had no
git-caused failures, so it was not rerun.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01J5Utyfzw7gF7UhjRDEtjTk

2026-10-24 08:40:23 +00:00