dev/nisse
2
1 Fork 0
Code Issues 23 Pull Requests Actions Packages Projects Releases 1 Wiki Activity
Files
427278ac809078d274fd9e1ea9fc18c681acf024
nisse/bench/results/2026-09-27-mimo-v2.6-9b.jsonl
T
dongarandClaude Opus 5.5 4b6c48cc96
CI / checks (push) Skipped
CI / checks (pull_request) Successful in 1m12s
Details
Benchmark the finalists on all eight tasks, and archive older results 
Five runs per task at 320 W with max_turns 40, after the fixes in
#50-#52, for qwen3.8-27b, qwen3.6-35b-a3b, gemma-4-26b-a4b,
devstral-small-2-24b and mimo-v2.6-9b; the harder four also for
claude-haiku-4-5 as the ceiling, and two calibration runs each for
local-fast as the floor. Runs failed by the proxy's rate limiter were
set aside, not stored.

Earlier results move to bench/results/archive/, which the report does
not read: they were made at other power caps, at max_turns 24, or on
the RTX 4070, and are kept as the record.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-28 03:14:40 +00:00

9 lines
22 KiB
JSON
Raw Blame History

{"backing": "openai/mimo-v2.6-9b", "check_output": ".......... [100%]\n10 passed in 0.02s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 1, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "completed", "outcome_note": "Fixed the wrong totals on multi-currency invoices. Root cause: the shared `normalise_rate` function in `invoicing/money.py` quantized all rates and fractions to 2 decimal places (`RATE_PLACES = Decimal(\"0.01\")`), rounding the true USD->EUR rate (0.9195402298850574...) to 0.92, which turned 100 USD into 92.00 EUR instead of 91.95. Fix: raised `RATE_PLACES` to `Decimal(\"0.000001\")` (six places, matching the finest rate, JPY at 0.006712). This fixes every caller of the shared function (`convert`, `", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": true, "task": "trace-bug", "task_hash": "a234c8fbeceeb166", "tokens_in": 18679, "tokens_out": 1508, "trimmed_requests": 0, "ts": "2026-09-27T23:08:25+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 8, "wall_s": 31.2}
{"backing": "openai/mimo-v2.6-9b", "check_output": ".......... [100%]\n10 passed in 0.02s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 1, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "completed", "outcome_note": "Fixed the multi-currency total bug. Root cause: `apply_rate` in `invoicing/money.py` rounded every rate through `normalise_rate` to `RATE_PLACES = 0.01` (whole cents), so the USD->EUR rate 0.919540... became 0.92, turning 100 USD into 92.00 EUR instead of 91.95. Changed `RATE_PLACES` to `0.000001`, matching the six-decimal precision of the reference rates (JPY 0.006712), so no step rounds a rate or fraction coarsely. All four tests pass.", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": true, "task": "trace-bug", "task_hash": "a234c8fbeceeb166", "tokens_in": 17672, "tokens_out": 789, "trimmed_requests": 0, "ts": "2026-09-27T23:08:36+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 8, "wall_s": 9.9}
{"backing": "openai/mimo-v2.6-9b", "check_output": "!!!!!!!!!!!!!!!!!!\\n2 errors in 0.09s\\n\", stderr='').returncode\n\n.bench_check/test_hidden.py:97: AssertionError\n______________________ test_the_command_line_still_works _______________________\n\ntmp_path = PosixPath('/tmp/pytest-of-root/pytest-185/test_the_command_line_still_wo0')\n\n def test_the_command_line_still_works(tmp_path: Path) -> None:\n (tmp_path / \"catalog.csv\").write_text(\"sku,name,unit_price\\nSKU-2,hammer,12.50\\n\")\n ini = tmp_path / \"shop.ini\"\n ini.write_text(\n f\"[shop]\\ncurrency = EUR\\ntax_percent = 20\\ncatalog_file = {tmp_path / 'catalog.csv'}\\n\"\n )\n run = subprocess.run(\n [\n sys.executable,\n \"-m\",\n \"shopkeeper\",\n \"--config\",\n str(ini),\n \"price\",\n \"SKU-2\",\n \"2\",\n ],\n cwd=ROOT,\n capture_output=True,\n text=True,\n check=False,\n )\n> assert run.stdout.strip() == \"30.00 EUR\", run.stderr[-1000:]\nE AssertionError: /root/nisse/.venv/bin/python: Error while finding module specification for 'shopkeeper.__main__' (ImportError: cannot import name 'Settings' from partially initialized module 'shopkeeper' (most likely due to a circular import) (/tmp/tmpufgv1d78/work/shopkeeper/__init__.py))\nE \nE assert '' == '30.00 EUR'\nE \nE - 30.00 EUR\n\n.bench_check/test_hidden.py:122: AssertionError\n=========================== short test summary info ============================\nFAILED .bench_check/test_hidden.py::test_the_new_name_is_exported - ImportErr...\nFAILED .bench_check/test_hidden.py::test_the_similar_names_were_left_alone - ...\nFAILED .bench_check/test_hidden.py::test_behaviour_is_unchanged - ImportError...\nFAILED .bench_check/test_hidden.py::test_the_projects_own_tests_pass - Assert...\nFAILED .bench_check/test_hidden.py::test_the_command_line_still_works - Asser...\n5 failed, 2 passed in 0.41s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 2, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "escalate", "outcome_note": "2 consecutive command failures; last: exit code: 1\nstdout:\n\nstderr:\n", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": false, "task": "refactor-rename", "task_hash": "696f6832ddf02216", "tokens_in": 64868, "tokens_out": 3790, "trimmed_requests": 0, "ts": "2026-09-27T23:09:17+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 13, "wall_s": 40.4}
{"backing": "openai/mimo-v2.6-9b", "check_output": "..F.... [100%]\n=================================== FAILURES ===================================\n____________________ test_the_similar_names_were_left_alone ____________________\n\n def test_the_similar_names_were_left_alone() -> None:\n from shopkeeper import config\n \n assert callable(config.load_config_defaults)\n assert callable(config.reload_config)\n assert not hasattr(config, \"read_settings_defaults\")\n assert not hasattr(config, \"reread_settings\")\n readme = (ROOT / \"README.md\").read_text()\n> assert \"load_config_defaults()\" in readme\nE AssertionError: assert 'load_config_defaults()' in '# shopkeeper\\n\\nA small shop back office: catalogue, pricing, stock, orders and reports.\\n\\n## Settings\\n\\nSettings c...d line\\n\\n python -m shopkeeper --config shop.ini price SKU-1 3\\n python -m shopkeeper --config shop.ini stock\\n'\n\n.bench_check/test_hidden.py:47: AssertionError\n=========================== short test summary info ============================\nFAILED .bench_check/test_hidden.py::test_the_similar_names_were_left_alone - ...\n1 failed, 6 passed in 0.35s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 1, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "completed", "outcome_note": "Renamed load_config to read_settings across the project: definition and internal call in shopkeeper/config.py, imports/calls/docstrings/comments in all shopkeeper modules, exports and __all__ in shopkeeper/__init__.py, README.md, and tests. Kept load_config_defaults and reload_config untouched. Verified no load_config references remain and python -m pytest -q passes (8 passed).", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": false, "task": "refactor-rename", "task_hash": "696f6832ddf02216", "tokens_in": 34784, "tokens_out": 1069, "trimmed_requests": 0, "ts": "2026-09-27T23:09:32+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 12, "wall_s": 14.0}
{"backing": "openai/mimo-v2.6-9b", "check_output": " - ValueError: not enou...\nFAILED .bench_check/test_hidden.py::test_valid[1d-86400] - ValueError: not en...\nFAILED .bench_check/test_hidden.py::test_valid[1H30M-5400] - ValueError: inva...\nFAILED .bench_check/test_hidden.py::test_valid[2D-172800] - ValueError: inval...\nFAILED .bench_check/test_hidden.py::test_valid[ 1h 30m -5400] - ValueError: n...\nFAILED .bench_check/test_hidden.py::test_valid[1d 2h 3m 4s-93784] - ValueErro...\nFAILED .bench_check/test_hidden.py::test_valid[1.5h-5400] - ValueError: not e...\nFAILED .bench_check/test_hidden.py::test_valid[1.5m-90] - ValueError: not eno...\nFAILED .bench_check/test_hidden.py::test_valid[0.25h-900] - ValueError: not e...\nFAILED .bench_check/test_hidden.py::test_valid[1:30-90] - ValueError: invalid...\nFAILED .bench_check/test_hidden.py::test_valid[1:02:03-3723] - NameError: nam...\nFAILED .bench_check/test_hidden.py::test_valid[90:00-5400] - ValueError: inva...\nFAILED .bench_check/test_hidden.py::test_valid[0:05-5] - ValueError: invalid ...\nFAILED .bench_check/test_hidden.py::test_valid[ 1:30 -90] - ValueError: inval...\nFAILED .bench_check/test_hidden.py::test_valid[0s-0] - ValueError: not enough...\nFAILED .bench_check/test_hidden.py::test_valid[0:00-0] - ValueError: invalid ...\nFAILED .bench_check/test_hidden.py::test_invalid[30m1h] - assert \"'30m1h'\" in...\nFAILED .bench_check/test_hidden.py::test_invalid[1h2h] - assert \"'1h2h'\" in '...\nFAILED .bench_check/test_hidden.py::test_invalid[1s1m] - assert \"'1s1m'\" in '...\nFAILED .bench_check/test_hidden.py::test_invalid[1 h] - assert \"'1 h'\" in 'no...\nFAILED .bench_check/test_hidden.py::test_invalid[1h1.5m] - assert \"'1h1.5m'\" ...\nFAILED .bench_check/test_hidden.py::test_invalid[0.5s] - assert \"'0.5s'\" in '...\nFAILED .bench_check/test_hidden.py::test_invalid[0.01m] - assert \"'0.01m'\" in...\nFAILED .bench_check/test_hidden.py::test_the_result_is_an_int - ValueError: n...\nFAILED .bench_check/test_hidden.py::test_the_plan_asked_for_tests_and_they_pass\n28 failed, 21 passed in 0.55s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 2, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "escalate", "outcome_note": "2 consecutive command failures; last: exit code: 1\nstdout:\nFFFFFFF...FFF.FFFFFFFFF.....FFFFFFFFFFFF.........FF...... [100%]\n=================================== FAILURES ===================================\n___________________________ test_unit_form[2h-7200] ____________________________\n\ntext = '2h', expected = 7200\n\n @pytest.mark.parametrize(\"text,expected\", test_valid_unit_forms)\n def test_unit_form(text, expected):\n> assert parse_duration(text) == expected\n ", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": false, "task": "spec-parser", "task_hash": "bcead05857457203", "tokens_in": 20352, "tokens_out": 3057, "trimmed_requests": 0, "ts": "2026-09-27T23:10:06+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 7, "wall_s": 32.8}
{"backing": "openai/mimo-v2.6-9b", "check_output": " \nE assert 1 == 0\nE + where 1 = CompletedProcess(args=['/root/nisse/.venv/bin/python', '-m', 'pytest', '-q', 'test_durations.py'], returncode=1, stdou...test_durations.py::test_zero_with_clock - ValueError: not enough value...\\n13 failed, 33 passed in 0.10s\\n', stderr='').returncode\n\n.bench_check/test_hidden.py:87: AssertionError\n=========================== short test summary info ============================\nFAILED .bench_check/test_hidden.py::test_valid[1h30m-5400] - TypeError: argum...\nFAILED .bench_check/test_hidden.py::test_valid[1d2h3m4s-93784] - ValueError: ...\nFAILED .bench_check/test_hidden.py::test_valid[1H30M-5400] - ValueError: inva...\nFAILED .bench_check/test_hidden.py::test_valid[2D-172800] - ValueError: inval...\nFAILED .bench_check/test_hidden.py::test_valid[ 1h 30m -5400] - TypeError: ar...\nFAILED .bench_check/test_hidden.py::test_valid[1d 2h 3m 4s-93784] - ValueErro...\nFAILED .bench_check/test_hidden.py::test_valid[1.5h-5400] - ValueError: inval...\nFAILED .bench_check/test_hidden.py::test_valid[1.5m-90] - ValueError: invalid...\nFAILED .bench_check/test_hidden.py::test_valid[0.25h-900] - ValueError: inval...\nFAILED .bench_check/test_hidden.py::test_valid[1:30-90] - ValueError: not eno...\nFAILED .bench_check/test_hidden.py::test_valid[90:00-5400] - ValueError: not ...\nFAILED .bench_check/test_hidden.py::test_valid[0:05-5] - ValueError: not enou...\nFAILED .bench_check/test_hidden.py::test_valid[ 1:30 -90] - ValueError: not e...\nFAILED .bench_check/test_hidden.py::test_valid[0:00-0] - ValueError: not enou...\nFAILED .bench_check/test_hidden.py::test_invalid[1h1.5m] - TypeError: argumen...\nFAILED .bench_check/test_hidden.py::test_invalid[1:60] - assert \"'1:60'\" in '...\nFAILED .bench_check/test_hidden.py::test_invalid[1.5:30] - assert \"'1.5:30'\" ...\nFAILED .bench_check/test_hidden.py::test_the_result_is_an_int - ValueError: i...\nFAILED .bench_check/test_hidden.py::test_the_plan_asked_for_tests_and_they_pass\n19 failed, 30 passed in 0.45s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 2, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "escalate", "outcome_note": "2 consecutive command failures; last: exit code: 1\nstdout:\n.FFFFF...F........FF.F...F.F.......F..F....... [100%]\n=================================== FAILURES ===================================\n______________________ test_unit_form_multiple_components ______________________\n\n def test_unit_form_multiple_components():\n> assert parse_duration(\"1h30m\") == 5400\n ^^^^^^^^^^^^^^^^^^^^^^^\n\ntest_durations.py:14: \n_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": false, "task": "spec-parser", "task_hash": "bcead05857457203", "tokens_in": 42798, "tokens_out": 17497, "trimmed_requests": 0, "ts": "2026-09-27T23:13:03+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 11, "wall_s": 176.2}
{"backing": "openai/mimo-v2.6-9b", "check_output": "\n==================================== ERRORS ====================================\n_________________ ERROR collecting .bench_check/test_hidden.py _________________\nImportError while importing test module '/tmp/tmpzdboh8sj/work/.bench_check/test_hidden.py'.\nHint: make sure your test modules/packages have valid Python names.\nTraceback:\n/usr/lib/python3.12/importlib/__init__.py:90: in import_module\n return _bootstrap._gcd_import(name[level:], package, level)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n.bench_check/test_hidden.py:10: in <module>\n from tracker.core import add_task, complete, overdue, sort_tasks\ntracker/core.py:3: in <module>\n from datetime import date, datetime, max as max_date\nE ImportError: cannot import name 'max' from 'datetime' (/usr/lib/python3.12/datetime.py)\n=========================== short test summary info ============================\nERROR .bench_check/test_hidden.py\n!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!\n1 error in 0.10s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 3, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "escalate", "outcome_note": "2 consecutive command failures; last: exit code: 2\nstdout:\n\n==================================== ERRORS ====================================\n______________________ ERROR collecting tests/test_cli.py ______________________\nImportError while importing test module '/tmp/tmpzdboh8sj/work/tests/test_cli.py'.\nHint: make sure your test modules/packages have valid Python names.\nTraceback:\n/usr/lib/python3.12/importlib/__init__.py:90: in import_module\n return _bootstrap._gcd_import(name[level:], packa", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": false, "task": "long-milestone", "task_hash": "ba436defff7d212f", "tokens_in": 131864, "tokens_out": 7226, "trimmed_requests": 0, "ts": "2026-09-27T23:14:21+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 22, "wall_s": 77.3}
{"backing": "openai/mimo-v2.6-9b", "check_output": "ionError:...\nE FAILED tests/test_cli.py::test_cli_today_from_env - TypeError: '<' not suppor...\nE FAILED tests/test_core.py::test_complete_and_sort - assert [1, 2, 3] == [2, 3...\nE FAILED tests/test_core.py::test_sort_undone_before_done - assert [1, 3, 2] ==...\nE FAILED tests/test_core.py::test_sort_due_first_then_without_due_then_id - ass...\nE FAILED tests/test_core.py::test_overdue_only_undone_past_due - TypeError: add...\nE FAILED tests/test_formatting.py::test_due_shown - AssertionError: assert '[!]...\nE FAILED tests/test_formatting.py::test_done_task_ignores_today - AssertionErro...\nE FAILED tests/test_storage.py::test_load_version_2 - AssertionError: assert [T...\nE FAILED tests/test_storage_and_cli.py::test_cli_add_done_list - AssertionError...\nE FAILED tests/test_storage_and_cli.py::test_cli_list_only_undone - SystemExit: 2\nE 11 failed, 14 passed in 0.13s\nE \nE assert 1 == 0\nE + where 1 = CompletedProcess(args=['/root/nisse/.venv/bin/python', '-m', 'pytest', '-q', 'tests'], returncode=1, stdout='F.F...FFF... tests/test_storage_and_cli.py::test_cli_list_only_undone - SystemExit: 2\\n11 failed, 14 passed in 0.13s\\n', stderr='').returncode\n\n.bench_check/test_hidden.py:183: AssertionError\n=========================== short test summary info ============================\nFAILED .bench_check/test_hidden.py::test_round_trip_keeps_dates - AssertionEr...\nFAILED .bench_check/test_hidden.py::test_sort_order - assert [4, 5, 3, 6, 2, ...\nFAILED .bench_check/test_hidden.py::test_command_line_flow - AssertionError: \nFAILED .bench_check/test_hidden.py::test_a_bad_due_date_is_a_usage_error - as...\nFAILED .bench_check/test_hidden.py::test_today_defaults_to_the_real_date - As...\nFAILED .bench_check/test_hidden.py::test_existing_behaviour_is_kept - assert ...\nFAILED .bench_check/test_hidden.py::test_the_projects_own_tests_pass_and_cover_due_dates\n7 failed, 13 passed in 0.80s\n", "commit": "277bff6+dirty", "cost": 0.0, "failed_commands": 3, "fallbacks": [], "invented_tools": 0, "model": "mimo-v2.6-9b", "model_info": {"max_input_tokens": 262144, "max_output_tokens": 32768, "supports_function_calling": true, "supports_tool_choice": false}, "note": "llama.cpp b11206, Q6_K, q8_0 KV, 256k, temp 0.6 top-p 0.95 top-k 20, RTX 4090, 320 W cap", "outcome": "escalate", "outcome_note": "2 consecutive command failures; last: exit code: 1\nstdout:\nF.F...FFFF.F.F....F....FF [100%]\n=================================== FAILURES ===================================\n______________________ test_cli_add_due_and_list_overdue _______________________\n\ntmp_path = PosixPath('/tmp/pytest-of-root/pytest-193/test_cli_add_due_and_list_over0')\ncapsys = <_pytest.capture.CaptureFixture object at 0x7a8632deacc0>\n\n def test_cli_add_due_and_list_overdue(t", "prose_turns": 0, "provider": "openai", "rate_limit_wait_s": 0.0, "success": false, "task": "long-milestone", "task_hash": "ba436defff7d212f", "tokens_in": 285738, "tokens_out": 12320, "trimmed_requests": 0, "ts": "2026-09-27T23:16:32+00:00", "tuning": {"context": {"keep_recent_turns": 6, "safety_margin": 0.1}, "delegation": {"max_tokens": 200000, "max_turns": 30, "wall_clock_s": 900.0}, "executor": {"failure_limit": 2, "max_turns": 40}, "expert": {"consult_budget": 3}, "tools": {"command_timeout_s": 120, "max_output_chars": 4000}}, "turns": 33, "wall_s": 130.4}
Reference in new issue View Git Blame Copy Permalink