dongarandClaude Opus 5.5 7a57cef9ff Benchmark: the seed is a git repository's first commit ...

The agent works in a clone, but benchmark workspaces were plain
directories, so a model that starts with `git log` failed two commands
in a row and was stopped as stuck within seconds (Flash-Next, 10 of 13
failures on 2026-10-24). The seed is now committed on main, locally and
on the build VM, and how a workspace is set up is part of each task's
hash, so earlier runs are reported as not comparable.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01J5Utyfzw7gF7UhjRDEtjTk

2026-10-24 02:44:22 +00:00

..

model_contract.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_agent_build.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_bench.py

Benchmark: the seed is a git repository's first commit

2026-10-24 02:44:22 +00:00

test_config.py

Compaction: the model's notes replace the middle of a long run (#158)

2026-10-17 22:51:36 +00:00

test_delegation.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_dev_main.py

Make the config file the only home for settings

2026-09-23 23:25:58 +00:00

test_dev_state.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_evals.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_git.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_actions.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_classifier.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_conversations.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_help.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_labels.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_live_fixes.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_memory.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_milestones.py

nisse-review marks a reply that settles its thread; the PR's author resolves it

2026-10-19 22:06:56 +00:00

test_loop_multi.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_new_projects.py

M7.2: share the loop's parts

2026-10-13 21:31:29 +00:00

test_loop_notes.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_peers.py

nisse-dev: a settled reply posted top-level is no point to answer either

2026-10-19 23:32:43 +00:00

test_loop_projects.py

M7.2: share the loop's parts

2026-10-13 21:31:29 +00:00

test_loop_properties.py

M7.2: share the loop's parts

2026-10-13 21:31:29 +00:00

test_loop_queue.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_talk.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_loop_toolchain.py

M7.2: share the loop's parts

2026-10-13 21:31:29 +00:00

test_loop_trust.py

M7.2: share the loop's parts

2026-10-13 21:31:29 +00:00

test_loop_vm.py

nisse-dev: a VM lost as a helper's work is taken back ends the run

2026-10-17 16:00:31 +00:00

test_loop.py

M7.2: share the loop's parts

2026-10-13 21:31:29 +00:00

test_preflight.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00

test_tools.py

nisse-core: group modules into packages by architecture section

2026-10-13 21:16:09 +00:00