dongarandClaude Opus 5.5
089af0c391
What the fast path calls unknown is judged by an independent model call on the item's classifier role (L4), before it runs. - nisse_dev.loop.classifier: it sees the action and the agreed scope (project, repository, issue number, the restatement the operator said go to), built in code; never the transcript, the issue's text, tool output or the driver's reasoning. Its verdict is a tool call: safe runs; in_scope runs and is reported in the thread; needs_discussion asks, as a dangerous action does. An error, no verdict or an unknown one fails closed. Verdicts are cached per item, agreed revision and action. A helper is refused what needs discussion. - action_verdict gains source, model and the classifier's exact input; details shows the source. An allow after the classifier asked is an override. scripts/classifier-evals.py exports the judgements from a store, read-only; tests/integration/classifier_cases.yaml is the seed set, run per model with --capability-models. - The fast path's delete rule: deleting on the build VM is contained; only what breaks the host (system and home directories) stays dangerous, since in tests the build VM is the test machine. - The classifier role is the local model in the example config. - The property walk gains a classifier answering at random, junk and failures included; dangerous_only_when_allowed now covers its verdicts (checked against a mutant that runs them all). Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01PPQ14L3LikyefCMFBqEbKE
103 lines
4.8 KiB
YAML
103 lines
4.8 KiB
YAML
# Example configuration for nisse-dev. Copy to nisse-dev.yaml (or point
|
|
# NISSE_CONFIG at your copy) and edit.
|
|
#
|
|
# - Structure lives here. Secrets do not: write them as ${VARIABLE} references,
|
|
# resolved from the environment (or .env, see .env.example) at startup.
|
|
# - Keep this file outside the workspace clone. Startup refuses otherwise,
|
|
# because the agent commits and pushes everything in the clone.
|
|
# - Unknown keys are errors, so a misspelt knob fails at startup instead of
|
|
# silently doing nothing.
|
|
|
|
state_db: ~/nisse-demo-workspace/state.db
|
|
# loop: new # the new conversational loop (M2.1); default old (control.py)
|
|
|
|
# D8: one entry per project. A second project is a second entry (the old loop
|
|
# runs exactly one). Changed by PR like the rest of this file.
|
|
projects:
|
|
demo:
|
|
repo: owner/demo-repo
|
|
base_branch: main
|
|
workspace: /root/work/demo # the clone, on the build host
|
|
build_host: # L13: every command runs here, over SSH
|
|
address: build-demo.example
|
|
key: ~/.ssh/nisse-dev # the agent's key for the build host
|
|
# user: root
|
|
# port: 22
|
|
push_key: ~/.ssh/push-demo-repo # a deploy key with write access (D4)
|
|
# labels: [discuss] # added to every issue's own (D1)
|
|
# secrets: # by name; values only by reference (D7)
|
|
# DATABASE_URL: {value: "${DEMO_DATABASE_URL}", visible: commands}
|
|
# DEPLOY_TOKEN: {value: "${DEMO_DEPLOY_TOKEN}", visible: harness}
|
|
# egress: [pypi.org] # beyond the default; recorded, not yet enforced
|
|
|
|
llm: # L9: LiteLLM is the only LLM destination
|
|
base_url: http://litellm.example:4000
|
|
token: ${NISSE_LLM_TOKEN}
|
|
# Ceiling on each response. The model's own max_output_tokens in LiteLLM
|
|
# caps it further, which is where to hold a local model to less.
|
|
max_output_tokens: 16384
|
|
# How long one request may take before it is abandoned. A safety net for a
|
|
# hung connection; slow local models can take minutes over a long answer.
|
|
request_timeout_s: 600
|
|
|
|
roles: # L9: role -> LiteLLM model alias
|
|
# Each work item pins the mapping when it opens.
|
|
driver: claude-opus-5-5 # drives the loop: talks, restates, works
|
|
helper: claude-opus-5-5 # takes over what the driver got stuck on
|
|
expert: claude-haiku-4-5 # one question at a time, no tools: cheap is enough
|
|
# Reads go-aheads and judges actions the fast path doesn't know (L4); unset,
|
|
# the expert's. It never sees the transcript, so the driver's model is fine.
|
|
classifier: qwen3.8-27b
|
|
|
|
# Capability profiles (L9), from benchmarks: what one role is told about
|
|
# another (never a model's name). Optional; a model without one is briefed as
|
|
# "no profile recorded".
|
|
profiles:
|
|
qwen3.8-27b:
|
|
tools: reliable (37/40 on the executor benchmark, PR #55)
|
|
strengths: careful multi-step edits that follow a clear brief
|
|
weaknesses: speed (minutes per hard task) and open-ended design
|
|
claude-haiku-4-5:
|
|
tools: reliable
|
|
strengths: quick, well-scoped changes and short answers
|
|
weaknesses: long multi-file work (15/20 on the harder benchmark tasks)
|
|
claude-opus-5-5:
|
|
tools: reliable
|
|
strengths: design, debugging, and work other models got stuck on
|
|
weaknesses: cost; use it for what needs it
|
|
|
|
matrix: # L5
|
|
homeserver: https://matrix.example
|
|
user_id: "@nisse-dev:example"
|
|
token: ${NISSE_MATRIX_TOKEN}
|
|
room_id: "!roomid:example"
|
|
operators: ["@you:example"]
|
|
|
|
gitea: # D4, D5
|
|
url: https://gitea.example
|
|
token: ${NISSE_GITEA_TOKEN}
|
|
operators: [your-gitea-login]
|
|
|
|
# What each knob does, and how to choose a value: docs/Tuning-Guide.md.
|
|
# These are the defaults; the section can be left out entirely. The file is
|
|
# read at startup, so a change takes effect on the next restart.
|
|
tuning:
|
|
driver:
|
|
max_turns: 40 # model calls per driver run before it stops as capped
|
|
failure_limit: 2 # consecutive failed commands before escalating (L9)
|
|
expert:
|
|
consult_budget: 3 # ask_expert calls per milestone (L9)
|
|
delegation: # hard caps on one delegation (L9)
|
|
max_turns: 30
|
|
max_tokens: 200000
|
|
wall_clock_s: 900
|
|
tools:
|
|
command_timeout_s: 120 # one run_command before it is killed
|
|
max_output_chars: 4000 # tool output kept for the model, head and tail
|
|
context: # fitting each request into the model's window
|
|
keep_recent_turns: 6 # turns never cut or dropped
|
|
safety_margin: 0.1 # fraction of the window held back
|
|
loop: # the new loop (loop: new)
|
|
bug_grace_s: 600 # a `bug` restatement proceeds after this long unanswered
|
|
general_idle_s: 86400 # a conversation closes after this long without a message
|