dongarandClaude Opus 5.5
5e1086c501
claude-haiku-4-5 is being replaced by claude-haiku-5-5 in LiteLLM: the integration tests' roles and the example config's expert move to it. Its profile keeps the predecessor's benchmark figures, marked as such until it's measured. The plan's models-by-role line also gains the local classifier (M3.2). Results measured on 4.5 stay as they were. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01PPQ14L3LikyefCMFBqEbKE
56 lines
2.2 KiB
YAML
56 lines
2.2 KiB
YAML
# Agent config for the live integration tests, aimed at test resources: the
|
|
# testing identities, the dedicated test room, and the sandbox repo. Never
|
|
# point it at production.
|
|
#
|
|
# Secrets are ${…} references. CI passes them as environment variables;
|
|
# locally they come from .env at the repository root. A missing one fails
|
|
# the live tests that need it, rather than skipping them, so a broken
|
|
# credential cannot hide as a skip.
|
|
|
|
# Unused by the live tests, which work in pytest's temporary directories;
|
|
# present because every agent config has it.
|
|
state_db: /tmp/nisse-test/state.db
|
|
|
|
projects:
|
|
nisse-dev-testing:
|
|
# Placeholders: every live test that touches a repository makes one of
|
|
# its own (tests/integration/e2e_support.py, fresh_repo), owned by the
|
|
# test operator and deleted afterwards, with its own deploy key; and runs
|
|
# on a throwaway local sshd (the `ssh_host` fixture) or the bring-up build
|
|
# VM, in temporary directories.
|
|
repo: nisse-testing-operator/made-per-run
|
|
workspace: /tmp/nisse-test/work
|
|
build_host:
|
|
address: 127.0.0.1
|
|
key: /tmp/nisse-test/unused-key
|
|
|
|
llm:
|
|
base_url: https://litellm.dongar.net
|
|
token: ${NISSE_LLM_TOKEN}
|
|
# The test key caps each request's worst-case cost ($0.10): input plus
|
|
# this much reserved output. The test agent's replies are short, so half
|
|
# the default leaves room for ~40k input tokens on Haiku.
|
|
max_output_tokens: 8192
|
|
|
|
# The live tests exercise the gated loop and the routes over a real proxy,
|
|
# not local-model competence (measured separately by test_model_capability),
|
|
# so every role uses a model that holds the tool-call contract.
|
|
roles:
|
|
driver: claude-haiku-5-5
|
|
helper: claude-haiku-5-5
|
|
expert: claude-haiku-5-5
|
|
|
|
matrix:
|
|
homeserver: https://matrix.dongar.net
|
|
user_id: "@nisse-dev-testing:dongar.net"
|
|
token: ${NISSE_MATRIX_TOKEN}
|
|
room_id: "!UxpXhTlQsFIeNZwkgv:dongar.net" # the test room, never production
|
|
operators: ["@dongar:dongar.net"]
|
|
|
|
gitea:
|
|
url: https://gitea.dongar.net
|
|
token: ${NISSE_GITEA_TOKEN}
|
|
# nisse-testing-operator plays the operator in the end-to-end tests
|
|
# (NISSE_OPERATOR_TOKEN); an operator here and nowhere else.
|
|
operators: [dongar, nisse-testing-operator]
|