Expert and integration roles on claude-haiku-5-5
claude-haiku-4-5 is being replaced by claude-haiku-5-5 in LiteLLM: the integration tests' roles and the example config's expert move to it. Its profile keeps the predecessor's benchmark figures, marked as such until it's measured. The plan's models-by-role line also gains the local classifier (M3.2). Results measured on 4.5 stay as they were. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01PPQ14L3LikyefCMFBqEbKE
This commit is contained in:
1 parent
b6eaceefa2
commit
5e1086c501
4 files changed
+10
-9
No files matched your search
@@ -16,7 +16,7 @@ from nisse_dev.gitea import GiteaClient, GiteaError
|
||||
from nisse_dev.llm import RoleMap
|
||||
|
||||
# The end-to-end tests run every role on a local model, which costs nothing
|
||||
# per call; NISSE_E2E_MODEL overrides it (e.g. claude-haiku-4-5 for a quick,
|
||||
# per call; NISSE_E2E_MODEL overrides it (e.g. claude-haiku-5-5 for a quick,
|
||||
# paid run). The no-thinking alias (LiteLLM: chat_template_kwargs
|
||||
# enable_thinking false): with thinking, some answers ran to 6-8k tokens,
|
||||
# minutes each, and stretched a test from 3.5 to 20 minutes.
|
||||
|
||||
@@ -36,9 +36,9 @@ llm:
|
||||
# not local-model competence (measured separately by test_model_capability),
|
||||
# so every role uses a model that holds the tool-call contract.
|
||||
roles:
|
||||
driver: claude-haiku-4-5
|
||||
helper: claude-haiku-4-5
|
||||
expert: claude-haiku-4-5
|
||||
driver: claude-haiku-5-5
|
||||
helper: claude-haiku-5-5
|
||||
expert: claude-haiku-5-5
|
||||
|
||||
matrix:
|
||||
homeserver: https://matrix.dongar.net
|
||||
|
||||
Reference in new issue
Block a user