dongarandClaude Opus 5.5
1ad0b2147d
CI / checks (push) Skipped
CI / checks (pull_request) Successful in 1m22s
Development Plan M0.1. Every section reference in code, tests, specs/, the example config, the tuning guide, and the CLAUDE.md and README files now cites docs/Architecture.md (P, L, D, O, X, Q) instead of the old spec's A-H, and docs/Architecture-Build-Spec.md is deleted (git keeps it). The plan's old-to-new table goes with it. Mostly mechanical, with a per-site choice where one old section split: A4 became L2 where it meant stop/abandon/the loop and L3 where it meant approvals; A10 became L6 in the context-budget code and L7 elsewhere; B2 became D4 for outbound Gitea and publishing and D5 for review intake; 'A3 step N' became the matching step of L8's boot sequence. Comments describing behaviour the architecture drops (planning always escalating, thresholds tuned at an old build step) now describe the current code and point at the Development Plan. docs/Architecture.md gains one line the rewrite missed: intake outages delay but never fail work (old B2), now in L5, where the poller and Matrix code cite it. Comments and docs only; no behaviour change. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01PPQ14L3LikyefCMFBqEbKE
55 lines
1.7 KiB
Python
55 lines
1.7 KiB
Python
"""A real consult over the normalized route (L9).
|
|
|
|
The point is the prompt-level contract: a live model must produce something
|
|
that parses against our local schema, since no API-level enforcement exists.
|
|
"""
|
|
|
|
import io
|
|
from pathlib import Path
|
|
|
|
import pytest
|
|
|
|
from nisse_dev.evals import collect
|
|
from nisse_dev.expert import BudgetExhausted, ExpertDesk
|
|
from nisse_dev.llm import LiteLLMClient, RoleMap
|
|
from nisse_dev.oplog import OpLog
|
|
from nisse_dev.state import StateStore
|
|
|
|
pytestmark = pytest.mark.integration
|
|
|
|
|
|
@pytest.fixture
|
|
def desk(tmp_path: Path, litellm: LiteLLMClient, live_model: str):
|
|
def make(budget: int = 2) -> tuple[ExpertDesk, StateStore]:
|
|
model = live_model
|
|
roles = RoleMap(executor=model, planner=model, delegate=model, consultant=model)
|
|
store = StateStore(
|
|
tmp_path / "state.db", oplog=OpLog("nisse-dev", io.StringIO())
|
|
)
|
|
return ExpertDesk(litellm, store, roles, budget=budget), store
|
|
|
|
return make
|
|
|
|
|
|
def test_live_consult_parses_against_the_local_schema(desk) -> None:
|
|
expert, store = desk()
|
|
|
|
answer = expert.ask(
|
|
"For a single-process agent storing a few thousand rows of task state, "
|
|
"is SQLite sufficient, or is PostgreSQL warranted? Answer briefly."
|
|
)
|
|
|
|
assert answer.confidence in {"high", "medium", "low"}
|
|
assert len(answer.answer) > 20
|
|
# The consult is captured for L9 without any extra bookkeeping.
|
|
[record] = collect(store)
|
|
assert record.role == "consultant"
|
|
assert record.exit_status == "answered"
|
|
|
|
|
|
def test_live_budget_stops_a_circling_caller(desk) -> None:
|
|
expert, _ = desk(budget=1)
|
|
expert.ask("Name one advantage of WAL mode in SQLite. Be brief.")
|
|
with pytest.raises(BudgetExhausted):
|
|
expert.ask("And another?")
|