dongarandClaude Opus 5.5
8994b3fb4b
- Questions never change state (L5, #77): a message ending in "?" to a waiting project item starts a question run (reply and look-only tools, an instruction to change nothing), and the item goes back to the very wait it was in: a restatement up stays up and a go binds to it; the agent's own question stays open. - Explanations: a restatement gives its reasons and the main alternative; a revision says what changed (restate(changed), sent back without it); a milestone's summary says what was done, verified and left open. - Progress in prose (#42): the driver's and a helper's own words for a turn are posted, trimmed, at most once a minute per item; `details` shows the last tool calls; a message arriving mid-run is acknowledged at once ("Noted; ..."). - CI: the e2e job's comments and the plan no longer claim a newer push cancels the run it supersedes (Gitea here doesn't); the concurrency block goes. Tests: conversation unit tests (questions in a go-ahead and an answer wait, an unanswerable question, revisions, progress rate and trimming, details, mid-run notes), the helper's progress, the walk asking questions in every state with a questions_change_nothing property (routing questions the old way fails 32 of 48 seeds), and an e2e question while a restatement is up. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01PPQ14L3LikyefCMFBqEbKE
97 lines
3.5 KiB
YAML
97 lines
3.5 KiB
YAML
name: CI
|
|
on:
|
|
# Only main on push. A PR branch is already covered by the pull_request
|
|
# event, and running both fired two identical suites concurrently — which
|
|
# doubled the LLM tokens the live tests spend and tripped the proxy's
|
|
# per-minute limit.
|
|
push:
|
|
branches: [main]
|
|
pull_request:
|
|
# Manual re-run, e.g. after rotating a credential or raising a budget cap.
|
|
workflow_dispatch:
|
|
|
|
jobs:
|
|
checks:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
|
|
- name: Install uv
|
|
run: |
|
|
curl -LsSf https://astral.sh/uv/install.sh | sh
|
|
echo "$HOME/.local/bin" >> "$GITHUB_PATH"
|
|
|
|
- name: Sync workspace
|
|
run: uv sync --all-packages
|
|
|
|
- name: Install sshd
|
|
# The tests reach "the build VM" over real SSH, through a throwaway
|
|
# sshd the test fixture starts (nisse_dev/testing.py).
|
|
run: |
|
|
SUDO=$(command -v sudo || true)
|
|
$SUDO apt-get update -qq
|
|
$SUDO apt-get install -y -qq openssh-server openssh-client > /dev/null
|
|
$SUDO mkdir -p /run/sshd
|
|
|
|
- name: Lint
|
|
run: uv run ruff check .
|
|
|
|
- name: Format check
|
|
run: uv run ruff format --check .
|
|
|
|
- name: Unit tests
|
|
run: uv run pytest -m "not integration and not e2e"
|
|
|
|
- name: Integration tests
|
|
# Everything but the secrets is in tests/integration/nisse-test.yaml,
|
|
# which refers to these by name. A missing secret fails the live
|
|
# tests that need it; it is never quietly turned into a skip.
|
|
env:
|
|
NISSE_LLM_TOKEN: ${{ secrets.NISSE_LLM_TOKEN }}
|
|
NISSE_MATRIX_TOKEN: ${{ secrets.NISSE_MATRIX_TOKEN }}
|
|
NISSE_GITEA_TOKEN: ${{ secrets.NISSE_GITEA_TOKEN }}
|
|
# The test operator, who makes each run's repository (and its deploy
|
|
# key) and deletes it afterwards.
|
|
NISSE_OPERATOR_TOKEN: ${{ secrets.NISSE_OPERATOR_TOKEN }}
|
|
run: uv run pytest -m "integration and not e2e" -rs
|
|
|
|
e2e:
|
|
# The end-to-end suite (scripts/e2e.sh): the whole agent against real
|
|
# services, every role on a local model, so it spends nothing but keeps
|
|
# the RTX 4090 busy for ~25 minutes. On PRs only, and only after the
|
|
# checks pass: a PR that's red already doesn't spend the GPU. There is
|
|
# one runner and Gitea doesn't honour cancel-in-progress, so a run a
|
|
# newer push supersedes holds the runner until it's cancelled by hand.
|
|
# Locally, run only what you're writing (-k) or diagnosing (--lf).
|
|
if: github.event_name != 'push'
|
|
needs: checks
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 90
|
|
steps:
|
|
- uses: actions/checkout@v4
|
|
|
|
- name: Install uv
|
|
run: |
|
|
curl -LsSf https://astral.sh/uv/install.sh | sh
|
|
echo "$HOME/.local/bin" >> "$GITHUB_PATH"
|
|
|
|
- name: Sync workspace
|
|
run: uv sync --all-packages
|
|
|
|
- name: Install sshd
|
|
# The build VM is a throwaway sshd here (scripts/e2e.sh --local).
|
|
run: |
|
|
SUDO=$(command -v sudo || true)
|
|
$SUDO apt-get update -qq
|
|
$SUDO apt-get install -y -qq openssh-server openssh-client > /dev/null
|
|
$SUDO mkdir -p /run/sshd
|
|
|
|
- name: End-to-end tests
|
|
env:
|
|
NISSE_LLM_TOKEN: ${{ secrets.NISSE_LLM_TOKEN }}
|
|
NISSE_MATRIX_TOKEN: ${{ secrets.NISSE_MATRIX_TOKEN }}
|
|
NISSE_GITEA_TOKEN: ${{ secrets.NISSE_GITEA_TOKEN }}
|
|
NISSE_OPERATOR_TOKEN: ${{ secrets.NISSE_OPERATOR_TOKEN }}
|
|
NISSE_E2E_RUNS: /tmp/nisse-e2e-runs
|
|
run: scripts/e2e.sh --local -v
|