Add concurrent-session MCP restart safety tests (dogfooding) #666

Open
opened 2026-07-10 15:32:58 -05:00 by jcwalker3 · 0 comments
Owner

Problem statement

No realistic concurrent-session test suite proves restart governance: unilateral deny, drain behavior, checkpoints, lease safety, scoped restart non-interference.

Operational impact

Regressions ship unnoticed; dogfooding requirement unenforceable.

Scope

Automated tests proving:

  1. One LLM cannot restart MCP unilaterally
  2. New work stops during drain
  3. Active safe work can finish
  4. Unsafe mutations block restart
  5. Session state is durably checkpointed
  6. Leases/locks not silently orphaned
  7. Sessions resume or receive canonical next action
  8. Failed drain creates durable incident work
  9. Restart of one component does not unnecessarily interrupt unrelated work
  10. Restart/upgrade workflows do not require manual chat reconstruction

Use fixtures/fakes for multi-session; integration where safe.

Non-goals

  • Live kill of developer machines in CI.
  • Full HA multi-node tests (later).

Required implementation investigation

#655 children; pytest patterns; compliance harness.

Proposed implementation direction

tests/test_mcp_restart_governance.py multi-agent simulation harness.

Security / workflow-safety

Tests must not disable fail-closed gates globally.

Failure behavior

Test fail = release blocker for restart features.

Acceptance criteria

  1. All 10 dogfooding bullets covered by tests (or explicitly marked pending with issue if env-blocked).
  2. CI runs suite on restart-related changes.
  3. Links #652 #653 #655.

Required tests

This issue is the test delivery.

Observability and audit

N/A beyond test logs.

Dependencies

  • Parent #655 · Soft-depends #658–#665 · Vision #652 · Roadmap #653

Rollout

Land tests alongside features; expand coverage incrementally.

Canonical issue state

STATE: ready-for-author
WHO_IS_NEXT: author
NEXT_ACTION: Implement concurrent restart safety tests
NEXT_PROMPT: Author dogfooding tests under #655; PR; stop

Required proof

Green test suite output in PR.

Required final response and handoff

Brief PR → reviewer.

## Problem statement No realistic concurrent-session test suite proves restart governance: unilateral deny, drain behavior, checkpoints, lease safety, scoped restart non-interference. ## Operational impact Regressions ship unnoticed; dogfooding requirement unenforceable. ## Scope Automated tests proving: 1. One LLM cannot restart MCP unilaterally 2. New work stops during drain 3. Active safe work can finish 4. Unsafe mutations block restart 5. Session state is durably checkpointed 6. Leases/locks not silently orphaned 7. Sessions resume or receive canonical next action 8. Failed drain creates durable incident work 9. Restart of one component does not unnecessarily interrupt unrelated work 10. Restart/upgrade workflows do not require manual chat reconstruction Use fixtures/fakes for multi-session; integration where safe. ## Non-goals * Live kill of developer machines in CI. * Full HA multi-node tests (later). ## Required implementation investigation #655 children; pytest patterns; compliance harness. ## Proposed implementation direction `tests/test_mcp_restart_governance.py` multi-agent simulation harness. ## Security / workflow-safety Tests must not disable fail-closed gates globally. ## Failure behavior Test fail = release blocker for restart features. ## Acceptance criteria 1. All 10 dogfooding bullets covered by tests (or explicitly marked pending with issue if env-blocked). 2. CI runs suite on restart-related changes. 3. Links #652 #653 #655. ## Required tests This issue *is* the test delivery. ## Observability and audit N/A beyond test logs. ## Dependencies * Parent **#655** · Soft-depends **#658–#665** · Vision **#652** · Roadmap **#653** ## Rollout Land tests alongside features; expand coverage incrementally. ## Canonical issue state ```text STATE: ready-for-author WHO_IS_NEXT: author NEXT_ACTION: Implement concurrent restart safety tests NEXT_PROMPT: Author dogfooding tests under #655; PR; stop ``` ## Required proof Green test suite output in PR. ## Required final response and handoff Brief PR → reviewer.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Scaled-Tech-Consulting/Gitea-Tools#666