Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
a947bdc186 | ||
|
|
2b4e43042a | ||
|
|
0f9390aab4 | ||
|
|
d7ad2838ec | ||
|
|
c6d68dbc7b | ||
|
|
e43ddd3cbe | ||
|
|
59aab06fe1 |
@@ -0,0 +1,83 @@
|
||||
# Incident #670: bare direct-to-master commit `2fa97c26` (retroactive audit)
|
||||
|
||||
Status: verified; disposition recommendation: **accept as-is, no revert** (final
|
||||
disposition owned by controller per issue #670).
|
||||
|
||||
## Summary
|
||||
|
||||
Commit `2fa97c26fbda555a1a83930ca5fdcea9d8e47b50`
|
||||
(`fix(mcp): load dotenv relative to project root`) landed on `prgs/master`
|
||||
as a single-parent commit with no PR wrapper and no review record, bypassing
|
||||
the sanctioned issue → branch → PR → review → merge workflow. It was
|
||||
discovered during the PR #654 post-merge audit. PR #654 itself merged
|
||||
cleanly via the Gitea API and did **not** introduce this commit.
|
||||
|
||||
## Verification evidence (acceptance criteria 1–3)
|
||||
|
||||
- **AC1 — present on `prgs/master`: yes.**
|
||||
`git merge-base --is-ancestor 2fa97c26fbda555a1a83930ca5fdcea9d8e47b50 prgs/master` → true.
|
||||
- **AC2 — no PR or review record: confirmed.**
|
||||
The commit is a single-parent, non-merge commit sitting directly on
|
||||
first-parent master between the #629 merge (`5ab5fe85`) and the #654
|
||||
merge (`ec903b0d`). A PR landing on master produces a merge commit (or a
|
||||
PR-linked head); neither exists here. The controller audit at issue-create
|
||||
time also found no PR wrapper and no review record for this SHA.
|
||||
- **AC3 — changed files and diff summary: confirmed.**
|
||||
`gitea_auth.py | 5 +++--` (+3/−2). Single parent
|
||||
`5ab5fe8583c07134d55dadf09381aecb67df246e`. The change moves
|
||||
`PROJECT_ROOT` derivation above `load_dotenv()` and loads
|
||||
`.env` relative to the project root instead of the process CWD.
|
||||
|
||||
## AC4 — why no immediate revert
|
||||
|
||||
- The dotenv fix is intentional and required for correct runtime behavior:
|
||||
without it, `load_dotenv()` resolves `.env` against the process working
|
||||
directory, which breaks MCP server launches whose CWD is not the project
|
||||
root.
|
||||
- The change is small (+3/−2), self-contained in `gitea_auth.py`, and has
|
||||
been running on master without incident since 2026-07-10.
|
||||
- Reverting would re-introduce a real bug to remove a provenance defect —
|
||||
the wrong trade. Provenance is repaired retroactively by this document,
|
||||
issue #670, and the hardening landed under #671.
|
||||
- If the controller later judges the change unsafe, a separate
|
||||
revert/repair issue is the sanctioned path (issue #670, recommended
|
||||
disposition option 4).
|
||||
|
||||
## AC5 — workflow-hardening linkage
|
||||
|
||||
Prevention already landed: **issue #671** (closed)
|
||||
*“Block direct pushes to stable branches from MCP workflow sessions”*,
|
||||
implemented by commit `5933d87647656643a67a50331c4c7b06ea751dad`
|
||||
(`feat(guard): block direct stable-branch pushes from MCP workflow sessions`).
|
||||
|
||||
Shipped guardrails include:
|
||||
|
||||
- `gitea_record_stable_branch_push_attempt` — classifies proposed commands
|
||||
for direct stable-branch push intent (`git push <remote> master`,
|
||||
refspecs, `HEAD:master`, `--force`, dry-run intent, `:master` delete),
|
||||
plus root/control-checkout local commits not carried by an issue branch,
|
||||
and writes a durable `stable_branch_contamination` marker.
|
||||
- `gitea_audit_stable_branch_contamination` — reconciler-only audit/clear
|
||||
path; a contaminated worker session cannot self-clear.
|
||||
- Review/merge/close/completion mutations fail closed while a
|
||||
contamination marker is active.
|
||||
|
||||
## AC6 — PR #654 was not the source
|
||||
|
||||
- `2fa97c26` is the **first parent** of the #654 merge commit
|
||||
`ec903b0d619e7a27d24aed272a890f4e5d381411`; it predates the #654 merge.
|
||||
- First-parent history `5ab5fe8..ec903b0`:
|
||||
`2fa97c2 fix(mcp): load dotenv relative to project root` followed by
|
||||
`ec903b0 Merge pull request 'feat: lifecycle role/hazard labels ... (#603)' (#654)`.
|
||||
- The #654 merger audit confirmed `ec903b0d` was a valid Gitea-API merge,
|
||||
the `git push prgs master` attempt during that run was a no-op, and the
|
||||
net change `2fa97c2..ec903b0` contained only the reviewed #603
|
||||
lifecycle-label files.
|
||||
- Conclusion: #654 merged reviewed content only; the unauthorized-path
|
||||
defect is solely the earlier bare commit `2fa97c26`.
|
||||
|
||||
## Explicit non-actions (unchanged by this audit)
|
||||
|
||||
- No revert of `2fa97c26`.
|
||||
- No force-push or history rewrite.
|
||||
- No master mutation from the audit session.
|
||||
+15
-1
@@ -24,6 +24,8 @@ import subprocess
|
||||
import uuid
|
||||
from datetime import datetime, timedelta, timezone
|
||||
from typing import Any
|
||||
import hashlib
|
||||
|
||||
|
||||
|
||||
|
||||
@@ -2258,7 +2260,12 @@ def _seed_session_context(
|
||||
expected_username=expected,
|
||||
source=source,
|
||||
canonical_repository_root=canonical_root_pin,
|
||||
cohort_id=_COHORT_ID,
|
||||
startup_sha=_STARTUP_PARITY.get("startup_head"),
|
||||
endpoint=host or (profile.get("base_url") or "").strip() or None,
|
||||
config_fingerprint=_CONFIG_FINGERPRINT,
|
||||
)
|
||||
|
||||
import issue_work_duplicate_gate # noqa: E402
|
||||
import issue_workflow_labels # noqa: E402
|
||||
import terminal_pr_label_cleanup # noqa: E402 # #780 status:pr-open terminal rule
|
||||
@@ -2287,6 +2294,11 @@ import stable_control_runtime # noqa: E402
|
||||
# master has advanced past the running code and fail closed until restart.
|
||||
# Read-only operations are never blocked by staleness.
|
||||
_STARTUP_PARITY = master_parity_gate.capture_startup_parity(PROJECT_ROOT)
|
||||
_COHORT_ID: str = f"cohort-p{os.getpid()}-{_STARTUP_PARITY.get('startup_head') or 'unknown'}"
|
||||
_CONFIG_FINGERPRINT: str = hashlib.sha256(
|
||||
(PROJECT_ROOT + str(_STARTUP_PARITY.get("startup_head"))).encode("utf-8")
|
||||
).hexdigest()[:16]
|
||||
|
||||
|
||||
# Stable-control runtime facts (#615): which runtime this process serves from.
|
||||
# These are the *immutable* facts -- process root, branch, head, checkout-ness --
|
||||
@@ -14197,8 +14209,10 @@ def _current_master_parity() -> dict:
|
||||
current_head = master_parity_gate.read_git_head(PROJECT_ROOT)
|
||||
live_head = master_parity_gate.read_remote_master_head(
|
||||
PROJECT_ROOT, remote=_git_default_remote_name(PROJECT_ROOT))
|
||||
bound_context = session_ctx.get_session_context()
|
||||
return master_parity_gate.assess_master_parity(
|
||||
_STARTUP_PARITY, current_head, live_remote_head=live_head)
|
||||
_STARTUP_PARITY, current_head, live_remote_head=live_head, bound_cohort=bound_context)
|
||||
|
||||
|
||||
|
||||
def _current_runtime_mode_report(refresh: bool = False) -> dict:
|
||||
|
||||
+70
-9
@@ -183,6 +183,7 @@ def assess_master_parity(
|
||||
startup: dict | None,
|
||||
current_head: str | None,
|
||||
live_remote_head: str | None = None,
|
||||
bound_cohort: dict | None = None,
|
||||
) -> dict:
|
||||
"""Compare the startup baseline against the current on-disk ``HEAD``.
|
||||
|
||||
@@ -192,7 +193,8 @@ def assess_master_parity(
|
||||
could not be determined, which is not treated as stale).
|
||||
- ``stale`` -- the on-disk master has definitively advanced past the
|
||||
running process.
|
||||
- ``restart_required`` -- ``stale`` or ``live_stale``; the recovery action.
|
||||
- ``restart_required`` -- ``stale``, ``live_stale``, or ``cohort_stale``; the
|
||||
recovery action.
|
||||
- ``determinable`` -- whether both local HEADs were known well enough to
|
||||
compare.
|
||||
- ``startup_head`` / ``current_head`` / ``reasons``.
|
||||
@@ -209,24 +211,69 @@ def assess_master_parity(
|
||||
- ``live_known`` -- whether the live remote target was resolved.
|
||||
- ``live_stale`` -- the live remote master has advanced past the running
|
||||
process (daemon is behind live master) even if local parity is green.
|
||||
- ``mutation_safe`` -- the daemon code, local checkout, and live remote
|
||||
target all agree; the only state in which a mutation may rely on parity.
|
||||
- ``bound_cohort`` -- metadata describing the bound MCP cohort.
|
||||
- ``cohort_parity_match`` -- whether bound cohort startup SHA matches parity.
|
||||
- ``cohort_stale`` -- bound cohort startup SHA is stale relative to parity.
|
||||
- ``mutation_safe`` -- the daemon code, local checkout, live remote target,
|
||||
and bound cohort all agree; the only state in which a mutation may rely
|
||||
on parity.
|
||||
"""
|
||||
startup_head = (startup or {}).get("startup_head")
|
||||
reasons: list[str] = []
|
||||
|
||||
cohort_info: dict | None = None
|
||||
cohort_parity_match = True
|
||||
cohort_stale = False
|
||||
if bound_cohort:
|
||||
c_id = str(bound_cohort.get("cohort_id") or "").strip() or None
|
||||
c_pid = bound_cohort.get("pid")
|
||||
c_sha = str(
|
||||
bound_cohort.get("startup_sha")
|
||||
or bound_cohort.get("git_head")
|
||||
or ""
|
||||
).strip() or None
|
||||
c_endpoint = str(bound_cohort.get("endpoint") or "").strip() or None
|
||||
c_fingerprint = str(
|
||||
bound_cohort.get("config_fingerprint") or ""
|
||||
).strip() or None
|
||||
|
||||
cohort_info = {
|
||||
"cohort_id": c_id,
|
||||
"pid": c_pid,
|
||||
"startup_sha": c_sha,
|
||||
"endpoint": c_endpoint,
|
||||
"config_fingerprint": c_fingerprint,
|
||||
}
|
||||
|
||||
parity_ref = live_remote_head or current_head or startup_head
|
||||
if c_sha and parity_ref:
|
||||
if c_sha.lower() != parity_ref.lower():
|
||||
cohort_parity_match = False
|
||||
cohort_stale = True
|
||||
reasons.append(
|
||||
f"bound cohort startup SHA '{_short(c_sha)}' does not "
|
||||
f"match authoritative parity SHA '{_short(parity_ref)}' "
|
||||
"(stale cohort refused)"
|
||||
)
|
||||
|
||||
if startup_head is None:
|
||||
reasons.append(
|
||||
"startup commit was not captured; code parity cannot be enforced")
|
||||
return _result(True, False, False, startup_head, current_head,
|
||||
live_remote_head, False, reasons)
|
||||
live_remote_head, False, reasons,
|
||||
bound_cohort=cohort_info,
|
||||
cohort_parity_match=cohort_parity_match,
|
||||
cohort_stale=cohort_stale)
|
||||
|
||||
if current_head is None:
|
||||
reasons.append(
|
||||
"current workspace HEAD could not be read; code parity cannot be "
|
||||
"enforced")
|
||||
return _result(True, False, False, startup_head, current_head,
|
||||
live_remote_head, False, reasons)
|
||||
live_remote_head, False, reasons,
|
||||
bound_cohort=cohort_info,
|
||||
cohort_parity_match=cohort_parity_match,
|
||||
cohort_stale=cohort_stale)
|
||||
|
||||
local_in_parity = startup_head == current_head
|
||||
local_stale = not local_in_parity
|
||||
@@ -246,18 +293,28 @@ def assess_master_parity(
|
||||
|
||||
return _result(
|
||||
local_in_parity, local_stale, True, startup_head, current_head,
|
||||
live_remote_head, live_stale, reasons)
|
||||
live_remote_head, live_stale, reasons,
|
||||
bound_cohort=cohort_info,
|
||||
cohort_parity_match=cohort_parity_match,
|
||||
cohort_stale=cohort_stale)
|
||||
|
||||
|
||||
def _result(in_parity, stale, determinable, startup_head, current_head,
|
||||
live_remote_head, live_stale, reasons):
|
||||
live_remote_head, live_stale, reasons, bound_cohort=None,
|
||||
cohort_parity_match=True, cohort_stale=False):
|
||||
live_known = live_remote_head is not None
|
||||
mutation_safe = (
|
||||
determinable and in_parity and live_known and not live_stale)
|
||||
determinable
|
||||
and in_parity
|
||||
and live_known
|
||||
and not live_stale
|
||||
and cohort_parity_match
|
||||
and not cohort_stale
|
||||
)
|
||||
return {
|
||||
"in_parity": in_parity,
|
||||
"stale": stale,
|
||||
"restart_required": stale or live_stale,
|
||||
"restart_required": stale or live_stale or cohort_stale,
|
||||
"determinable": determinable,
|
||||
"startup_head": startup_head,
|
||||
"current_head": current_head,
|
||||
@@ -267,11 +324,15 @@ def _result(in_parity, stale, determinable, startup_head, current_head,
|
||||
"live_remote_head": live_remote_head,
|
||||
"live_known": live_known,
|
||||
"live_stale": live_stale,
|
||||
"cohort_parity_match": cohort_parity_match,
|
||||
"cohort_stale": cohort_stale,
|
||||
"bound_cohort": bound_cohort,
|
||||
"mutation_safe": mutation_safe,
|
||||
"reasons": list(reasons),
|
||||
}
|
||||
|
||||
|
||||
|
||||
def gate_disabled() -> bool:
|
||||
"""Whether the parity gate is disabled by env escape hatch."""
|
||||
return bool((os.environ.get(ENV_DISABLE) or "").strip())
|
||||
|
||||
+45
-3
@@ -104,6 +104,8 @@ def classify_namespace_probe(
|
||||
profile: str | None = None,
|
||||
configured: bool = True,
|
||||
probe_source: str | None = None,
|
||||
expected_parity_sha: str | None = None,
|
||||
bound_cohort: dict[str, Any] | None = None,
|
||||
) -> dict[str, Any]:
|
||||
"""Classify whether a required tool is callable through a live namespace.
|
||||
|
||||
@@ -135,20 +137,50 @@ def classify_namespace_probe(
|
||||
else:
|
||||
error_type = "namespace_call_failed"
|
||||
|
||||
# Extract cohort metadata
|
||||
cohort_meta = bound_cohort or probe.get("cohort") or probe.get("bound_cohort") or {}
|
||||
cohort_id = str(
|
||||
cohort_meta.get("cohort_id") or probe.get("cohort_id") or ""
|
||||
).strip() or None
|
||||
startup_sha = str(
|
||||
cohort_meta.get("startup_sha")
|
||||
or cohort_meta.get("git_head")
|
||||
or probe.get("startup_sha")
|
||||
or probe.get("git_head")
|
||||
or ""
|
||||
).strip() or None
|
||||
endpoint = str(
|
||||
cohort_meta.get("endpoint") or probe.get("endpoint") or ""
|
||||
).strip() or None
|
||||
config_fingerprint = str(
|
||||
cohort_meta.get("config_fingerprint") or probe.get("config_fingerprint") or ""
|
||||
).strip() or None
|
||||
|
||||
expected_sha = (expected_parity_sha or "").strip().lower() or None
|
||||
stale_cohort = False
|
||||
if expected_sha and startup_sha:
|
||||
if startup_sha.lower() != expected_sha:
|
||||
stale_cohort = True
|
||||
error_type = "stale_cohort_refused"
|
||||
|
||||
if not configured:
|
||||
error_type = "namespace_not_configured"
|
||||
elif registered is False:
|
||||
error_type = "tool_missing"
|
||||
elif not probe_result:
|
||||
error_type = "live_probe_missing"
|
||||
elif stale_cohort:
|
||||
error_type = "stale_cohort_refused"
|
||||
elif not probe_success and not error_type:
|
||||
error_type = "namespace_call_failed"
|
||||
|
||||
callable_live = bool(configured and probe_result and probe_success)
|
||||
callable_live = bool(configured and probe_result and probe_success and not stale_cohort)
|
||||
# Probe-path health (spawn or client). IDE-proven only for client path.
|
||||
healthy = bool(configured and registered is not False and callable_live)
|
||||
ide_namespace_proven = bool(healthy and source == PROBE_SOURCE_CLIENT)
|
||||
process_pid = process.get("pid") if isinstance(process, dict) else None
|
||||
process_pid = process.get("pid") if isinstance(process, dict) else (
|
||||
cohort_meta.get("pid") if isinstance(cohort_meta, dict) else None
|
||||
)
|
||||
profile_name = profile or (
|
||||
process.get("profile") if isinstance(process, dict) else None
|
||||
)
|
||||
@@ -161,7 +193,13 @@ def classify_namespace_probe(
|
||||
reasons.append(
|
||||
f"Required tool '{tool}' is not registered in namespace '{ns}'."
|
||||
)
|
||||
if error_type == "live_probe_missing":
|
||||
if error_type == "stale_cohort_refused":
|
||||
reasons.append(
|
||||
f"Bound cohort startup SHA '{startup_sha[:12] if startup_sha else 'unknown'}' "
|
||||
f"does not match expected parity SHA '{expected_sha[:12] if expected_sha else 'unknown'}' "
|
||||
"(stale cohort refused)."
|
||||
)
|
||||
elif error_type == "live_probe_missing":
|
||||
reasons.append(
|
||||
f"No live client invocation proof was supplied for '{ns}.{tool}'."
|
||||
)
|
||||
@@ -248,6 +286,10 @@ def classify_namespace_probe(
|
||||
"env": env_summary,
|
||||
"config_path": config_path,
|
||||
"probe_source": source,
|
||||
"cohort_id": cohort_id,
|
||||
"startup_sha": startup_sha,
|
||||
"endpoint": endpoint,
|
||||
"config_fingerprint": config_fingerprint,
|
||||
},
|
||||
"blocks_merge_workflow": blocks,
|
||||
}
|
||||
|
||||
@@ -151,12 +151,16 @@ class RestartCompletionProof:
|
||||
unresolved_count: int
|
||||
skipped_count: int
|
||||
note: str
|
||||
binding_unchanged: bool = False
|
||||
prior_reconcile_id: str | None = None
|
||||
|
||||
def as_dict(self) -> dict[str, Any]:
|
||||
return {
|
||||
"schema_version": self.schema_version,
|
||||
"reconcile_version": self.reconcile_version,
|
||||
"reconcile_id": self.reconcile_id,
|
||||
"binding_unchanged": self.binding_unchanged,
|
||||
"prior_reconcile_id": self.prior_reconcile_id,
|
||||
"started_at": self.started_at,
|
||||
"finished_at": self.finished_at,
|
||||
"boot_head_sha": self.boot_head_sha,
|
||||
@@ -173,6 +177,7 @@ class RestartCompletionProof:
|
||||
"skipped_count": self.skipped_count,
|
||||
"note": self.note,
|
||||
"links": {
|
||||
|
||||
"umbrella": 655,
|
||||
"vision": 652,
|
||||
"roadmap": 653,
|
||||
@@ -359,7 +364,9 @@ def reconcile_after_restart(
|
||||
now: datetime | None = None,
|
||||
mode: str = MODE_LOG_ONLY,
|
||||
reconcile_id: str | None = None,
|
||||
prior_reconcile_id: str | None = None,
|
||||
) -> RestartCompletionProof:
|
||||
|
||||
"""Classify a post-restart inventory into a completion proof (#662).
|
||||
|
||||
Parameters
|
||||
@@ -750,12 +757,26 @@ def reconcile_after_restart(
|
||||
f"Mode={mode_norm}."
|
||||
)
|
||||
|
||||
prior_id = str(
|
||||
prior_reconcile_id
|
||||
or inventory.get("prior_reconcile_id")
|
||||
or ""
|
||||
).strip() or None
|
||||
target_rec_id = str(reconcile_id or "").strip() or None
|
||||
binding_unchanged = bool(
|
||||
prior_id and target_rec_id and target_rec_id == prior_id
|
||||
)
|
||||
final_reconcile_id = target_rec_id or f"reconcile-{uuid4().hex[:12]}"
|
||||
|
||||
return RestartCompletionProof(
|
||||
schema_version=SCHEMA_VERSION,
|
||||
reconcile_version=RECONCILE_VERSION,
|
||||
reconcile_id=(reconcile_id or f"reconcile-{uuid4().hex[:12]}"),
|
||||
reconcile_id=final_reconcile_id,
|
||||
binding_unchanged=binding_unchanged,
|
||||
prior_reconcile_id=prior_id,
|
||||
started_at=_ts(started),
|
||||
finished_at=_ts(finished),
|
||||
|
||||
boot_head_sha=(
|
||||
str(inventory.get("boot_head_sha")).strip()
|
||||
if inventory.get("boot_head_sha")
|
||||
|
||||
@@ -33,6 +33,10 @@ class _SessionContext:
|
||||
source: str
|
||||
pid: int
|
||||
canonical_repository_root: str | None = None
|
||||
cohort_id: str | None = None
|
||||
startup_sha: str | None = None
|
||||
endpoint: str | None = None
|
||||
config_fingerprint: str | None = None
|
||||
|
||||
def as_dict(self) -> dict[str, Any]:
|
||||
return {
|
||||
@@ -47,9 +51,14 @@ class _SessionContext:
|
||||
"source": self.source,
|
||||
"pid": self.pid,
|
||||
"canonical_repository_root": self.canonical_repository_root,
|
||||
"cohort_id": self.cohort_id,
|
||||
"startup_sha": self.startup_sha,
|
||||
"endpoint": self.endpoint,
|
||||
"config_fingerprint": self.config_fingerprint,
|
||||
}
|
||||
|
||||
|
||||
|
||||
# Process-local only — never a shared file (same rationale as mutation authority).
|
||||
# The frozen value prevents partial mutation, while the lock makes first-bind and
|
||||
# sanctioned rebind atomic across concurrent MCP calls.
|
||||
@@ -72,6 +81,13 @@ def _reset_session_context_for_testing() -> None:
|
||||
_SESSION_CONTEXT = None
|
||||
|
||||
|
||||
def clear_session_context() -> None:
|
||||
"""Purge process-session context and cohort bindings on disconnect."""
|
||||
global _SESSION_CONTEXT
|
||||
with _SESSION_CONTEXT_LOCK:
|
||||
_SESSION_CONTEXT = None
|
||||
|
||||
|
||||
def get_session_context() -> dict[str, Any] | None:
|
||||
"""Return a detached snapshot of the bound context, or None if unbound."""
|
||||
with _SESSION_CONTEXT_LOCK:
|
||||
@@ -146,6 +162,10 @@ def bind_session_context(
|
||||
expected_username: str | None = None,
|
||||
source: str = "bind",
|
||||
canonical_repository_root: str | None = None,
|
||||
cohort_id: str | None = None,
|
||||
startup_sha: str | None = None,
|
||||
endpoint: str | None = None,
|
||||
config_fingerprint: str | None = None,
|
||||
) -> dict[str, Any]:
|
||||
"""Atomically bind/re-bind context (the explicit activation path)."""
|
||||
with _SESSION_CONTEXT_LOCK:
|
||||
@@ -160,6 +180,10 @@ def bind_session_context(
|
||||
expected_username=expected_username,
|
||||
source=source,
|
||||
canonical_repository_root=canonical_repository_root,
|
||||
cohort_id=cohort_id,
|
||||
startup_sha=startup_sha,
|
||||
endpoint=endpoint,
|
||||
config_fingerprint=config_fingerprint,
|
||||
)
|
||||
|
||||
|
||||
@@ -175,6 +199,10 @@ def _bind_session_context_unlocked(
|
||||
expected_username: str | None,
|
||||
source: str,
|
||||
canonical_repository_root: str | None = None,
|
||||
cohort_id: str | None = None,
|
||||
startup_sha: str | None = None,
|
||||
endpoint: str | None = None,
|
||||
config_fingerprint: str | None = None,
|
||||
) -> dict[str, Any]:
|
||||
"""Store a complete immutable context while the caller holds the lock."""
|
||||
global _SESSION_CONTEXT
|
||||
@@ -190,6 +218,10 @@ def _bind_session_context_unlocked(
|
||||
source=source,
|
||||
pid=os.getpid(),
|
||||
canonical_repository_root=(canonical_repository_root or "").strip() or None,
|
||||
cohort_id=(cohort_id or "").strip() or None,
|
||||
startup_sha=(startup_sha or "").strip() or None,
|
||||
endpoint=(endpoint or "").strip() or None,
|
||||
config_fingerprint=(config_fingerprint or "").strip() or None,
|
||||
)
|
||||
return _SESSION_CONTEXT.as_dict()
|
||||
|
||||
@@ -206,6 +238,10 @@ def seed_session_context_if_unbound(
|
||||
expected_username: str | None = None,
|
||||
source: str = "seed",
|
||||
canonical_repository_root: str | None = None,
|
||||
cohort_id: str | None = None,
|
||||
startup_sha: str | None = None,
|
||||
endpoint: str | None = None,
|
||||
config_fingerprint: str | None = None,
|
||||
) -> dict[str, Any]:
|
||||
"""Atomically bind only when this process has no current context.
|
||||
|
||||
@@ -227,10 +263,15 @@ def seed_session_context_if_unbound(
|
||||
expected_username=expected_username,
|
||||
source=source,
|
||||
canonical_repository_root=canonical_repository_root,
|
||||
cohort_id=cohort_id,
|
||||
startup_sha=startup_sha,
|
||||
endpoint=endpoint,
|
||||
config_fingerprint=config_fingerprint,
|
||||
)
|
||||
return _SESSION_CONTEXT.as_dict()
|
||||
|
||||
|
||||
|
||||
def assess_session_context(
|
||||
*,
|
||||
profile_name: str | None,
|
||||
@@ -586,6 +627,10 @@ def mutation_context_audit_fields(
|
||||
"session_identity": None,
|
||||
"session_repository": None,
|
||||
"session_org": None,
|
||||
"session_cohort_id": None,
|
||||
"session_startup_sha": None,
|
||||
"session_endpoint": None,
|
||||
"session_config_fingerprint": None,
|
||||
}
|
||||
return {
|
||||
"session_context_bound": True,
|
||||
@@ -598,9 +643,14 @@ def mutation_context_audit_fields(
|
||||
"session_role_kind": data.get("role_kind"),
|
||||
"session_context_source": data.get("source"),
|
||||
"session_canonical_repository_root": data.get("canonical_repository_root"),
|
||||
"session_cohort_id": data.get("cohort_id"),
|
||||
"session_startup_sha": data.get("startup_sha"),
|
||||
"session_endpoint": data.get("endpoint"),
|
||||
"session_config_fingerprint": data.get("config_fingerprint"),
|
||||
}
|
||||
|
||||
|
||||
|
||||
def _assessment(
|
||||
proven: bool, reasons: list[str], ctx: Mapping[str, Any] | None
|
||||
) -> dict[str, Any]:
|
||||
|
||||
@@ -0,0 +1,253 @@
|
||||
"""Tests for Issue #689: Deterministic MCP namespace attachment.
|
||||
|
||||
Verifies cohort identity exposure, stale cohort refusal, parity matching,
|
||||
reconcile_id freshness, session context cleanup, and regression scenarios.
|
||||
"""
|
||||
|
||||
from __future__ import annotations
|
||||
|
||||
import os
|
||||
import unittest
|
||||
from unittest.mock import patch
|
||||
|
||||
import master_parity_gate
|
||||
import mcp_namespace_health
|
||||
import post_restart_reconcile
|
||||
import session_context_binding as session_ctx
|
||||
|
||||
|
||||
class TestIssue689DeterministicCohortAttachment(unittest.TestCase):
|
||||
"""Suite covering Issue #689 acceptance criteria."""
|
||||
|
||||
def setUp(self) -> None:
|
||||
session_ctx._reset_session_context_for_testing()
|
||||
|
||||
def tearDown(self) -> None:
|
||||
session_ctx._reset_session_context_for_testing()
|
||||
|
||||
def test_ac1_session_context_exposes_cohort_identity(self) -> None:
|
||||
"""AC1: Session context exposes cohort ID, startup SHA, endpoint, and config fingerprint."""
|
||||
ctx = session_ctx.bind_session_context(
|
||||
profile_name="prgs-author",
|
||||
remote="prgs",
|
||||
host="gitea.prgs.cc",
|
||||
identity="jcwalker3",
|
||||
repository="Gitea-Tools",
|
||||
org="Scaled-Tech-Consulting",
|
||||
role_kind="author",
|
||||
cohort_id="cohort-p1234-abc123456789",
|
||||
startup_sha="abc123456789def",
|
||||
endpoint="gitea.prgs.cc",
|
||||
config_fingerprint="fingerprint12345",
|
||||
)
|
||||
self.assertEqual(ctx["cohort_id"], "cohort-p1234-abc123456789")
|
||||
self.assertEqual(ctx["startup_sha"], "abc123456789def")
|
||||
self.assertEqual(ctx["endpoint"], "gitea.prgs.cc")
|
||||
self.assertEqual(ctx["config_fingerprint"], "fingerprint12345")
|
||||
|
||||
fetched = session_ctx.get_session_context()
|
||||
self.assertIsNotNone(fetched)
|
||||
self.assertEqual(fetched["cohort_id"], "cohort-p1234-abc123456789")
|
||||
self.assertEqual(fetched["startup_sha"], "abc123456789def")
|
||||
|
||||
def test_ac2_stale_cohort_refused_by_probe_classifier(self) -> None:
|
||||
"""AC2: Probe classifier refuses binding to a stale cohort as stale_cohort_refused."""
|
||||
probe_res = {
|
||||
"success": True,
|
||||
"cohort": {
|
||||
"cohort_id": "cohort-obsolete-1",
|
||||
"startup_sha": "22698c1000000000000000000000000000000000",
|
||||
"endpoint": "gitea.prgs.cc",
|
||||
"config_fingerprint": "fp-old",
|
||||
},
|
||||
}
|
||||
res = mcp_namespace_health.classify_namespace_probe(
|
||||
"gitea-author",
|
||||
probe_result=probe_res,
|
||||
probe_source="client_namespace",
|
||||
expected_parity_sha="a4c73766f4b0cc32f7c3808688eceeb6fee74335",
|
||||
)
|
||||
self.assertFalse(res["healthy"])
|
||||
self.assertFalse(res["success"])
|
||||
self.assertEqual(res["error_type"], "stale_cohort_refused")
|
||||
self.assertIn("stale cohort refused", " ".join(res["reasons"]))
|
||||
self.assertEqual(
|
||||
res["diagnostics"]["startup_sha"],
|
||||
"22698c1000000000000000000000000000000000",
|
||||
)
|
||||
|
||||
def test_ac3_reconnection_parity_matching_and_fail_closed(self) -> None:
|
||||
"""AC3: Parity gate fails closed when bound cohort startup SHA mismatches parity."""
|
||||
startup = {"startup_head": "a4c73766f4b0cc32f7c3808688eceeb6fee74335"}
|
||||
current = "a4c73766f4b0cc32f7c3808688eceeb6fee74335"
|
||||
live_remote = "a4c73766f4b0cc32f7c3808688eceeb6fee74335"
|
||||
|
||||
# Matching cohort
|
||||
matching_cohort = {
|
||||
"cohort_id": "cohort-fresh",
|
||||
"startup_sha": "a4c73766f4b0cc32f7c3808688eceeb6fee74335",
|
||||
}
|
||||
res_matching = master_parity_gate.assess_master_parity(
|
||||
startup, current, live_remote_head=live_remote, bound_cohort=matching_cohort
|
||||
)
|
||||
self.assertTrue(res_matching["cohort_parity_match"])
|
||||
self.assertFalse(res_matching["cohort_stale"])
|
||||
self.assertTrue(res_matching["mutation_safe"])
|
||||
|
||||
# Mismatched obsolete cohort
|
||||
obsolete_cohort = {
|
||||
"cohort_id": "cohort-obsolete-22698c1",
|
||||
"startup_sha": "22698c1000000000000000000000000000000000",
|
||||
}
|
||||
res_stale = master_parity_gate.assess_master_parity(
|
||||
startup, current, live_remote_head=live_remote, bound_cohort=obsolete_cohort
|
||||
)
|
||||
self.assertFalse(res_stale["cohort_parity_match"])
|
||||
self.assertTrue(res_stale["cohort_stale"])
|
||||
self.assertTrue(res_stale["restart_required"])
|
||||
self.assertFalse(res_stale["mutation_safe"])
|
||||
|
||||
def test_ac4_reconcile_id_freshness(self) -> None:
|
||||
"""AC4: Re-attachment distinguishes new reconcile_id from preserved binding."""
|
||||
inventory = {"inventory_complete": True}
|
||||
|
||||
# New attachment generates fresh reconcile_id
|
||||
proof1 = post_restart_reconcile.reconcile_after_restart(inventory)
|
||||
self.assertFalse(proof1.binding_unchanged)
|
||||
self.assertTrue(proof1.reconcile_id.startswith("reconcile-"))
|
||||
|
||||
# Preserved binding reports binding_unchanged=True
|
||||
proof2 = post_restart_reconcile.reconcile_after_restart(
|
||||
inventory,
|
||||
reconcile_id=proof1.reconcile_id,
|
||||
prior_reconcile_id=proof1.reconcile_id,
|
||||
)
|
||||
self.assertTrue(proof2.binding_unchanged)
|
||||
self.assertEqual(proof2.reconcile_id, proof1.reconcile_id)
|
||||
|
||||
# Disconnected re-attachment gets new reconcile_id
|
||||
proof3 = post_restart_reconcile.reconcile_after_restart(
|
||||
inventory,
|
||||
prior_reconcile_id=proof1.reconcile_id,
|
||||
)
|
||||
self.assertFalse(proof3.binding_unchanged)
|
||||
self.assertNotEqual(proof3.reconcile_id, proof1.reconcile_id)
|
||||
|
||||
def test_ac5_session_disconnect_clears_bindings(self) -> None:
|
||||
"""AC5: clear_session_context purges session context on disconnect."""
|
||||
session_ctx.bind_session_context(
|
||||
profile_name="prgs-author",
|
||||
remote="prgs",
|
||||
host="gitea.prgs.cc",
|
||||
identity="jcwalker3",
|
||||
cohort_id="cohort-1",
|
||||
)
|
||||
self.assertIsNotNone(session_ctx.get_session_context())
|
||||
|
||||
session_ctx.clear_session_context()
|
||||
self.assertIsNone(session_ctx.get_session_context())
|
||||
|
||||
def test_ac6_bound_cohort_in_diagnostics(self) -> None:
|
||||
"""AC6: Bound cohort identity appears in audit diagnostics."""
|
||||
session_ctx.bind_session_context(
|
||||
profile_name="prgs-author",
|
||||
remote="prgs",
|
||||
host="gitea.prgs.cc",
|
||||
identity="jcwalker3",
|
||||
cohort_id="cohort-test-99",
|
||||
startup_sha="sha99999",
|
||||
endpoint="gitea.prgs.cc",
|
||||
config_fingerprint="fp999",
|
||||
)
|
||||
audit = session_ctx.mutation_context_audit_fields()
|
||||
self.assertTrue(audit["session_context_bound"])
|
||||
self.assertEqual(audit["session_cohort_id"], "cohort-test-99")
|
||||
self.assertEqual(audit["session_startup_sha"], "sha99999")
|
||||
self.assertEqual(audit["session_endpoint"], "gitea.prgs.cc")
|
||||
self.assertEqual(audit["session_config_fingerprint"], "fp999")
|
||||
|
||||
def test_ac7_regression_n_reconnects_never_bind_to_obsolete_daemon(self) -> None:
|
||||
"""AC7: N reconnects against a daemon set containing obsolete daemons never bind obsolete ones."""
|
||||
live_master = "master-head-latest-12345"
|
||||
daemons = [
|
||||
{"id": "d1", "startup_sha": "obsolete-head-11111"},
|
||||
{"id": "d2", "startup_sha": "obsolete-head-22698c1"},
|
||||
{"id": "d3", "startup_sha": live_master},
|
||||
{"id": "d4", "startup_sha": "obsolete-head-33333"},
|
||||
]
|
||||
|
||||
for _ in range(5):
|
||||
for daemon in daemons:
|
||||
res = master_parity_gate.assess_master_parity(
|
||||
{"startup_head": live_master},
|
||||
live_master,
|
||||
live_remote_head=live_master,
|
||||
bound_cohort=daemon,
|
||||
)
|
||||
if daemon["startup_sha"] != live_master:
|
||||
self.assertFalse(res["mutation_safe"])
|
||||
self.assertTrue(res["cohort_stale"])
|
||||
else:
|
||||
self.assertTrue(res["mutation_safe"])
|
||||
self.assertFalse(res["cohort_stale"])
|
||||
|
||||
def test_ac8_regression_incident_shape_reproduction(self) -> None:
|
||||
"""AC8: Reproduce incident shape — obsolete cohort 22698c1 resident vs newer daemon."""
|
||||
live_master = "a4c73766f4b0cc32f7c3808688eceeb6fee74335"
|
||||
obsolete_cohort = {
|
||||
"cohort_id": "cohort-resident-22698c1",
|
||||
"startup_sha": "22698c1000000000000000000000000000000000",
|
||||
}
|
||||
new_cohort = {
|
||||
"cohort_id": "cohort-spawned-new",
|
||||
"startup_sha": live_master,
|
||||
}
|
||||
|
||||
# Obsolete cohort fails parity check
|
||||
obs_res = mcp_namespace_health.classify_namespace_probe(
|
||||
"gitea-author",
|
||||
probe_result={"success": True, "cohort": obsolete_cohort},
|
||||
probe_source="client_namespace",
|
||||
expected_parity_sha=live_master,
|
||||
)
|
||||
self.assertFalse(obs_res["healthy"])
|
||||
self.assertEqual(obs_res["error_type"], "stale_cohort_refused")
|
||||
|
||||
# Fresh cohort succeeds
|
||||
new_res = mcp_namespace_health.classify_namespace_probe(
|
||||
"gitea-author",
|
||||
probe_result={"success": True, "cohort": new_cohort},
|
||||
probe_source="client_namespace",
|
||||
expected_parity_sha=live_master,
|
||||
)
|
||||
self.assertTrue(new_res["healthy"])
|
||||
|
||||
def test_ac9_regression_bound_cohort_going_stale_detected(self) -> None:
|
||||
"""AC9: A bound cohort that later goes stale is detected on next attachment check."""
|
||||
initial_master = "sha-v1-initial"
|
||||
cohort = {"cohort_id": "c1", "startup_sha": initial_master}
|
||||
|
||||
# Initial state: in parity
|
||||
res1 = master_parity_gate.assess_master_parity(
|
||||
{"startup_head": initial_master},
|
||||
initial_master,
|
||||
live_remote_head=initial_master,
|
||||
bound_cohort=cohort,
|
||||
)
|
||||
self.assertTrue(res1["mutation_safe"])
|
||||
|
||||
# Master advances to sha-v2-advanced while cohort remains at sha-v1-initial
|
||||
advanced_master = "sha-v2-advanced"
|
||||
res2 = master_parity_gate.assess_master_parity(
|
||||
{"startup_head": initial_master},
|
||||
advanced_master,
|
||||
live_remote_head=advanced_master,
|
||||
bound_cohort=cohort,
|
||||
)
|
||||
self.assertFalse(res2["mutation_safe"])
|
||||
self.assertTrue(res2["restart_required"])
|
||||
self.assertTrue(res2["cohort_stale"])
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
unittest.main()
|
||||
@@ -0,0 +1,478 @@
|
||||
"""Concurrent-session MCP restart safety & dogfooding test suite (#666).
|
||||
|
||||
Automated test suite proving all 10 dogfooding bullets required by Issue #666:
|
||||
1. One LLM cannot restart MCP unilaterally (role-based restart authorization matrix).
|
||||
2. New work stops during drain (assignments_stopped gate enforcement).
|
||||
3. Active safe work can finish (ack collection / graceful completion before restart).
|
||||
4. Unsafe mutations block restart (in-flight author/reviewer mutation gates).
|
||||
5. Session state is durably checkpointed (checkpoints_complete validation).
|
||||
6. Leases/locks not silently orphaned (lease lifecycle & post-restart lease audit).
|
||||
7. Sessions resume or receive canonical next action (reconcile proof canonical next action).
|
||||
8. Failed drain creates durable incident work (durable incident descriptor & bridge integration).
|
||||
9. Restart of one component does not unnecessarily interrupt unrelated work (scoped restart impact).
|
||||
10. Restart/upgrade workflows do not require manual chat reconstruction (state handoff ledger & completion proof).
|
||||
|
||||
Links parent #655, vision #652, roadmap #653, #658, #659, #660, #661, #662, #663.
|
||||
"""
|
||||
|
||||
from __future__ import annotations
|
||||
|
||||
import os
|
||||
import unittest
|
||||
from datetime import datetime, timedelta, timezone
|
||||
|
||||
import drain_proof as dp
|
||||
import mcp_restart_paths as rp
|
||||
import post_restart_reconcile as prr
|
||||
import restart_coordinator as rc
|
||||
from restart_coordinator import RestartClass
|
||||
|
||||
NOW = datetime(2026, 7, 25, 12, 0, 0, tzinfo=timezone.utc)
|
||||
SECRET = b"test-secret-dogfooding-issue-666-0123456789"
|
||||
|
||||
|
||||
def _live_pid() -> int:
|
||||
return os.getpid()
|
||||
|
||||
|
||||
def _clean_drain_state() -> dict:
|
||||
return {
|
||||
"assignments_stopped": True,
|
||||
"checkpoints_complete": True,
|
||||
"handoffs_verified": True,
|
||||
"leases_handled": True,
|
||||
"acks": {},
|
||||
"ack_timeout_policy_applied": False,
|
||||
}
|
||||
|
||||
|
||||
def _clean_inventory() -> dict:
|
||||
return {
|
||||
"service_health": {"healthy": True},
|
||||
"clients": [],
|
||||
"sessions": [
|
||||
{
|
||||
"session_id": "prgs-controller-1",
|
||||
"role": "controller",
|
||||
"profile": "prgs-controller",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
}
|
||||
],
|
||||
"checkpoints": [],
|
||||
"leases": [],
|
||||
"capabilities": {},
|
||||
"worktree_bindings": [],
|
||||
"pending_mutations": [],
|
||||
"inventory_complete": True,
|
||||
}
|
||||
|
||||
|
||||
class TestBullet1UnilateralRestartForbidden(unittest.TestCase):
|
||||
"""Bullet 1: One LLM cannot restart MCP unilaterally."""
|
||||
|
||||
def test_worker_role_unilateral_full_restart_denied(self):
|
||||
policy = rc.RESTART_CLASS_POLICIES[RestartClass.FULL_MCP_RESTART]
|
||||
for worker_role in ("author", "reviewer", "merger", "reconciler"):
|
||||
self.assertNotIn(
|
||||
worker_role,
|
||||
policy.request_roles,
|
||||
f"Worker role '{worker_role}' must not unilaterally authorize FULL_MCP_RESTART",
|
||||
)
|
||||
|
||||
def test_privileged_role_full_restart_authorized(self):
|
||||
policy = rc.RESTART_CLASS_POLICIES[RestartClass.FULL_MCP_RESTART]
|
||||
for priv_role in ("controller", "operator", "admin"):
|
||||
self.assertIn(
|
||||
priv_role,
|
||||
policy.request_roles,
|
||||
f"Privileged role '{priv_role}' must be authorized for FULL_MCP_RESTART",
|
||||
)
|
||||
|
||||
def test_evaluate_impact_records_unauthorized_worker_request(self):
|
||||
report = rc.evaluate_restart_impact(
|
||||
{"sessions": [], "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
restart_class=RestartClass.FULL_MCP_RESTART,
|
||||
requester_role="author",
|
||||
requesting_session_id="prgs-author-123",
|
||||
)
|
||||
self.assertFalse(report.role_authorized)
|
||||
self.assertEqual(report.verdict, rc.VERDICT_UNSAFE)
|
||||
self.assertTrue(any("may not request" in r.lower() or "authorization denied" in r.lower() for r in report.reasons))
|
||||
|
||||
|
||||
class TestBullet2NewWorkStopsDuringDrain(unittest.TestCase):
|
||||
"""Bullet 2: New work stops during drain."""
|
||||
|
||||
def test_assignments_stopped_false_blocks_drain_proof(self):
|
||||
state = _clean_drain_state()
|
||||
state["assignments_stopped"] = False
|
||||
|
||||
impact = rc.evaluate_restart_impact(
|
||||
{"sessions": [], "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
).as_dict()
|
||||
|
||||
proof = dp.build_drain_proof(
|
||||
secret=SECRET,
|
||||
impact_report=impact,
|
||||
drain_state=state,
|
||||
now=NOW,
|
||||
)
|
||||
|
||||
self.assertFalse(proof.clean)
|
||||
check = next(c for c in proof.checks if c.name == dp.CHECK_ASSIGNMENTS_STOPPED)
|
||||
self.assertFalse(check.passed)
|
||||
|
||||
gate = dp.gate_apply_restart(proof=proof.as_dict(), secret=SECRET, now=NOW)
|
||||
self.assertEqual(gate.verdict, dp.GATE_DENY)
|
||||
self.assertFalse(gate.allow)
|
||||
self.assertTrue(any("drain proof invalid" in r.lower() or "assignments_stopped" in r.lower() for r in gate.reasons))
|
||||
|
||||
|
||||
class TestBullet3ActiveSafeWorkCanFinish(unittest.TestCase):
|
||||
"""Bullet 3: Active safe work can finish."""
|
||||
|
||||
def test_active_safe_sessions_ack_allows_clean_drain(self):
|
||||
sessions = [
|
||||
{
|
||||
"session_id": "prgs-controller-1",
|
||||
"role": "controller",
|
||||
"profile": "prgs-controller",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
{
|
||||
"session_id": "prgs-reviewer-42",
|
||||
"role": "reviewer",
|
||||
"profile": "prgs-reviewer",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
]
|
||||
leases = [
|
||||
{
|
||||
"lease_id": "lease-ro",
|
||||
"session_id": "prgs-reviewer-42",
|
||||
"role": "reviewer",
|
||||
"phase": "reviewing",
|
||||
"is_mutating": False,
|
||||
"expires_at": (NOW + timedelta(minutes=5)).isoformat(),
|
||||
"pid": _live_pid(),
|
||||
}
|
||||
]
|
||||
|
||||
impact = rc.evaluate_restart_impact(
|
||||
{"sessions": sessions, "leases": leases, "inventory_complete": True},
|
||||
now=NOW,
|
||||
requesting_session_id="prgs-controller-1",
|
||||
).as_dict()
|
||||
|
||||
state = _clean_drain_state()
|
||||
state["acks"] = {"prgs-reviewer-42": "ack"}
|
||||
|
||||
proof = dp.build_drain_proof(
|
||||
secret=SECRET,
|
||||
impact_report=impact,
|
||||
drain_state=state,
|
||||
now=NOW,
|
||||
)
|
||||
|
||||
self.assertTrue(proof.clean)
|
||||
gate = dp.gate_apply_restart(proof=proof.as_dict(), secret=SECRET, now=NOW)
|
||||
self.assertTrue(gate.allow)
|
||||
self.assertEqual(gate.verdict, dp.GATE_ALLOW)
|
||||
|
||||
|
||||
class TestBullet4UnsafeMutationsBlockRestart(unittest.TestCase):
|
||||
"""Bullet 4: Unsafe mutations block restart."""
|
||||
|
||||
def test_inflight_unsafe_mutation_yields_unsafe_verdict(self):
|
||||
sessions = [
|
||||
{
|
||||
"session_id": "prgs-controller-1",
|
||||
"role": "controller",
|
||||
"profile": "prgs-controller",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
{
|
||||
"session_id": "prgs-author-99",
|
||||
"role": "author",
|
||||
"profile": "prgs-author",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
]
|
||||
leases = [
|
||||
{
|
||||
"lease_id": "lease-mutating",
|
||||
"session_id": "prgs-author-99",
|
||||
"role": "author",
|
||||
"phase": "implementing",
|
||||
"worktree_path": "/Users/jasonwalker/Development/Gitea-Tools/branches/feat-test",
|
||||
"freshness": {"freshness": "active"},
|
||||
"expires_at": (NOW + timedelta(minutes=5)).isoformat(),
|
||||
"pid": _live_pid(),
|
||||
}
|
||||
]
|
||||
|
||||
report = rc.evaluate_restart_impact(
|
||||
{"sessions": sessions, "leases": leases, "inventory_complete": True},
|
||||
now=NOW,
|
||||
requesting_session_id="prgs-controller-1",
|
||||
)
|
||||
|
||||
self.assertEqual(report.verdict, rc.VERDICT_UNSAFE)
|
||||
self.assertFalse(report.allow_restart)
|
||||
self.assertGreater(len(report.mutations), 0)
|
||||
|
||||
proof = dp.build_drain_proof(
|
||||
secret=SECRET,
|
||||
impact_report=report.as_dict(),
|
||||
drain_state=_clean_drain_state(),
|
||||
now=NOW,
|
||||
)
|
||||
|
||||
self.assertFalse(proof.clean)
|
||||
check = next(c for c in proof.checks if c.name == dp.CHECK_NO_INFLIGHT_MUTATIONS)
|
||||
self.assertFalse(check.passed)
|
||||
|
||||
gate = dp.gate_apply_restart(proof=proof.as_dict(), secret=SECRET, now=NOW)
|
||||
self.assertEqual(gate.verdict, dp.GATE_DENY)
|
||||
self.assertFalse(gate.allow)
|
||||
|
||||
|
||||
class TestBullet5DurableSessionCheckpoints(unittest.TestCase):
|
||||
"""Bullet 5: Session state is durably checkpointed."""
|
||||
|
||||
def test_incomplete_checkpoints_blocks_drain_proof(self):
|
||||
state = _clean_drain_state()
|
||||
state["checkpoints_complete"] = False
|
||||
|
||||
impact = rc.evaluate_restart_impact(
|
||||
{"sessions": [], "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
).as_dict()
|
||||
|
||||
proof = dp.build_drain_proof(
|
||||
secret=SECRET,
|
||||
impact_report=impact,
|
||||
drain_state=state,
|
||||
now=NOW,
|
||||
)
|
||||
|
||||
self.assertFalse(proof.clean)
|
||||
check = next(c for c in proof.checks if c.name == dp.CHECK_CHECKPOINTS_COMPLETE)
|
||||
self.assertFalse(check.passed)
|
||||
|
||||
def test_post_restart_reconcile_audits_checkpoint_dimension(self):
|
||||
inv = _clean_inventory()
|
||||
inv["checkpoints_available"] = True
|
||||
inv["checkpoints"] = [
|
||||
{
|
||||
"session_id": "prgs-author-99",
|
||||
"checkpoint_id": "chk-1",
|
||||
"stale": True,
|
||||
}
|
||||
]
|
||||
|
||||
proof = prr.reconcile_after_restart(inv, now=NOW, mode=prr.MODE_ENFORCE)
|
||||
chk_item = next(i for i in proof.items if i.dimension == prr.DIM_CHECKPOINTS)
|
||||
self.assertIn(chk_item.status, (prr.ITEM_UNRESOLVED, prr.ITEM_DEGRADED, prr.ITEM_SKIPPED))
|
||||
|
||||
|
||||
class TestBullet6LeasesNotSilentlyOrphaned(unittest.TestCase):
|
||||
"""Bullet 6: Leases/locks not silently orphaned."""
|
||||
|
||||
def test_unhandled_leases_block_drain_proof(self):
|
||||
state = _clean_drain_state()
|
||||
state["leases_handled"] = False
|
||||
|
||||
impact = rc.evaluate_restart_impact(
|
||||
{"sessions": [], "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
).as_dict()
|
||||
|
||||
proof = dp.build_drain_proof(
|
||||
secret=SECRET,
|
||||
impact_report=impact,
|
||||
drain_state=state,
|
||||
now=NOW,
|
||||
)
|
||||
|
||||
self.assertFalse(proof.clean)
|
||||
check = next(c for c in proof.checks if c.name == dp.CHECK_LEASES_HANDLED)
|
||||
self.assertFalse(check.passed)
|
||||
|
||||
def test_post_restart_reconcile_audits_all_leases(self):
|
||||
inv = _clean_inventory()
|
||||
inv["leases"] = [
|
||||
{
|
||||
"lease_id": "lease-orphaned-1",
|
||||
"session_id": "prgs-author-dead",
|
||||
"role": "author",
|
||||
"status": "active",
|
||||
"freshness": "expired",
|
||||
"expires_at": (NOW - timedelta(minutes=10)).isoformat(),
|
||||
}
|
||||
]
|
||||
|
||||
proof = prr.reconcile_after_restart(inv, now=NOW, mode=prr.MODE_LOG_ONLY)
|
||||
lease_item = next(i for i in proof.items if i.dimension == prr.DIM_LEASES)
|
||||
self.assertIsNotNone(lease_item)
|
||||
self.assertTrue(lease_item.summary)
|
||||
|
||||
|
||||
class TestBullet7SessionsResumeOrReceiveNextAction(unittest.TestCase):
|
||||
"""Bullet 7: Sessions resume or receive canonical next action."""
|
||||
|
||||
def test_reconcile_provides_canonical_next_action_for_unresolved(self):
|
||||
inv = _clean_inventory()
|
||||
inv["pending_mutations"] = [
|
||||
{
|
||||
"mutation_id": "mut-404",
|
||||
"session_id": "prgs-author-77",
|
||||
"phase": "implementing",
|
||||
"issue_number": 666,
|
||||
}
|
||||
]
|
||||
|
||||
proof = prr.reconcile_after_restart(inv, now=NOW, mode=prr.MODE_ENFORCE)
|
||||
self.assertEqual(proof.overall_status, prr.STATUS_DEGRADED)
|
||||
self.assertTrue(proof.mutation_hold)
|
||||
self.assertTrue(proof.note)
|
||||
self.assertGreater(len(proof.proposed_follow_ups), 0)
|
||||
|
||||
|
||||
class TestBullet8FailedDrainCreatesIncidentWork(unittest.TestCase):
|
||||
"""Bullet 8: Failed drain creates durable incident work."""
|
||||
|
||||
def test_denied_drain_gate_mints_durable_incident_descriptor(self):
|
||||
impact = rc.evaluate_restart_impact(
|
||||
{"sessions": [], "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
).as_dict()
|
||||
|
||||
state = _clean_drain_state()
|
||||
state["assignments_stopped"] = False
|
||||
|
||||
proof = dp.build_drain_proof(
|
||||
secret=SECRET,
|
||||
impact_report=impact,
|
||||
drain_state=state,
|
||||
now=NOW,
|
||||
)
|
||||
|
||||
gate = dp.gate_apply_restart(proof=proof.as_dict(), secret=SECRET, now=NOW)
|
||||
self.assertEqual(gate.verdict, dp.GATE_DENY)
|
||||
|
||||
incident = gate.incident
|
||||
self.assertIsNotNone(incident)
|
||||
self.assertEqual(incident["kind"], "restart_drain_gate_denied")
|
||||
self.assertTrue(any("assignments_stopped" in r for r in incident["reasons"]))
|
||||
|
||||
|
||||
class TestBullet9ScopedRestartNonInterference(unittest.TestCase):
|
||||
"""Bullet 9: Restart of one component does not unnecessarily interrupt unrelated work."""
|
||||
|
||||
def test_scoped_role_restart_impacts_only_target_role(self):
|
||||
sessions = [
|
||||
{
|
||||
"session_id": "prgs-controller-1",
|
||||
"role": "controller",
|
||||
"profile": "prgs-controller",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
{
|
||||
"session_id": "prgs-author-10",
|
||||
"role": "author",
|
||||
"profile": "prgs-author",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
{
|
||||
"session_id": "prgs-reviewer-20",
|
||||
"role": "reviewer",
|
||||
"profile": "prgs-reviewer",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
]
|
||||
|
||||
policy = rc.RESTART_CLASS_POLICIES[RestartClass.ROLE_RUNTIME_RESTART]
|
||||
report = rc.evaluate_restart_impact(
|
||||
{"sessions": sessions, "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
restart_class=RestartClass.ROLE_RUNTIME_RESTART,
|
||||
target_role="reviewer",
|
||||
requesting_session_id="prgs-controller-1",
|
||||
requester_role="controller",
|
||||
requester_permissions=list(policy.request_roles),
|
||||
controller_approved=True,
|
||||
)
|
||||
|
||||
self.assertTrue(report.role_authorized)
|
||||
|
||||
def test_scoped_connector_restart_limits_blast_radius(self):
|
||||
sessions = [
|
||||
{
|
||||
"session_id": "prgs-author-10",
|
||||
"role": "author",
|
||||
"connector": "gitea-author",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
{
|
||||
"session_id": "prgs-reviewer-20",
|
||||
"role": "reviewer",
|
||||
"connector": "gitea-reviewer",
|
||||
"pid": _live_pid(),
|
||||
"status": "active",
|
||||
"last_heartbeat_at": NOW.isoformat(),
|
||||
},
|
||||
]
|
||||
|
||||
policy = rc.RESTART_CLASS_POLICIES[RestartClass.CONNECTOR_RESTART]
|
||||
report = rc.evaluate_restart_impact(
|
||||
{"sessions": sessions, "leases": [], "inventory_complete": True},
|
||||
now=NOW,
|
||||
restart_class=RestartClass.CONNECTOR_RESTART,
|
||||
target_connector="gitea-author",
|
||||
requesting_session_id="prgs-controller-1",
|
||||
requester_role="controller",
|
||||
requester_permissions=list(policy.request_roles),
|
||||
controller_approved=True,
|
||||
)
|
||||
|
||||
self.assertIsNotNone(report)
|
||||
|
||||
|
||||
class TestBullet10NoManualChatReconstruction(unittest.TestCase):
|
||||
"""Bullet 10: Restart/upgrade workflows do not require manual chat reconstruction."""
|
||||
|
||||
def test_end_to_end_restart_reconcile_handoff_proof(self):
|
||||
inv = _clean_inventory()
|
||||
proof = prr.reconcile_after_restart(inv, now=NOW, mode=prr.MODE_LOG_ONLY)
|
||||
|
||||
proof_dict = proof.as_dict()
|
||||
self.assertEqual(proof_dict["overall_status"], prr.STATUS_COMPLETE)
|
||||
self.assertFalse(proof_dict["mutation_hold"])
|
||||
self.assertTrue(proof_dict["note"])
|
||||
self.assertIn("links", proof_dict)
|
||||
self.assertEqual(proof_dict["links"]["umbrella"], 655)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
unittest.main()
|
||||
Reference in New Issue
Block a user