Reviewer reports must include exact validation commands and execution environment #311

New Issue

2026-07-07T01:08:33-05:00

jcwalker3 commented

2026-07-07 01:08:33 -05:00

A reviewer workflow reported successful validation with pytest, but the final report did not include the exact resolved executable or environment.

Observed behavior

Transcript command: pytest
Final report: pytest executed inside the worktree: 1014 passed, 6 skipped

Problem

For reproducibility, reviewer reports should include exact validation commands and the environment used, especially when the project venv is expected.

Required behavior

Final reports must include the exact validation command as executed.
If a bare command like pytest is used, report:
- which pytest
- pytest --version
- whether it resolves to the project venv
Prefer project venv commands where applicable, such as:
/Users/jasonwalker/Development/Gitea-Tools/venv/bin/pytest tests/
Reports must include the working directory where validation ran.

Acceptance criteria

Reports include exact command, working directory, and result.
Bare pytest requires executable/path proof.
Tests cover venv pytest, bare pytest with path proof, missing path proof, and failed validation.

A reviewer workflow reported successful validation with `pytest`, but the final report did not include the exact resolved executable or environment. ## Observed behavior - Transcript command: `pytest` - Final report: `pytest executed inside the worktree: 1014 passed, 6 skipped` ## Problem For reproducibility, reviewer reports should include exact validation commands and the environment used, especially when the project venv is expected. ## Required behavior 1. Final reports must include the exact validation command as executed. 2. If a bare command like `pytest` is used, report: - `which pytest` - `pytest --version` - whether it resolves to the project venv 3. Prefer project venv commands where applicable, such as: `/Users/jasonwalker/Development/Gitea-Tools/venv/bin/pytest tests/` 4. Reports must include the working directory where validation ran. ## Acceptance criteria - [ ] Reports include exact command, working directory, and result. - [ ] Bare `pytest` requires executable/path proof. - [ ] Tests cover venv pytest, bare pytest with path proof, missing path proof, and failed validation.

jcwalker3 referenced this issue

2026-07-07 01:51:24 -05:00

Add final-report validator rules for reviewer and reconciliation handoffs #327

jcwalker3 referenced this issue

2026-07-07 02:25:31 -05:00

Extract review-merge-pr workflow from monolithic LLM project skill #334

jcwalker3 added the status:in-progress label 2026-07-07 04:07:58 -05:00

jcwalker3 referenced this issue from a commit

2026-07-07 04:08:46 -05:00

feat: enforce validation environment proof in reviewer reports (Closes #311)

jcwalker3 referenced a pull request that will close this issue

2026-07-07 04:08:53 -05:00