Scaled-Tech-Consulting/Gitea-Tools
2
0
Fork 0
Code Issues 73 Pull Requests 9 Actions Packages Projects Releases Wiki Activity

Web Console: AI-provider connections and evidence-backed operational insights (Phase 4) #650

New Issue
Open
opened 2026-07-10 14:42:19 -05:00 by jcwalker3 · 0 comments
jcwalker3 commented 2026-07-10 14:42:19 -05:00
Owner
Copy Link
Copy Source

Problem statement

Operators lack a model-agnostic view of AI provider connections and evidence-backed operational insights (e.g. recurring gate failures, handoff gaps) that do not invent policy or bypass workflow proofs.

User and operational impact

Cannot optimize provider choice or spot systemic workflow defects from console evidence alone.

Scope

  • Provider connection status (configured/not) without exposing API keys.
  • Insights derived only from durable evidence: timelines (#637), health, traffic, final-report validation trends.
  • Each insight must cite evidence refs (issue/PR/event ids).
  • No autonomous code mutation from insights.

Explicit non-goals

  • No free-form chatbot that overrides gates.
  • No secret provider keys in UI.
  • No auto-merge or auto-close from insights.

Required implementation investigation

#637, #640, #649, final_report_validator, #631, #633.

Proposed architecture or implementation direction

Insight jobs as pure functions over stored events; confidence + evidence list; console cards.

Security and workflow-safety requirements

RBAC; redaction; insights advisory only.

Acceptance criteria

  1. Provider connection status redacted and accurate.
  2. At least three insight types with evidence citations.
  3. Insights never claim actions completed without proof.
  4. Tests for evidence requirement.
  5. Docs for interpretation limits.

Required tests

Insight generator unit tests; redaction tests.

Observability and audit requirements

Insight generation errors logged safely.

Dependencies and linkage

Canonical issue state

STATE: ready-for-author
WHO_IS_NEXT: author
NEXT_ACTION: Implement provider status + evidence-backed insights
NEXT_PROMPT: Author insights views; PR; stop

Required final evidence

PR with insights, tests, docs.

Required final response and handoff expectations

Brief PR → reviewer.

## Problem statement Operators lack a model-agnostic view of **AI provider connections** and **evidence-backed operational insights** (e.g. recurring gate failures, handoff gaps) that do not invent policy or bypass workflow proofs. ## User and operational impact Cannot optimize provider choice or spot systemic workflow defects from console evidence alone. ## Scope * Provider connection status (configured/not) without exposing API keys. * Insights derived only from durable evidence: timelines (#637), health, traffic, final-report validation trends. * Each insight must cite evidence refs (issue/PR/event ids). * No autonomous code mutation from insights. ## Explicit non-goals * No free-form chatbot that overrides gates. * No secret provider keys in UI. * No auto-merge or auto-close from insights. ## Required implementation investigation #637, #640, #649, final_report_validator, #631, #633. ## Proposed architecture or implementation direction Insight jobs as pure functions over stored events; confidence + evidence list; console cards. ## Security and workflow-safety requirements RBAC; redaction; insights advisory only. ## Acceptance criteria 1. Provider connection status redacted and accurate. 2. At least three insight types with evidence citations. 3. Insights never claim actions completed without proof. 4. Tests for evidence requirement. 5. Docs for interpretation limits. ## Required tests Insight generator unit tests; redaction tests. ## Observability and audit requirements Insight generation errors logged safely. ## Dependencies and linkage * Parent: #631 · Soft-depends: #637, #640, #633 · Related: #649 ## Canonical issue state ```text STATE: ready-for-author WHO_IS_NEXT: author NEXT_ACTION: Implement provider status + evidence-backed insights NEXT_PROMPT: Author insights views; PR; stop ``` ## Required final evidence PR with insights, tests, docs. ## Required final response and handoff expectations Brief PR → reviewer.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
allocator
Controller-owned work allocator
 anti-stomp
Prevent concurrent LLM session stomping
 architecture
Architecture / structural design
 bug
chore
codex
OpenAI Codex client / workflow session surface
 concurrency
Concurrent session safety
 contamination
Workflow or session contamination incident
 control-plane
MCP control-plane coordination and allocation authority
 dashboard
MCP operational dashboard/queue view
 database
Internal coordination storage (SQLite/Postgres)
 design
Design / investigation, no implementation
 documentation
Docs / runbooks
 enhancement
New feature or improvement
 gitea
Gitea MCP workflow
 glitchtip
GlitchTip integration
 important
incident
Operational or process incident requiring durable audit trail
 incident-bridge
Sentry-to-Gitea incident bridging
 integration
Integration testing
 jenkins
Jenkins integration
 labels
Label taxonomy management
 leases
Lease adopt/release/expire lifecycle
 mcp
MCP server / tooling
 mcp-health
MCP namespace and runtime health
 mcp-menu
MCP menu surface
 multi-project
Work spanning multiple monitoring projects or Gitea repos
 mutating
Mutating action; requires gating
 nice-to-have
observability
Observability, metrics, traces, error reporting
 portability
Cross-platform / portability
 preflight
Shared preflight gates before mutation
 protected-branch
Protected branch / stable-branch policy concern
 queue
Work queue visibility and allocation
 read-only
Read-only, no mutation
 reconnect
MCP client reconnect/reload recovery path
 recovery
Recovery paths for stale/foreign leases
 refactor
Code refactor / restructure
 release
Release / versioning
 reliability
Reliability / failure handling
 resumable-review
Persist and resume prepared review verdicts across sessions
 reviewer
Reviewer workflow tooling
 roadmap
Roadmap / umbrella issue
 safety
Safety rails and fail-closed mutation guards
 security
Security / trust boundary
 self-hosted
Self-hosted infrastructure integration
 sentry
Sentry error monitoring integration
 stale-runtime
Stale backend daemon / runtime-vs-master parity failures
 status:blocked
Issue is blocked
 status:in-progress
Issue is being worked on
 status:pr-open
Issue has an open pull request
 status:ready
Issue is ready for work
 terminal-lock
Terminal review lock (#332) path
 testing
Tests / test coverage
 tracker
Issue tracker hygiene / meta
 type:bug
Bug or defect
 type:feature
Feature or enhancement
 type:feature
Feature or enhancement
 type:guardrail
Safety gate or guardrail
 visibility
Workflow state visibility for LLMs/operators
 workflow
Cross-tool workflow
 workflow-hardening
LLM workflow coordination hardening
 workflow-hardening
LLM workflow coordination hardening
No labels dashboard observability status:ready type:feature workflow-hardening
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
jcwalker3 sysadmin
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Scaled-Tech-Consulting/Gitea-Tools#650