pdurlej/platform

Fork 0

audit(runbooks): inventory runbook coverage — find modules without runbooks and orphan runbooks #760

New issue

Closed

opened 2026-06-08 23:08:40 +02:00 by ollama · 1 comment

ollama commented

2026-06-08 23:08:40 +02:00

Collaborator

Spec sources (whitelist)

modules/ directory listing — find modules with module.yaml but no runbook.md
modules/ directory listing — find modules with runbook.md but no module.yaml
AGENTS.md — runbook format expectations

Extracted context

Module runbooks are essential for ops/recovery procedures. Not all 88 modules may have runbooks. Some may have runbooks but no module manifest (inconsistent).

Scope

Run: for d in modules/*/; do id=$(basename "$d"); [ "$id" = "INDEX.yaml" ] && continue; [ -f "$d/runbook.md" ] && echo "HAS_RUNBOOK $id" || echo "MISSING $id"; done
Also check: for d in modules/*/; do [ -f "$d/runbook.md" ] && [ ! -f "$d/module.yaml" ] && echo "ORPHAN_RUNBOOK $id"; done
Report counts and names of:
- Modules WITH module.yaml but WITHOUT runbook.md
- Orphan runbooks (runbook.md without module.yaml)
Create follow-up issue for each gap

Acceptance criteria

Complete inventory of runbook coverage
Gap report: which modules need runbooks
Orphan report: which runbooks have no parent module

Do NOT read

Read module directory names only
Do not deep-read runbook content (just existence check)

Agent notes

Recommended executor: Gemini 3.5 Flash (pure investigation)
Size: Trivial (0 LOC — investigation + report)
Review tier: tier/trivial
Audit ref: state/audit/deepseek-2026-06-08-multiperspective.md §UR3

## Spec sources (whitelist) - `modules/` directory listing — find modules with `module.yaml` but no `runbook.md` - `modules/` directory listing — find modules with `runbook.md` but no `module.yaml` - `AGENTS.md` — runbook format expectations ## Extracted context Module runbooks are essential for ops/recovery procedures. Not all 88 modules may have runbooks. Some may have runbooks but no module manifest (inconsistent). ## Scope 1. Run: `for d in modules/*/; do id=$(basename "$d"); [ "$id" = "INDEX.yaml" ] && continue; [ -f "$d/runbook.md" ] && echo "HAS_RUNBOOK $id" || echo "MISSING $id"; done` 2. Also check: `for d in modules/*/; do [ -f "$d/runbook.md" ] && [ ! -f "$d/module.yaml" ] && echo "ORPHAN_RUNBOOK $id"; done` 3. Report counts and names of: - Modules WITH module.yaml but WITHOUT runbook.md - Orphan runbooks (runbook.md without module.yaml) 4. Create follow-up issue for each gap ## Acceptance criteria - [ ] Complete inventory of runbook coverage - [ ] Gap report: which modules need runbooks - [ ] Orphan report: which runbooks have no parent module ## Do NOT read - Read module directory names only - Do not deep-read runbook content (just existence check) ## Agent notes - Recommended executor: Gemini 3.5 Flash (pure investigation) - Size: Trivial (0 LOC — investigation + report) - Review tier: tier/trivial - Audit ref: state/audit/deepseek-2026-06-08-multiperspective.md §UR3

ollama referenced this issue

2026-06-08 23:09:24 +02:00

[meta] DeepSeek audit 2026-06-08 — atomic Gemini-ready task batch #766

ollama referenced this issue

2026-06-08 23:31:21 +02:00

feat(platformctl): automated truth-verification layer — lint --cross-refs + drift-check #772

codex added the

labels

2026-06-11 08:16:09 +02:00

pdurlej referenced this issue

2026-06-17 23:35:38 +02:00

[meta] DeepSeek audit 2026-06-08 — atomic Gemini-ready task batch #766

pdurlej referenced this issue

2026-06-18 00:06:36 +02:00

[meta] DeepSeek audit 2026-06-08 — atomic Gemini-ready task batch #766

Iskra commented

2026-06-18 03:03:54 +02:00

Collaborator

Iskra judgment

Field	Value
Target	`pdurlej/platform#issue#760`
Priority	p2
Action	observe
Scores	reach 4 / impact 3 / confidence 5
Piotr fit	high
Effort	small
Labels	`judge/p2`
Judge	`iskra` via `openclaw`

Rationale: This is P2 observe-first docs/process hygiene because missing or orphaned runbooks weaken recovery readiness but the task is bounded to inventory and follow-up issues.

Caveat: Keep the work read-only except for separate follow-up issues, and do not inspect unrelated repo contents beyond the allowed module and runbook paths.

Structured openclaw.judge.v0 payload

<!-- openclaw.judge.v0 -->
{
  "confidence": 5,
  "effort_hint": "small",
  "escalation": {
    "kind": "none",
    "reason": ""
  },
  "evidence_refs": [
    {
      "note": "Issue scopes a runbook coverage inventory for modules with manifests but missing runbooks and runbooks without manifests.",
      "type": "forgejo",
      "value": "issue-title-body-labels-and-target-snapshot"
    },
    {
      "note": "Body provides bounded directory-listing checks and AGENTS.md format expectations as the only spec sources.",
      "type": "forgejo",
      "value": "issue-body-scope"
    },
    {
      "note": "Current labels mark the target as ready, docs/process chore, priority p2, and small size.",
      "type": "forgejo",
      "value": "issue-labels-and-target-snapshot"
    }
  ],
  "impact": 3,
  "judge_actor": {
    "name": "iskra",
    "runtime": "openclaw"
  },
  "judged_at": "2026-06-18T01:02:00Z",
  "labels_to_apply": [
    "judge/p2"
  ],
  "piotr_fit": "high",
  "priority": "p2",
  "rationale_summary": "This is P2 observe-first docs/process hygiene because missing or orphaned runbooks weaken recovery readiness but the task is bounded to inventory and follow-up issues.",
  "reach": 4,
  "recommended_next_action": "observe",
  "rerun_reason": "no_prior_judgment",
  "schema": "openclaw.judge.v0",
  "target": {
    "kind": "issue",
    "number": 760,
    "repo": "pdurlej/platform"
  },
  "target_snapshot": {
    "body_hash": "sha256:aaf2ee1949a0ef1ec40a7bf350e11bc5fc1cecf4026f2ea27382fa19330c005d",
    "commit_count": null,
    "evidence_hash": "sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855",
    "head_sha": null,
    "labels": [
      "domain:docs",
      "flow/ready",
      "kind/chore",
      "phase/03",
      "priority:p2",
      "risk/process",
      "size/small"
    ],
    "labels_hash": "sha256:ce019f490c735251a36b9edb662e718f5defa4e920a921467b983e92c8e7b592",
    "state": "open",
    "title_hash": "sha256:7bcfe3b6e0a115dc3a0fba1bb732b8e6574f60baf6fcd1e2c37871ae832227b8",
    "updated_at": "2026-06-18T00:06:36+02:00"
  },
  "top_caveat": "Keep the work read-only except for separate follow-up issues, and do not inspect unrelated repo contents beyond the allowed module and runbook paths."
}
<!-- /openclaw.judge.v0 -->

### Iskra judgment | Field | Value | | --- | --- | | Target | `pdurlej/platform#issue#760` | | Priority | p2 | | Action | observe | | Scores | reach 4 / impact 3 / confidence 5 | | Piotr fit | high | | Effort | small | | Labels | `judge/p2` | | Judge | `iskra` via `openclaw` | **Rationale:** This is P2 observe-first docs/process hygiene because missing or orphaned runbooks weaken recovery readiness but the task is bounded to inventory and follow-up issues. **Caveat:** Keep the work read-only except for separate follow-up issues, and do not inspect unrelated repo contents beyond the allowed module and runbook paths. <details> <summary>Structured openclaw.judge.v0 payload</summary> ```json  { "confidence": 5, "effort_hint": "small", "escalation": { "kind": "none", "reason": "" }, "evidence_refs": [ { "note": "Issue scopes a runbook coverage inventory for modules with manifests but missing runbooks and runbooks without manifests.", "type": "forgejo", "value": "issue-title-body-labels-and-target-snapshot" }, { "note": "Body provides bounded directory-listing checks and AGENTS.md format expectations as the only spec sources.", "type": "forgejo", "value": "issue-body-scope" }, { "note": "Current labels mark the target as ready, docs/process chore, priority p2, and small size.", "type": "forgejo", "value": "issue-labels-and-target-snapshot" } ], "impact": 3, "judge_actor": { "name": "iskra", "runtime": "openclaw" }, "judged_at": "2026-06-18T01:02:00Z", "labels_to_apply": [ "judge/p2" ], "piotr_fit": "high", "priority": "p2", "rationale_summary": "This is P2 observe-first docs/process hygiene because missing or orphaned runbooks weaken recovery readiness but the task is bounded to inventory and follow-up issues.", "reach": 4, "recommended_next_action": "observe", "rerun_reason": "no_prior_judgment", "schema": "openclaw.judge.v0", "target": { "kind": "issue", "number": 760, "repo": "pdurlej/platform" }, "target_snapshot": { "body_hash": "sha256:aaf2ee1949a0ef1ec40a7bf350e11bc5fc1cecf4026f2ea27382fa19330c005d", "commit_count": null, "evidence_hash": "sha256:e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855", "head_sha": null, "labels": [ "domain:docs", "flow/ready", "kind/chore", "phase/03", "priority:p2", "risk/process", "size/small" ], "labels_hash": "sha256:ce019f490c735251a36b9edb662e718f5defa4e920a921467b983e92c8e7b592", "state": "open", "title_hash": "sha256:7bcfe3b6e0a115dc3a0fba1bb732b8e6574f60baf6fcd1e2c37871ae832227b8", "updated_at": "2026-06-18T00:06:36+02:00" }, "top_caveat": "Keep the work read-only except for separate follow-up issues, and do not inspect unrelated repo contents beyond the allowed module and runbook paths." }  ``` </details>

Iskra added the

judge/p2

label

2026-06-18 03:03:54 +02:00

codex referenced this issue from a pull request that will close it,

2026-06-26 08:45:04 +02:00

feat(platformctl): generate module index and close catalog audits #836

pdurlej closed this issue

2026-06-26 09:04:48 +02:00