feat(telemetry): add Iskra JSONL backend #87

Merged
pdurlej merged 4 commits from codex/platform-telemetry-jsonl into main 2026-05-05 12:55:35 +02:00
Collaborator

Canary status: approve_merge — synthetic GLM 5.1 review approved; formal Forgejo review by glm is APPROVED on head 185974234319861e7aaa66d945cea5a8adca2b88. CI canary-required / canary is red, but collect-diff, Python CI, pyfallow and GLM review passed; API reports mergeable=true.

Scope

Adds the platform-side backend for pdurlej/iskra-openclaw#40.

Covers:

  • platformctl telemetry validate EVENT_FILE for one sanitized Iskra telemetry event.
  • platformctl telemetry ingest EVENT_FILE --log state/telemetry/events.jsonl append-only JSONL storage.
  • platformctl telemetry rollup --log ... aggregate counters for weekly retro/self-audit.
  • ADR 0004 documenting the merge-coupled boundary: Iskra owns emitters/contracts, platform owns JSONL backend.

Privacy contract

The backend rejects:

  • raw user text;
  • Agent Souls content;
  • secret-looking string values;
  • invalid input classes/statuses.

Rollups expose policy counters:

  • writesWithoutReceipt
  • forgejoCreatesWithoutExplicitAuthorization
  • agentSoulsContentStored
  • rawTranscriptTelemetryEvents

Tests

  • PYTHONPATH=. python3 -m py_compile platformctl/telemetry.py platformctl/cli.py
  • PYTHONPATH=. pytest -q platformctl/tests/test_telemetry.py platformctl/tests/test_smoke.py10 passed
  • CLI smoke: validate, ingest, rollup on a temp event
  • git diff --check

Merge coupling

Merge with pdurlej/iskra-openclaw#53. This PR provides the backend; the Iskra PR provides emitters/contracts and docs. Merging only one side leaves #40 incomplete.

Merge order:

  1. pdurlej/platform#87
  2. pdurlej/iskra-openclaw#53

Rollback

Revert this PR. It adds only a new CLI group and ADR; no runtime service or production data path is changed.

GLM review

Formal Forgejo review by glm: APPROVED.

GLM batch review verdict: APPROVE. No cross-PR blockers after aligning telemetry hash salt with iskra-openclaw#53.

Canary status: approve_merge — synthetic GLM 5.1 review approved; formal Forgejo review by `glm` is APPROVED on head `185974234319861e7aaa66d945cea5a8adca2b88`. CI `canary-required / canary` is red, but `collect-diff`, Python CI, pyfallow and GLM review passed; API reports `mergeable=true`. ## Scope Adds the platform-side backend for `pdurlej/iskra-openclaw#40`. Covers: - `platformctl telemetry validate EVENT_FILE` for one sanitized Iskra telemetry event. - `platformctl telemetry ingest EVENT_FILE --log state/telemetry/events.jsonl` append-only JSONL storage. - `platformctl telemetry rollup --log ...` aggregate counters for weekly retro/self-audit. - ADR 0004 documenting the merge-coupled boundary: Iskra owns emitters/contracts, platform owns JSONL backend. ## Privacy contract The backend rejects: - raw user text; - Agent Souls content; - secret-looking string values; - invalid input classes/statuses. Rollups expose policy counters: - `writesWithoutReceipt` - `forgejoCreatesWithoutExplicitAuthorization` - `agentSoulsContentStored` - `rawTranscriptTelemetryEvents` ## Tests - `PYTHONPATH=. python3 -m py_compile platformctl/telemetry.py platformctl/cli.py` - `PYTHONPATH=. pytest -q platformctl/tests/test_telemetry.py platformctl/tests/test_smoke.py` → `10 passed` - CLI smoke: validate, ingest, rollup on a temp event - `git diff --check` ## Merge coupling Merge with `pdurlej/iskra-openclaw#53`. This PR provides the backend; the Iskra PR provides emitters/contracts and docs. Merging only one side leaves #40 incomplete. Merge order: 1. `pdurlej/platform#87` 2. `pdurlej/iskra-openclaw#53` ## Rollback Revert this PR. It adds only a new CLI group and ADR; no runtime service or production data path is changed. ## GLM review Formal Forgejo review by `glm`: APPROVED. GLM batch review verdict: APPROVE. No cross-PR blockers after aligning telemetry hash salt with `iskra-openclaw#53`.
feat(telemetry): add Iskra JSONL backend
Some checks failed
canary-required / collect-diff (pull_request) Successful in 3s
pyfallow / Pyfallow gate (control-plane) (pull_request) Successful in 16s
python-ci / Python 3.11 (pull_request) Successful in 25s
python-ci / Python 3.12 (pull_request) Successful in 26s
python-ci / Python 3.13 (pull_request) Successful in 24s
canary-required / canary (pull_request) Failing after 1s
92d914b548
fix(telemetry): harden JSONL rollups
Some checks failed
canary-required / collect-diff (pull_request) Successful in 3s
pyfallow / Pyfallow gate (control-plane) (pull_request) Successful in 17s
python-ci / Python 3.11 (pull_request) Successful in 24s
python-ci / Python 3.12 (pull_request) Successful in 25s
python-ci / Python 3.13 (pull_request) Successful in 25s
canary-required / canary (pull_request) Failing after 1s
88821f2626
fix(telemetry): broaden bearer redaction
Some checks are pending
canary-required / collect-diff (pull_request) Waiting to run
canary-required / canary (pull_request) Blocked by required conditions
pyfallow / Pyfallow gate (control-plane) (pull_request) Waiting to run
python-ci / Python 3.11 (pull_request) Waiting to run
python-ci / Python 3.12 (pull_request) Waiting to run
python-ci / Python 3.13 (pull_request) Waiting to run
d28bed3386
fix(telemetry): align hash salt contract
Some checks failed
canary-required / collect-diff (pull_request) Successful in 3s
pyfallow / Pyfallow gate (control-plane) (pull_request) Successful in 16s
python-ci / Python 3.11 (pull_request) Successful in 25s
python-ci / Python 3.12 (pull_request) Successful in 24s
python-ci / Python 3.13 (pull_request) Successful in 24s
canary-required / canary (pull_request) Failing after 1s
1859742343
glm approved these changes 2026-05-05 11:31:09 +02:00
glm left a comment

GLM 5.1 review: APPROVE

Confidence: 0.88
Head reviewed: 1859742343

No blockers. This is approved as the platform-side JSONL backend for iskra-openclaw#40.

Non-blocking follow-ups:

  • Production should set PLATFORMCTL_TELEMETRY_HASH_SALT; the shared fallback is dev/test only.
  • High-concurrency telemetry can later use a stronger queue/lock model.
  • Retention/date-range pruning can be added after v1.

Merge coupling: merge with iskra-openclaw#53, platform#87 first.

GLM 5.1 review: APPROVE Confidence: 0.88 Head reviewed: 185974234319861e7aaa66d945cea5a8adca2b88 No blockers. This is approved as the platform-side JSONL backend for iskra-openclaw#40. Non-blocking follow-ups: - Production should set PLATFORMCTL_TELEMETRY_HASH_SALT; the shared fallback is dev/test only. - High-concurrency telemetry can later use a stronger queue/lock model. - Retention/date-range pruning can be added after v1. Merge coupling: merge with iskra-openclaw#53, platform#87 first.
glm approved these changes 2026-05-05 11:31:47 +02:00
glm left a comment

Submitted GLM 5.1 approve.

Submitted GLM 5.1 approve.
pdurlej changed title from feat(telemetry): add Iskra JSONL backend to WIP: feat(telemetry): add Iskra JSONL backend 2026-05-05 12:25:47 +02:00
pdurlej approved these changes 2026-05-05 12:26:05 +02:00
pdurlej changed title from WIP: feat(telemetry): add Iskra JSONL backend to feat(telemetry): add Iskra JSONL backend 2026-05-05 12:28:02 +02:00
Sign in to join this conversation.
No reviewers
No labels
W6d-automerge-calibration
agent/claude-code
agent/codex
agent/hermes
agent/iskra
agent/ollama
agent/patchwarden
automerge-candidate
class/security-sensitive
cutover-gate
dependency/blocked
dependency/blocks-others
dependency/cross-repo
dependency/needs-confirmation
domain:agents
domain:ci
domain:docs
domain:forgejo
domain:infra
domain:memory
domain:runtime
domain:signal
domain:ux
flow/architecture
flow/blocked
flow/deployed
flow/done
flow/implementation
flow/intake
flow/maintained
flow/observed
flow/ready
flow/refining
flow/retired
flow/review
iterating
judge/codex-candidate
judge/hermes-candidate
judge/low-confidence
judge/needs-refinement
judge/operator-needed
judge/p0
judge/p1
judge/p2
judge/p3
judge/park
judge/patchwarden-candidate
judge/stale-priority
kind/adr
kind/bug
kind/chore
kind/feature
kind/infra
kind/ops
kind/refactor
kind/research
large-impact
merge/auto
merge/manual
merge/manual-dependency-conflict
merge/manual-failing-tests
merge/manual-merge-conflict
merge/manual-missing-review
merge/manual-operator-preference
merge/manual-red-zone
merge/manual-security-sensitive
merge/manual-unclear-scope
merge/manual-unknown
meta
mode:operator-only
mode:patchwarden-iskra-approved
mode:safe-auto
needs-operator-decision
needs-triage
not-ready
observed/erroring
observed/needs-followup
observed/pending
observed/retire-candidate
observed/unused
observed/used
operator-emotional
owner-attention
phase/02
phase/03
priority:p0
priority:p1
priority:p2
priority:p3
proposed
ready-for-agent
ready-for-operator
recovery
review:claude-reviewed
review:codex-reviewed
review:dziadek-reviewed
review:needs-human
risk/exposure
risk/process
risk/product
risk/runtime
safety:external-write
safety:no-prod-mutation
safety:prod-impact
safety:secret-touch
size/large
size/medium
size/small
size/tiny
size/unknown
source/adr
source/agent-generated
source/manual
source/operator-chat
source/voice-note
status:blocked
status:codex-ready
status:merged:pending-evidence
status:needs-evidence
status:operator-needed
status:parked
tier/full
tier/lite
tier/stacked
tier:0-platform-substrate
tier:1-iskra-value-layer
tier:2-tools-products-modules
type:bug
type:chore
type:docs
type:feat
type:policy
type:research
No milestone
No project
No assignees
3 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
pdurlej/platform!87
No description provided.