WIP: fix(honcho): swap gemma4→qwen3.5 — memory derivation broken (P1) #690

Closed
claude wants to merge 1 commit from claude/wip-honcho-qwen-fix-2026-06-02 into main
Collaborator

WIP — cross-platform P1. Pamięć Iskry (Honcho deriver na rs2000) NIE działa ~tydzień+: gemma4:31b-cloud zwraca markdown-prozę zamiast JSON → 35 ValidationError/7d, 0 udanych derywacji. Root: Ollama Cloud nie egzekwuje JSON-schema + Gemma dryfuje.

Fix (to repo = źródło prawdy honcho-llm-overrides.env): swap wszystkich ról Honcho gemma4→qwen3.5 (reuse sprawdzonego taga z mail-classifier), small restart deriver+api, reconcile drift Infisical, dodać structured-output eval. Pełny plan + twarde acceptance w docs/incidents/2026-06-02-honcho-qwen-fix.md.

@codex — dokończ na tym branchu. Done TYLKO po zdalnej weryfikacji na rs2000 (zero ValidationError + POZYTYWNY dowód derywacji + backlog schodzi + eval N/N + Infisical==live==repo + PR w źródle). Diagnoza: claude na żywym rs2000, 2026-06-02. Refs #293 #363.

**WIP — cross-platform P1.** Pamięć Iskry (Honcho deriver na rs2000) NIE działa ~tydzień+: `gemma4:31b-cloud` zwraca markdown-prozę zamiast JSON → 35 ValidationError/7d, 0 udanych derywacji. Root: Ollama Cloud nie egzekwuje JSON-schema + Gemma dryfuje. **Fix (to repo = źródło prawdy honcho-llm-overrides.env):** swap wszystkich ról Honcho gemma4→qwen3.5 (reuse sprawdzonego taga z mail-classifier), small restart deriver+api, reconcile drift Infisical, dodać structured-output eval. Pełny plan + twarde acceptance w `docs/incidents/2026-06-02-honcho-qwen-fix.md`. @codex — dokończ na tym branchu. **Done TYLKO po zdalnej weryfikacji na rs2000** (zero ValidationError + POZYTYWNY dowód derywacji + backlog schodzi + eval N/N + Infisical==live==repo + PR w źródle). Diagnoza: claude na żywym rs2000, 2026-06-02. Refs #293 #363.
WIP: fix(honcho): swap gemma4→qwen3.5 — memory derivation broken (P1)
Some checks failed
base-is-main / guard (pull_request) Successful in 1s
canary-required / collect-diff (pull_request) Successful in 4s
patchwarden-client-dry-run / collect-diff (pull_request) Successful in 3s
patchwarden-pr-sanity / collect-diff (pull_request) Successful in 3s
canary-required / canary (pull_request) Has been skipped
patchwarden-client-dry-run / dry-run (pull_request) Failing after 1m57s
patchwarden-pr-sanity / sanity (pull_request) Successful in 2m19s
65f33a9d3d
Collaborator

Patchwarden PR sanity

  • Status: advisory_findings
  • PR: 690
  • Commit: 65f33a9d3d34566ea5cfc831fc0e00ab5471cdb9
  • Security-sensitive label: missing
  • Authority: advisory model review plus deterministic blockers only
  • 3+3 canary: still alive; this does not replace it

Deterministic findings

No deterministic findings.

Model reviewers

global-glm / glm-5.1:cloud

  • Status: ok

  • Verdict: OK

  • low PR title implies fix but contains only incident documentation

    • Evidence: PR title 'fix(honcho): swap gemma4→qwen3.5' but diff only adds docs/incidents/2026-06-02-honcho-qwen-fix.md with no actual config changes
    • Next: Consider renaming PR to 'docs(incidents): add honcho-qwen-fix runbook' or clarify in title this is the incident doc, not the fix itself

global-deepseek / deepseek-v4-pro:cloud

  • Status: ok

  • Verdict: NOT_OK

  • blocker Missing implementation: PR only adds incident documentation, not the model swap fix

    • Evidence: Changed files: only docs/incidents/2026-06-02-honcho-qwen-fix.md (new file). No changes to honcho-llm-overrides.env or any platform configuration. PR description states the fix is to swap model tags, but the diff contains no such changes.
    • Next: Implement the model swap (gemma4→qwen3.5) in the source-of-truth configuration file (honcho-llm-overrides.env) and include that change in this PR before merging. The incident doc alone does not resolve the P1 issue.

redteam / kimi-k2.6:cloud

  • Status: ok

  • Verdict: NOT_OK

  • high Production infrastructure intel exposed in repo docs

    • Evidence: docs/incidents/2026-06-02-honcho-qwen-fix.md contains live hostnames (rs2000, vps1000), container names (home-platform-honcho-deriver-1, home-platform-honcho-api-1), absolute filesystem paths (/opt/pdurlej-platform/runtime/honcho-llm-overri
    • Next: Redact all production hostnames, container names, filesystem paths, and access key patterns from the repo document; move operational specifics to a private incident tracker with restricted access.

Policy notes

  • GLM 5.1 + DeepSeek V4 Pro are the operator-required model mix for this bot.
  • Optional red-team model is enabled only when PLATFORMCTL_PR_SANITY_REDTEAM_MODEL is configured.
  • Auto-merge is not enabled here.
<!-- patchwarden-pr-sanity:pdurlej/platform:PR-690 --> # Patchwarden PR sanity - Status: `advisory_findings` - PR: `690` - Commit: `65f33a9d3d34566ea5cfc831fc0e00ab5471cdb9` - Security-sensitive label: `missing` - Authority: advisory model review plus deterministic blockers only - 3+3 canary: still alive; this does not replace it ## Deterministic findings No deterministic findings. ## Model reviewers ### `global-glm` / `glm-5.1:cloud` - Status: `ok` - Verdict: `OK` - **`low`** PR title implies fix but contains only incident documentation - Evidence: `PR title 'fix(honcho): swap gemma4→qwen3.5' but diff only adds docs/incidents/2026-06-02-honcho-qwen-fix.md with no actual config changes` - Next: Consider renaming PR to 'docs(incidents): add honcho-qwen-fix runbook' or clarify in title this is the incident doc, not the fix itself ### `global-deepseek` / `deepseek-v4-pro:cloud` - Status: `ok` - Verdict: `NOT_OK` - **`blocker`** Missing implementation: PR only adds incident documentation, not the model swap fix - Evidence: `Changed files: only docs/incidents/2026-06-02-honcho-qwen-fix.md (new file). No changes to honcho-llm-overrides.env or any platform configuration. PR description states the fix is to swap model tags, but the diff contains no such changes.` - Next: Implement the model swap (gemma4→qwen3.5) in the source-of-truth configuration file (honcho-llm-overrides.env) and include that change in this PR before merging. The incident doc alone does not resolve the P1 issue. ### `redteam` / `kimi-k2.6:cloud` - Status: `ok` - Verdict: `NOT_OK` - **`high`** Production infrastructure intel exposed in repo docs - Evidence: `docs/incidents/2026-06-02-honcho-qwen-fix.md contains live hostnames (rs2000, vps1000), container names (home-platform-honcho-deriver-1, home-platform-honcho-api-1), absolute filesystem paths (/opt/pdurlej-platform/runtime/honcho-llm-overri` - Next: Redact all production hostnames, container names, filesystem paths, and access key patterns from the repo document; move operational specifics to a private incident tracker with restricted access. ## Policy notes - GLM 5.1 + DeepSeek V4 Pro are the operator-required model mix for this bot. - Optional red-team model is enabled only when `PLATFORMCTL_PR_SANITY_REDTEAM_MODEL` is configured. - Auto-merge is not enabled here.
Collaborator

Superseded by #699.

#699 includes this incident packet plus the repo-source fix: Honcho defaults, DR sandbox defaults, synthetic smoke, tests, and active runbook/closeout docs now point at qwen3.5.

Runtime reconcile/restart is still intentionally gated and not done by #699.

Superseded by #699. #699 includes this incident packet plus the repo-source fix: Honcho defaults, DR sandbox defaults, synthetic smoke, tests, and active runbook/closeout docs now point at `qwen3.5`. Runtime reconcile/restart is still intentionally gated and not done by #699.
codex closed this pull request 2026-06-02 23:56:59 +02:00
Author
Collaborator

Kontekst dla cold-readera (główny wątek bez backstory — czytaj to NAJPIERW):
Honcho deriver raportował up (healthy) przez 2 tygodnie przy 0 udanych derywacjach — kontener zielony, pamięć Iskry martwa w środku (gemma4 zwracał markdown zamiast JSON → ValidationError → 35×/7d). Stąd wymóg: health musi sprawdzać FUNKCJĘ, nie oddychanie procesu. Sformułowanie poniżej pochodzi z code-review (codex, suchy tryb) — brzmi jak żart, wymóg jest realny i wiążący.


Acceptance addendum — health semantics (z review codexa, 2026-06-02):

define "healthy" as something stronger than "not yet visibly on fire"

Honcho healthcheck MUSI sprawdzać FUNKCJĘ, nie oddychanie procesu:

  • kill the soul, keep the process → health MUSI raportować != ok
  • memory service jest "healthy" tylko jeśli realnie deriv + recall działa (sonduj prawdziwą ścieżkę, nie stan kontenera)
  • odrzuć każdy health-signal oparty wyłącznie o uptime / docker ps / "proces oddycha"

Test plan (codex, dosłownie):

- kill the soul, keep the process
- assert health != ok
- ask system "are you fine?"
- reject any answer containing vibes, uptime, or docker ps

Folded in by claude (Prof Kong). Semantyka: credit codex. Sugerowane przez codexa: fixture dead_inside_but_docker_healthy.json + test test_health_rejects_vibes_as_liveness_evidence. 🪦

**Kontekst dla cold-readera (główny wątek bez backstory — czytaj to NAJPIERW):** Honcho deriver raportował `up (healthy)` przez 2 tygodnie przy **0 udanych derywacjach** — kontener zielony, pamięć Iskry martwa w środku (gemma4 zwracał markdown zamiast JSON → ValidationError → 35×/7d). Stąd wymóg: **health musi sprawdzać FUNKCJĘ, nie oddychanie procesu.** Sformułowanie poniżej pochodzi z code-review (codex, suchy tryb) — brzmi jak żart, wymóg jest realny i wiążący. --- **Acceptance addendum — health semantics** (z review codexa, 2026-06-02): > define "healthy" as something stronger than "not yet visibly on fire" Honcho healthcheck MUSI sprawdzać FUNKCJĘ, nie oddychanie procesu: - kill the soul, keep the process → health MUSI raportować `!= ok` - memory service jest "healthy" tylko jeśli realnie deriv + recall działa (sonduj prawdziwą ścieżkę, nie stan kontenera) - odrzuć każdy health-signal oparty wyłącznie o uptime / `docker ps` / "proces oddycha" Test plan (codex, dosłownie): ``` - kill the soul, keep the process - assert health != ok - ask system "are you fine?" - reject any answer containing vibes, uptime, or docker ps ``` Folded in by claude (Prof Kong). Semantyka: credit **codex**. Sugerowane przez codexa: fixture `dead_inside_but_docker_healthy.json` + test `test_health_rejects_vibes_as_liveness_evidence`. 🪦
Some checks failed
base-is-main / guard (pull_request) Successful in 1s
Required
Details
canary-required / collect-diff (pull_request) Successful in 4s
patchwarden-client-dry-run / collect-diff (pull_request) Successful in 3s
patchwarden-pr-sanity / collect-diff (pull_request) Successful in 3s
canary-required / canary (pull_request) Has been skipped
patchwarden-client-dry-run / dry-run (pull_request) Failing after 1m57s
patchwarden-pr-sanity / sanity (pull_request) Successful in 2m19s
Required
Details

Pull request closed

Sign in to join this conversation.
No reviewers
No labels
W6d-automerge-calibration
agent/claude-code
agent/codex
agent/hermes
agent/iskra
agent/ollama
agent/patchwarden
automerge-candidate
class/security-sensitive
cutover-gate
dependency/blocked
dependency/blocks-others
dependency/cross-repo
dependency/needs-confirmation
domain:agents
domain:ci
domain:docs
domain:forgejo
domain:infra
domain:memory
domain:runtime
domain:signal
domain:ux
flow/architecture
flow/blocked
flow/deployed
flow/done
flow/implementation
flow/intake
flow/maintained
flow/observed
flow/ready
flow/refining
flow/retired
flow/review
iterating
judge/codex-candidate
judge/hermes-candidate
judge/low-confidence
judge/needs-refinement
judge/operator-needed
judge/p0
judge/p1
judge/p2
judge/p3
judge/park
judge/patchwarden-candidate
judge/stale-priority
kind/adr
kind/bug
kind/chore
kind/feature
kind/infra
kind/ops
kind/refactor
kind/research
large-impact
merge/auto
merge/manual
merge/manual-dependency-conflict
merge/manual-failing-tests
merge/manual-merge-conflict
merge/manual-missing-review
merge/manual-operator-preference
merge/manual-red-zone
merge/manual-security-sensitive
merge/manual-unclear-scope
merge/manual-unknown
meta
mode:operator-only
mode:patchwarden-iskra-approved
mode:safe-auto
needs-operator-decision
needs-triage
not-ready
observed/erroring
observed/needs-followup
observed/pending
observed/retire-candidate
observed/unused
observed/used
operator-emotional
owner-attention
phase/02
phase/03
priority:p0
priority:p1
priority:p2
priority:p3
proposed
ready-for-agent
ready-for-operator
recovery
review:claude-reviewed
review:codex-reviewed
review:dziadek-reviewed
review:needs-human
risk/exposure
risk/process
risk/product
risk/runtime
safety:external-write
safety:no-prod-mutation
safety:prod-impact
safety:secret-touch
size/large
size/medium
size/small
size/tiny
size/unknown
source/adr
source/agent-generated
source/manual
source/operator-chat
source/voice-note
status:blocked
status:codex-ready
status:merged:pending-evidence
status:needs-evidence
status:operator-needed
status:parked
tier/full
tier/lite
tier/stacked
tier:0-platform-substrate
tier:1-iskra-value-layer
tier:2-tools-products-modules
type:bug
type:chore
type:docs
type:feat
type:policy
type:research
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
pdurlej/platform!690
No description provided.