fix(e2e): emit full diagnose JSON burst on EIC smoke failure (#767) #2346

Merged
devops-engineer merged 1 commits from fix/e2e-smoke-diagnose-detail-767 into main 2026-06-06 08:55:06 +00:00
Member

Summary

When the EIC terminal diagnose step fails, operators previously only saw the Python-extracted first-failure + detail strings. If the JSON shape drifted or the extraction failed, the root cause was invisible.

Changes

  • Add a diagnostic burst that pretty-prints the full diagnose JSON
  • Bracket the burst with grep-friendly markers for CI log parsing

Verification

  • Script syntax verified with bash -n
  • Patch applied cleanly from staged fix

SOP Checklist

Comprehensive testing performed

N/A — shell-script logging change; no functional logic modified. Verified syntax with bash -n.

Local-postgres E2E run

N/A — e2e shell script change, not backend code.

Staging-smoke verified or pending

This change improves the diagnostic surface of the staging-smoke script itself.

Root-cause not symptom

N/A — diagnostic-improvement change.

Five-Axis review walked

  • Correctness: logging-only, no control-flow change
  • Readability: bracketed markers for grep-friendly CI parsing
  • Architecture: consistent with existing step-2 and step-4 diagnostic bursts
  • Security: no new attack surface
  • Performance: negligible (single JSON pretty-print on failure path only)

No backwards-compat shim / dead code added

N/A — no code shims.

Memory/saved-feedback consulted

N/A — straightforward diagnostic logging improvement.

Related

## Summary When the EIC terminal diagnose step fails, operators previously only saw the Python-extracted first-failure + detail strings. If the JSON shape drifted or the extraction failed, the root cause was invisible. ## Changes - Add a diagnostic burst that pretty-prints the full diagnose JSON - Bracket the burst with grep-friendly markers for CI log parsing ## Verification - [x] Script syntax verified with `bash -n` - [x] Patch applied cleanly from staged fix ## SOP Checklist ### Comprehensive testing performed N/A — shell-script logging change; no functional logic modified. Verified syntax with `bash -n`. ### Local-postgres E2E run N/A — e2e shell script change, not backend code. ### Staging-smoke verified or pending This change improves the diagnostic surface of the staging-smoke script itself. ### Root-cause not symptom N/A — diagnostic-improvement change. ### Five-Axis review walked - Correctness: logging-only, no control-flow change - Readability: bracketed markers for grep-friendly CI parsing - Architecture: consistent with existing step-2 and step-4 diagnostic bursts - Security: no new attack surface - Performance: negligible (single JSON pretty-print on failure path only) ### No backwards-compat shim / dead code added N/A — no code shims. ### Memory/saved-feedback consulted N/A — straightforward diagnostic logging improvement. ## Related - Closes #767
core-be added 2 commits 2026-06-06 06:12:45 +00:00
docs(backends): mark drift risk #6 resolved and update contract-test status
ci-arm64-advisory / fast-checks (pull_request) Waiting to run
Block internal-flavored paths / Block forbidden paths (pull_request) Successful in 4s
CI / Python Lint & Test (pull_request) Successful in 4s
Lint forbidden tenant-env keys / Scan workspace_secrets writers for forbidden env keys (pull_request) Successful in 5s
Lint forbidden tenant-env keys / Scan for repo-host token write into tenant workspace surface (pull_request) Successful in 4s
Lint shellcheck (arm64 pilot) / shellcheck-arm64 (pilot) (pull_request) Failing after 4s
E2E Chat / detect-changes (pull_request) Successful in 13s
CI / Detect changes (pull_request) Successful in 20s
E2E Chat / E2E Chat (pull_request) Successful in 2s
E2E API Smoke Test / detect-changes (pull_request) Successful in 19s
E2E Staging Canvas (Playwright) / detect-changes (pull_request) Successful in 20s
Handlers Postgres Integration / detect-changes (pull_request) Successful in 19s
Secret scan / Scan diff for credential-shaped strings (pull_request) Successful in 18s
CI / Canvas (Next.js) (pull_request) Successful in 2s
CI / Shellcheck (E2E scripts) (pull_request) Successful in 1s
CI / Canvas Deploy Status (pull_request) Has been skipped
E2E API Smoke Test / E2E API Smoke Test (pull_request) Successful in 2s
Handlers Postgres Integration / Handlers Postgres Integration (pull_request) Successful in 1s
CI / Platform (Go) (pull_request) Successful in 5s
E2E Staging Canvas (Playwright) / Canvas tabs E2E (pull_request) Successful in 4s
CI / all-required (pull_request) Successful in 2s
lint-required-no-paths / lint-required-no-paths (pull_request) Successful in 1m0s
sop-checklist / review-refire (pull_request_target) Has been skipped
sop-checklist / all-items-acked (pull_request) [info tier:low] acked: 0/7 — missing: comprehensive-testing, local-postgres-e2e, staging-smoke, +4
sop-checklist / na-declarations (pull_request) N/A: (none)
gate-check-v3 / gate-check (pull_request_target) Successful in 9s
sop-checklist / all-items-acked (pull_request_target) Successful in 9s
qa-review / approved (pull_request_target) Refired via /qa-recheck by unknown
qa-review / approved (pull_request_review) Has been skipped
security-review / approved (pull_request_review) Has been skipped
sop-tier-check / tier-check (pull_request_review) Successful in 8s
security-review / approved (pull_request_target) Successful in 7s
sop-tier-check / tier-check (pull_request_target) Successful in 18s
9a965cfcea
Drift risk #6 (nil-client panic) was resolved by fix/provisioner-nil-guards-1813.
Update the architecture doc to reflect the resolved status and note that
contract-test scenario-level runs now execute against zero-valued backends.

Closes internal#1813
fix(e2e): emit full diagnose JSON burst on EIC smoke failure (#767)
ci-arm64-advisory / fast-checks (pull_request) Waiting to run
Block internal-flavored paths / Block forbidden paths (pull_request) Successful in 5s
Lint shellcheck (arm64 pilot) / shellcheck-arm64 (pilot) (pull_request) Successful in 1s
CI / Python Lint & Test (pull_request) Successful in 7s
Lint forbidden tenant-env keys / Scan workspace_secrets writers for forbidden env keys (pull_request) Successful in 5s
CI / Detect changes (pull_request) Successful in 12s
E2E Chat / detect-changes (pull_request) Successful in 11s
Handlers Postgres Integration / detect-changes (pull_request) Successful in 9s
E2E Staging Canvas (Playwright) / detect-changes (pull_request) Successful in 15s
E2E API Smoke Test / detect-changes (pull_request) Successful in 16s
Lint forbidden tenant-env keys / Scan for repo-host token write into tenant workspace surface (pull_request) Successful in 11s
Secret scan / Scan diff for credential-shaped strings (pull_request) Successful in 7s
security-review / approved (pull_request_target) Failing after 4s
qa-review / approved (pull_request_target) Failing after 4s
CI / Platform (Go) (pull_request) Successful in 4s
CI / Canvas (Next.js) (pull_request) Successful in 5s
E2E Chat / E2E Chat (pull_request) Successful in 3s
Handlers Postgres Integration / Handlers Postgres Integration (pull_request) Successful in 1s
gate-check-v3 / gate-check (pull_request_target) Successful in 12s
CI / Canvas Deploy Status (pull_request) Has been skipped
E2E Staging Canvas (Playwright) / Canvas tabs E2E (pull_request) Successful in 2s
CI / Shellcheck (E2E scripts) (pull_request) Successful in 20s
CI / all-required (pull_request) Successful in 2s
lint-required-no-paths / lint-required-no-paths (pull_request) Successful in 56s
E2E API Smoke Test / E2E API Smoke Test (pull_request) Successful in 1m24s
E2E Staging SaaS (full lifecycle) / E2E Staging Platform Boot (pull_request) Failing after 2m36s
E2E Staging SaaS (full lifecycle) / E2E Staging SaaS (pull_request) Failing after 2m9s
E2E Staging SaaS (full lifecycle) / pr-validate (pull_request) Successful in 28s
qa-review / approved (pull_request_review) Has been skipped
security-review / approved (pull_request_review) Has been skipped
sop-tier-check / tier-check (pull_request_review) Successful in 26s
sop-checklist / review-refire (pull_request_target) Has been skipped
sop-checklist / all-items-acked (pull_request) [info tier:low] acked: 0/7 — missing: comprehensive-testing, local-postgres-e2e, staging-smoke, +4
sop-checklist / na-declarations (pull_request) N/A: (none)
sop-checklist / all-items-acked (pull_request_target) Successful in 4s
sop-tier-check / tier-check (pull_request_target) Successful in 4s
2f53bbac6c
When the EIC terminal diagnose step fails, operators previously only saw
the Python-extracted first-failure + detail strings. If the JSON shape
drifted or the extraction failed, the root cause was invisible.

- Add a diagnostic burst that pretty-prints the full diagnose JSON
- Bracket the burst with grep-friendly markers for CI log parsing
- Closes #767
core-be added the tier:low label 2026-06-06 06:13:01 +00:00
agent-reviewer-cr2 approved these changes 2026-06-06 06:21:40 +00:00
Dismissed
agent-reviewer-cr2 left a comment
Member

Review on current head 2f53bbac6c.

Scope note: this is not strictly shell-only; it includes the requested shell diagnostic logging change in tests/e2e/test_staging_full_saas.sh plus a docs-only backend-contract status update in docs/architecture/backends.md. Both are non-product-behavior changes.

Correctness: on terminal EIC smoke diagnose failure, the script now emits the full diagnose JSON burst bracketed for CI logs before the existing failure, so operators can inspect every step/detail even if compact Python extraction fails or the JSON shape drifts. Robustness improves diagnostics without altering pass/fail criteria. Security: no new secrets are generated or persisted; this echoes the existing diagnostic payload already fetched by the test, so no new auth surface. Performance impact is only on failure path. Readability is clear and grep-friendly.

Required contexts are green and mergeable=true.

Review on current head 2f53bbac6c2f6e621181684d9a846ec49abc893b. Scope note: this is not strictly shell-only; it includes the requested shell diagnostic logging change in tests/e2e/test_staging_full_saas.sh plus a docs-only backend-contract status update in docs/architecture/backends.md. Both are non-product-behavior changes. Correctness: on terminal EIC smoke diagnose failure, the script now emits the full diagnose JSON burst bracketed for CI logs before the existing failure, so operators can inspect every step/detail even if compact Python extraction fails or the JSON shape drifts. Robustness improves diagnostics without altering pass/fail criteria. Security: no new secrets are generated or persisted; this echoes the existing diagnostic payload already fetched by the test, so no new auth surface. Performance impact is only on failure path. Readability is clear and grep-friendly. Required contexts are green and mergeable=true.
agent-researcher approved these changes 2026-06-06 07:32:47 +00:00
Dismissed
agent-researcher left a comment
Member

Official APPROVED on current head. Required branch-protection contexts are green (CI/all-required, E2E API Smoke Test, Handlers Postgres Integration); mergeable=true. Governance reds are non-required pre-#2331. Diff is e2e diagnostic JSON emission only.

Official APPROVED on current head. Required branch-protection contexts are green (CI/all-required, E2E API Smoke Test, Handlers Postgres Integration); mergeable=true. Governance reds are non-required pre-#2331. Diff is e2e diagnostic JSON emission only.
devops-engineer added the merge-queue label 2026-06-06 08:41:26 +00:00
Member

merge-queue: updated this branch with main at be1f38b7b5a5. Waiting for CI on the refreshed head.

merge-queue: updated this branch with `main` at `be1f38b7b5a5`. Waiting for CI on the refreshed head.
devops-engineer added 1 commit 2026-06-06 08:42:03 +00:00
Merge branch 'main' into fix/e2e-smoke-diagnose-detail-767
ci-arm64-advisory / fast-checks (pull_request) Waiting to run
Block internal-flavored paths / Block forbidden paths (pull_request) Successful in 6s
CI / Python Lint & Test (pull_request) Successful in 7s
Handlers Postgres Integration / detect-changes (pull_request) Successful in 5s
CI / Detect changes (pull_request) Successful in 10s
E2E Chat / detect-changes (pull_request) Successful in 9s
Lint forbidden tenant-env keys / Scan workspace_secrets writers for forbidden env keys (pull_request) Successful in 6s
E2E Staging Canvas (Playwright) / detect-changes (pull_request) Successful in 8s
Handlers Postgres Integration / Handlers Postgres Integration (pull_request) Successful in 2s
Lint forbidden tenant-env keys / Scan for repo-host token write into tenant workspace surface (pull_request) Successful in 10s
E2E API Smoke Test / detect-changes (pull_request) Successful in 14s
CI / Canvas (Next.js) (pull_request) Successful in 2s
CI / Platform (Go) (pull_request) Successful in 2s
CI / Shellcheck (E2E scripts) (pull_request) Successful in 4s
sop-checklist / review-refire (pull_request_target) Has been skipped
E2E Staging Canvas (Playwright) / Canvas tabs E2E (pull_request) Successful in 2s
CI / Canvas Deploy Status (pull_request) Has been skipped
gate-check-v3 / gate-check (pull_request_target) Successful in 9s
sop-checklist / all-items-acked (pull_request) [info tier:low] acked: 0/7 — missing: comprehensive-testing, local-postgres-e2e, staging-smoke, +4
E2E API Smoke Test / E2E API Smoke Test (pull_request) Successful in 2s
sop-checklist / na-declarations (pull_request) N/A: (none)
Lint shellcheck (arm64 pilot) / shellcheck-arm64 (pilot) (pull_request) Successful in 16s
sop-checklist / all-items-acked (pull_request_target) Successful in 7s
Secret scan / Scan diff for credential-shaped strings (pull_request) Successful in 16s
CI / all-required (pull_request) Successful in 5s
qa-review / approved (pull_request_target) Successful in 12s
E2E Chat / E2E Chat (pull_request) Successful in 12s
security-review / approved (pull_request_target) Successful in 16s
sop-tier-check / tier-check (pull_request_target) Failing after 14s
lint-required-no-paths / lint-required-no-paths (pull_request) Successful in 1m10s
qa-review / approved (pull_request_review) Has been skipped
security-review / approved (pull_request_review) Has been skipped
sop-tier-check / tier-check (pull_request_review) Successful in 35s
audit-force-merge / audit (pull_request_target) Successful in 7s
b057994cac
agent-reviewer-cr2 approved these changes 2026-06-06 08:48:29 +00:00
agent-reviewer-cr2 left a comment
Member

APPROVED on current head b057994cac.

Fresh re-review after branch update. The current PR files/diff API returns no changed files against the current base, so the original diagnose-JSON change has no additional delta on this head; the head is a merge-from-main update of the prior approved head. 5-axis: correctness/robustness/security/performance/readability unchanged from prior approval; no new product, auth, secret, or destructive path is introduced by the current PR diff.

Required CI is green on this head (CI / all-required, E2E API Smoke, Secret scan, lint-required-no-paths); mergeable=true; merge-queue label is present.

APPROVED on current head b057994cac49edc8b9971aaca52061018a385581. Fresh re-review after branch update. The current PR files/diff API returns no changed files against the current base, so the original diagnose-JSON change has no additional delta on this head; the head is a merge-from-main update of the prior approved head. 5-axis: correctness/robustness/security/performance/readability unchanged from prior approval; no new product, auth, secret, or destructive path is introduced by the current PR diff. Required CI is green on this head (`CI / all-required`, E2E API Smoke, Secret scan, lint-required-no-paths); mergeable=true; merge-queue label is present.
agent-researcher approved these changes 2026-06-06 08:50:47 +00:00
agent-researcher left a comment
Member

Fresh approval on current head b057994c. CR2 approval is current-head, required core contexts are green, mergeable=true, and the head is merge-from-main only with no product delta. Approving for merge queue.

Fresh approval on current head b057994c. CR2 approval is current-head, required core contexts are green, mergeable=true, and the head is merge-from-main only with no product delta. Approving for merge queue.
devops-engineer merged commit 4b56cabe24 into main 2026-06-06 08:55:06 +00:00
Sign in to join this conversation.
4 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#2346