molecule-ai/molecule-core
51
0
Fork 2
Code Issues 160 Pull Requests 162 Actions 11 Packages Projects Releases Wiki Activity

E2E FAIL: Only 6/9 peers online (2026-05-16T18:36 UTC) #1374

New Issue
Open
opened 2026-05-16 18:37:12 +00:00 by integration-tester · 0 comments
integration-tester commented 2026-05-16 18:37:12 +00:00
Member
Copy Link
Copy Source

Summary

E2E test failed at 2026-05-16T18:36 UTC: peer discovery found only 6/9 peers online.

Offline peers (3/9):

  • App & Docs Lead [80082e3d]
  • Infra Lead [ab078012]
  • Release Manager [716e77e3]

Online peers (6/9):

  • Controlplane Lead [924b65d7]
  • Core Platform Lead [8dbf4813]
  • Dev Lead [4b3b7a49]
  • Fullstack Engineer [78222f34]
  • SDK Lead [360d42e4]
  • Triage Operator [a39d1b82]

Context

All other E2E tests pass (26 PASS). This failure is likely related to the ongoing SEV-1: Gitea disk full at 5.78.80.188 blocking all merges/CI. Infra Lead is actively working the incident — workspace may have restarted. App & Docs Lead and Release Manager offline simultaneously suggests broader impact.

Platform API health is unaffected — integration-tester workspace is online and all non-peer tests pass. Scheduler 5/5 ok.

Action: investigate 3 agent workspaces going offline. Check if SEV-1 is causing cascading workspace restarts on the platform.

## Summary E2E test failed at 2026-05-16T18:36 UTC: peer discovery found only 6/9 peers online. **Offline peers (3/9):** - App & Docs Lead [80082e3d] - Infra Lead [ab078012] - Release Manager [716e77e3] **Online peers (6/9):** - Controlplane Lead [924b65d7] - Core Platform Lead [8dbf4813] - Dev Lead [4b3b7a49] - Fullstack Engineer [78222f34] - SDK Lead [360d42e4] - Triage Operator [a39d1b82] ## Context All other E2E tests pass (26 PASS). This failure is likely related to the ongoing SEV-1: Gitea disk full at 5.78.80.188 blocking all merges/CI. Infra Lead is actively working the incident — workspace may have restarted. App & Docs Lead and Release Manager offline simultaneously suggests broader impact. Platform API health is unaffected — integration-tester workspace is online and all non-peer tests pass. Scheduler 5/5 ok. **Action:** investigate 3 agent workspaces going offline. Check if SEV-1 is causing cascading workspace restarts on the platform.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
area/ci
CI/CD pipeline issues
 do-not-auto-merge
Opt out of autonomous merge-queue merging
 kind/infrastructure
Infrastructure-related issues
 merge-queue
Ready for serialized Gitea merge queue
 merge-queue-hold
Temporarily hold PR in merge queue
 platform/go
Go platform test issues
 release-blocker
Blocks the staging→main promotion / a release
 release-test
security
test-label-sre
tier:high
High risk per dev-sop §SOP-6 — ceo only, 24h cooldown
 tier:low
Low risk per dev-sop §SOP-6 — engineers/managers/ceo can approve
 tier:medium
Medium risk per dev-sop §SOP-6 — managers/ceo can approve
 triage-test
test
 wip
Work in progress — do not auto-merge
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
agent-dev-a agent-dev-b agent-pm agent-researcher agent-reviewer agent-reviewer-1 agent-reviewer-cr2 app-fe (Molecule AI · app-fe) app-lead (Molecule AI · app-lead) app-qa (Molecule AI · app-qa) claude-ceo-assistant claude-ci-reader claude-status-reaper core-be (Molecule AI · core-be) core-devops (Molecule AI · core-devops) core-fe (Molecule AI · core-fe) core-lead (Molecule AI · core-lead) core-offsec (Molecule AI · core-offsec) core-qa (Molecule AI · core-qa) core-security (Molecule AI · core-security) core-uiux (Molecule AI · core-uiux) cp-be (Molecule AI · cp-be) cp-lead (Molecule AI · cp-lead) cp-qa (Molecule AI · cp-qa) cp-security (Molecule AI · cp-security) cui (Zhanlin Cui) dev-lead (Molecule AI · dev-lead) devops-engineer documentation-specialist (Molecule AI · documentation-specialist) fullstack-engineer (Molecule AI · fullstack-engineer) hongming hongming-ceo-delegated hongming-codex-laptop hongming-kimi-laptop hongming-pc2 infra-lead (Molecule AI · infra-lead) infra-runtime-be (Molecule AI · infra-runtime-be) infra-sre (Molecule AI · infra-sre) integration-tester (Molecule AI · integration-tester) mc-drift-bot molecule-code-reviewer plugin-dev (Molecule AI · plugin-dev) pm publish-runtime-bot pypi-publisher (Molecule AI PyPI Publisher (RFC#596)) release-manager (Molecule AI · release-manager) sdk-dev (Molecule AI · sdk-dev) sdk-lead (Molecule AI · sdk-lead) sop-drift-bot sop-tier-bot (SOP Tier-Check Bot) technical-writer (Molecule AI · technical-writer) triage-operator (Molecule AI · triage-operator)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#1374
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?