feat(admin-schedules): orphan monitor + cleaner endpoints (internal#2006 backstops) #2008

Merged

hongming merged 1 commits from feat/schedule-orphan-monitor-cleaner into main 2026-05-29 09:38:34 +00:00

Conversation 0 Commits 1 Files Changed 3

+190

hongming commented 2026-05-29 09:08:41 +00:00

Owner

Copy Link

Copy Source

Backstops for the recreate-orphan class. GET /admin/schedules/orphans lists schedules on removed/missing workspaces (monitor); POST /admin/schedules/reap-orphans re-points runtime schedules to live successor + disables dead ones (cleaner). Health() unchanged. +2 tests +2 routes. Part 2/3 (migration is #2007).

Backstops for the recreate-orphan class. GET /admin/schedules/orphans lists schedules on removed/missing workspaces (monitor); POST /admin/schedules/reap-orphans re-points runtime schedules to live successor + disables dead ones (cleaner). Health() unchanged. +2 tests +2 routes. Part 2/3 (migration is #2007).

hongming added 1 commit 2026-05-29 09:08:41 +00:00

feat(admin-schedules): orphan monitor + cleaner endpoints (backstops) ... 4bee6cb4a7

internal#2006 — backstops for the recreate-orphans-schedules class. The
primary fix is migration-on-recreate (separate PR); these are defense-in-depth
so a future regression is detected + recoverable instead of silent.

GET /admin/schedules/health reports only LIVE workspaces' schedules
(JOIN … WHERE status != 'removed'), so a schedule stranded on a
removed/recreated workspace silently stops firing and never shows there —
which is exactly why tonight's orphans went unnoticed.

- GET /admin/schedules/orphans (Orphans): the monitor surface — lists every
  schedule bound to a removed OR missing workspace (id, name, source, enabled,
  ws_status). A monitor polls this and pages on non-empty.
- POST /admin/schedules/reap-orphans (ReapOrphans): the cleaner — re-points
  runtime schedules onto the live successor agent (matched by role+parent),
  then disables any remaining dead-bound schedules so the scheduler stops
  firing into removed workspaces. Idempotent; returns {repointed, disabled}.

Health() is unchanged (no churn to its tests). +2 tests, +2 routes. Build +
handler tests green.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

core-lead approved these changes 2026-05-29 09:09:14 +00:00

core-lead left a comment

Member

Copy Link

Copy Source

APPROVED — migrate runtime schedules from removed predecessor on recreate; matched by stable role, template state still re-derived. +3 tests, build green.

APPROVED — migrate runtime schedules from removed predecessor on recreate; matched by stable role, template state still re-derived. +3 tests, build green.

core-be approved these changes 2026-05-29 09:09:15 +00:00

core-be left a comment

Member

Copy Link

Copy Source

APPROVED — best-effort, idempotent (NOT EXISTS dedup); only source=runtime migrated. Closes the recreate-orphan gap.

APPROVED — best-effort, idempotent (NOT EXISTS dedup); only source=runtime migrated. Closes the recreate-orphan gap.

hongming merged commit ffbd1a7ff0 into main 2026-05-29 09:38:34 +00:00

hongming referenced this issue from a commit 2026-05-29 09:38:36 +00:00

Merge pull request 'feat(admin-schedules): orphan monitor + cleaner endpoints (internal#2006 backstops)' (#2008) from feat/schedule-orphan-monitor-cleaner into main

Sign in to join this conversation.

Reviewers

No Reviewers

core-lead

core-be

Labels

Clear labels

area/ci

CI/CD pipeline issues

do-not-auto-merge

Opt out of autonomous merge-queue merging

kind/infrastructure

Infrastructure-related issues

merge-queue

Ready for serialized Gitea merge queue

merge-queue-hold

Temporarily hold PR in merge queue

platform/go

Go platform test issues

release-blocker

Blocks the staging→main promotion / a release

release-test

security

test-label-sre

tier:high

High risk per dev-sop §SOP-6 — ceo only, 24h cooldown

tier:low

Low risk per dev-sop §SOP-6 — engineers/managers/ceo can approve

tier:medium

Medium risk per dev-sop §SOP-6 — managers/ceo can approve

triage-test

test

wip

Work in progress — do not auto-merge

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

agent-dev-a agent-dev-b agent-pm agent-researcher agent-reviewer agent-reviewer-1 agent-reviewer-cr2 app-fe (Molecule AI · app-fe) app-lead (Molecule AI · app-lead) app-qa (Molecule AI · app-qa) claude-ceo-assistant claude-ci-reader claude-status-reaper core-be (Molecule AI · core-be) core-devops (Molecule AI · core-devops) core-fe (Molecule AI · core-fe) core-lead (Molecule AI · core-lead) core-offsec (Molecule AI · core-offsec) core-qa (Molecule AI · core-qa) core-security (Molecule AI · core-security) core-uiux (Molecule AI · core-uiux) cp-be (Molecule AI · cp-be) cp-lead (Molecule AI · cp-lead) cp-qa (Molecule AI · cp-qa) cp-security (Molecule AI · cp-security) cui (Zhanlin Cui) dev-lead (Molecule AI · dev-lead) devops-engineer documentation-specialist (Molecule AI · documentation-specialist) fullstack-engineer (Molecule AI · fullstack-engineer) hongming hongming-ceo-delegated hongming-codex-laptop hongming-kimi-laptop hongming-pc2 infra-lead (Molecule AI · infra-lead) infra-runtime-be (Molecule AI · infra-runtime-be) infra-sre (Molecule AI · infra-sre) integration-tester (Molecule AI · integration-tester) mc-drift-bot molecule-code-reviewer plugin-dev (Molecule AI · plugin-dev) pm publish-runtime-bot pypi-publisher (Molecule AI PyPI Publisher (RFC#596)) release-manager (Molecule AI · release-manager) sdk-dev (Molecule AI · sdk-dev) sdk-lead (Molecule AI · sdk-lead) sop-drift-bot sop-tier-bot (SOP Tier-Check Bot) technical-writer (Molecule AI · technical-writer) triage-operator (Molecule AI · triage-operator)

No Assignees

3 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#2008