Merge-blocking e2e: assert concierge actually exposes + invokes create_workspace (real capability, not proxy) #3081

Open
opened 2026-06-19 21:06:39 +00:00 by core-devops · 0 comments
Member

Prevention for core#3079 — the highest-leverage guardrail.

Every check this session passed on a PROXY (plugin dir exists, settings.json has the entry, MCP launches when run by hand). Nobody asserted the real thing: does the agent actually have create_workspace in its loaded tools? The existing "E2E Staging Concierge Creates Workspace" job was red/flaky against a stale fleet and gated nothing.

Ask: strengthen that e2e to assert the REAL capability, and make it merge-blocking:

  1. Provision a fresh concierge.
  2. A2A it: assert it reports mcp__molecule-platform__create_workspace in its tool list (NOT a proxy).
  3. Have it actually invoke create_workspace and assert a workspace is created.
  4. Remove continue-on-error / promote to a required status check (mirrors #37 for template-delivery-e2e).
    This catches a break ANYWHERE in the chain (delivery, --strict load, auth), regardless of where the next regression hides.
**Prevention for core#3079** — the highest-leverage guardrail. Every check this session passed on a PROXY (plugin dir exists, settings.json has the entry, MCP launches when run by hand). Nobody asserted the real thing: **does the agent actually have `create_workspace` in its loaded tools?** The existing "E2E Staging Concierge Creates Workspace" job was red/flaky against a stale fleet and gated nothing. **Ask:** strengthen that e2e to assert the REAL capability, and make it merge-blocking: 1. Provision a fresh concierge. 2. A2A it: assert it reports `mcp__molecule-platform__create_workspace` in its tool list (NOT a proxy). 3. Have it actually invoke `create_workspace` and assert a workspace is created. 4. Remove continue-on-error / promote to a required status check (mirrors #37 for template-delivery-e2e). This catches a break ANYWHERE in the chain (delivery, --strict load, auth), regardless of where the next regression hides.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#3081