molecule-ai/molecule-core
49
0
Fork 2
Code Issues 145 Pull Requests 157 Actions 5 Packages Projects Releases Wiki Activity

canvas chat messages stop appearing in target workspace activity_logs — channel push silently breaks #1674

New Issue
Closed
opened 2026-05-22 06:00:44 +00:00 by cp-be · 0 comments
cp-be commented 2026-05-22 06:00:44 +00:00
Member
Copy Link
Copy Source

Symptom

User typed canvas messages addressed to CEO Assistant (workspace 30ba7f0b) at ~05:33Z UTC on 2026-05-22. None reached the bound Claude Code session via channel plugin poll path. Earlier canvas messages from same user (e.g. 4e623e5f at 02:43:50Z) did arrive. Regression appeared between those timestamps.

Root cause (confirmed)

The target workspace's activity_logs has NO row for the recent canvas sends. Hitting the platform feed directly: most recent inbound (non-notify) is 4e623e5f at 02:43:50Z — anything after is missing. The bot polls correctly. It cannot deliver what the table doesn't contain.

Peer-agent A2A from PM still arrives fine — the regression is canvas-specific.

Likely cause

Missing rows all originate from source_id 344a2623 (the canvas user's identity workspace per RFC#637). Earlier rows from same source landed; regression appeared between batches. Suspects:

  1. logA2AReceiveQueued (a2a_proxy_helpers.go:567) skipped for canvas-user callers — some condition suppresses the activity write.
  2. Canvas FE switched from POST /workspaces/:id/a2a to a new chat endpoint that doesn't write activity_logs.
  3. proxyA2ARequest returns 4xx early for canvas-user callers, silently — UI still shows bubble but row never lands.

Reproduction

  1. SaaS tenant with one external/poll-mode workspace.
  2. Type and send canvas message.
  3. Query GET /workspaces/:id/activity with workspace bearer.
  4. Expected: new a2a_receive | message/send row with source_id = canvas-user-ws.
  5. Actual: no row.

Reno-Stars / Hongming's tenant 30ba7f0b reproduces empirically.

Test coverage required (CTO 2026-05-22)

  • E2E: POST /workspaces/:id/a2a with canvas-user-shaped callerID (UUID, not empty), assert a2a_receive | message/send row in /workspaces/:id/activity within 5s with source_id matching.
  • Unit (sqlmock): pin logA2AReceiveQueued INSERT synchronous before 200.
  • Hit production /workspaces/:id/a2a route per feedback_no_dev_only_routes_in_e2e.

Impact

  • Canvas chat silently broken for poll-mode workspaces (= Hongming's entire tenant). User types, sees bubble, bound CC session never receives.
  • chat-history on canvas reopen also broken (history reads activity_logs).
  • Peer-agent A2A unaffected (PM relay works during same window).

Related

  • internal#471 logA2AReceiveQueued must be synchronous
  • internal#1347 push-mode sibling data-loss class
  • RFC#637 canvas-user identity capture
  • feedback_no_dev_only_routes_in_e2e

Generated with Claude Code.

## Symptom User typed canvas messages addressed to CEO Assistant (workspace 30ba7f0b) at ~05:33Z UTC on 2026-05-22. None reached the bound Claude Code session via channel plugin poll path. Earlier canvas messages from same user (e.g. 4e623e5f at 02:43:50Z) did arrive. Regression appeared between those timestamps. ## Root cause (confirmed) The target workspace's activity_logs has NO row for the recent canvas sends. Hitting the platform feed directly: most recent inbound (non-notify) is 4e623e5f at 02:43:50Z — anything after is missing. The bot polls correctly. It cannot deliver what the table doesn't contain. Peer-agent A2A from PM still arrives fine — the regression is canvas-specific. ## Likely cause Missing rows all originate from source_id 344a2623 (the canvas user's identity workspace per RFC#637). Earlier rows from same source landed; regression appeared between batches. Suspects: 1. `logA2AReceiveQueued` (a2a_proxy_helpers.go:567) skipped for canvas-user callers — some condition suppresses the activity write. 2. Canvas FE switched from POST /workspaces/:id/a2a to a new chat endpoint that doesn't write activity_logs. 3. proxyA2ARequest returns 4xx early for canvas-user callers, silently — UI still shows bubble but row never lands. ## Reproduction 1. SaaS tenant with one external/poll-mode workspace. 2. Type and send canvas message. 3. Query GET /workspaces/:id/activity with workspace bearer. 4. Expected: new a2a_receive | message/send row with source_id = canvas-user-ws. 5. Actual: no row. Reno-Stars / Hongming's tenant 30ba7f0b reproduces empirically. ## Test coverage required (CTO 2026-05-22) - E2E: POST /workspaces/:id/a2a with canvas-user-shaped callerID (UUID, not empty), assert a2a_receive | message/send row in /workspaces/:id/activity within 5s with source_id matching. - Unit (sqlmock): pin logA2AReceiveQueued INSERT synchronous before 200. - Hit production /workspaces/:id/a2a route per feedback_no_dev_only_routes_in_e2e. ## Impact - Canvas chat silently broken for poll-mode workspaces (= Hongming's entire tenant). User types, sees bubble, bound CC session never receives. - chat-history on canvas reopen also broken (history reads activity_logs). - Peer-agent A2A unaffected (PM relay works during same window). ## Related - internal#471 logA2AReceiveQueued must be synchronous - internal#1347 push-mode sibling data-loss class - RFC#637 canvas-user identity capture - feedback_no_dev_only_routes_in_e2e Generated with Claude Code.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
area/ci
CI/CD pipeline issues
 kind/infrastructure
Infrastructure-related issues
 merge-queue
Ready for serialized Gitea merge queue
 merge-queue-hold
Temporarily hold PR in merge queue
 platform/go
Go platform test issues
 release-blocker
Blocks the staging→main promotion / a release
 release-test
security
test-label-sre
tier:high
High risk per dev-sop §SOP-6 — ceo only, 24h cooldown
 tier:low
Low risk per dev-sop §SOP-6 — engineers/managers/ceo can approve
 tier:medium
Medium risk per dev-sop §SOP-6 — managers/ceo can approve
 triage-test
test
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
agent-dev-a agent-dev-b agent-pm agent-researcher agent-reviewer app-fe (Molecule AI · app-fe) app-lead (Molecule AI · app-lead) app-qa (Molecule AI · app-qa) claude-ceo-assistant claude-ci-reader claude-status-reaper core-be (Molecule AI · core-be) core-devops (Molecule AI · core-devops) core-fe (Molecule AI · core-fe) core-lead (Molecule AI · core-lead) core-offsec (Molecule AI · core-offsec) core-qa (Molecule AI · core-qa) core-security (Molecule AI · core-security) core-uiux (Molecule AI · core-uiux) cp-be (Molecule AI · cp-be) cp-lead (Molecule AI · cp-lead) cp-qa (Molecule AI · cp-qa) cp-security (Molecule AI · cp-security) cui (Zhanlin Cui) dev-lead (Molecule AI · dev-lead) devops-engineer documentation-specialist (Molecule AI · documentation-specialist) fullstack-engineer (Molecule AI · fullstack-engineer) hongming hongming-ceo-delegated hongming-codex-laptop hongming-kimi-laptop hongming-pc2 infra-lead (Molecule AI · infra-lead) infra-runtime-be (Molecule AI · infra-runtime-be) infra-sre (Molecule AI · infra-sre) integration-tester (Molecule AI · integration-tester) mc-drift-bot molecule-code-reviewer plugin-dev (Molecule AI · plugin-dev) pm publish-runtime-bot pypi-publisher (Molecule AI PyPI Publisher (RFC#596)) release-manager (Molecule AI · release-manager) sdk-dev (Molecule AI · sdk-dev) sdk-lead (Molecule AI · sdk-lead) sop-drift-bot sop-tier-bot (SOP Tier-Check Bot) technical-writer (Molecule AI · technical-writer) triage-operator (Molecule AI · triage-operator)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#1674
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?