molecule-ai/molecule-core
52
0
Fork 2
Code Issues 184 Pull Requests 14 Actions 2 Packages Projects Releases Wiki Activity

Canary failing: staging SaaS smoke #1997

New Issue
Closed
opened 2026-05-28 20:36:12 +00:00 by gitea-actions · 163 comments
gitea-actions bot commented 2026-05-28 20:36:12 +00:00
Copy Link
Copy Source

Smoke run failed at 2026-05-28T20:36:12Z.

Run: https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148025

This issue auto-closes on the next green smoke run. Consecutive failures add a comment here rather than a new issue.

Smoke run failed at 2026-05-28T20:36:12Z. Run: https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148025 This issue auto-closes on the next green smoke run. Consecutive failures add a comment here rather than a new issue.
gitea-actions bot commented 2026-05-28 21:04:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148175

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148175
gitea-actions bot commented 2026-05-28 21:34:37 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148330

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148330
gitea-actions bot commented 2026-05-28 22:07:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148542

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148542
gitea-actions bot commented 2026-05-28 22:34:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148698

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148698
gitea-actions bot commented 2026-05-28 23:04:39 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148864

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/148864
gitea-actions bot commented 2026-05-28 23:34:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149032

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149032
gitea-actions bot commented 2026-05-29 00:04:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149204

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149204
gitea-actions bot commented 2026-05-29 00:39:37 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149429

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149429
gitea-actions bot commented 2026-05-29 01:04:45 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149587

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149587
gitea-actions bot commented 2026-05-29 01:34:22 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149746

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149746
gitea-actions bot commented 2026-05-29 02:06:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149899

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/149899
gitea-actions bot commented 2026-05-29 02:52:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150107

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150107
gitea-actions bot commented 2026-05-29 03:06:00 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150269

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150269
gitea-actions bot commented 2026-05-29 03:36:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150432

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150432
gitea-actions bot commented 2026-05-29 04:05:10 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150586

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/150586
gitea-actions bot commented 2026-05-30 00:02:35 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/157300

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/157300
gitea-actions bot commented 2026-05-30 00:32:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/157468

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/157468
hongming commented 2026-05-30 22:14:48 +00:00
Owner
Copy Link
Copy Source

needs-hongming hourly CI/security triage evidence (2026-05-30 15:10 PDT / 22:10 UTC)

Fresh current-head evidence for molecule-core/main@5fce77aac9:

  • Latest per-context status counts from Gitea commit-status API: failure=1, pending=3, success=35.
  • Log-backed failure 1: Continuous synthetic E2E run 99508 job 0 reached tenant provisioning, then timed out waiting for TLS/DNS. Diagnostic showed no DNS resolution for e2e-20260530-synth-164223.staging.moleculesai.app; teardown was accepted and AWS leak check found no live EC2 for the slug.
  • Log-backed failure 2: full-lifecycle E2E run 99468 job 1 reached tenant URL and provisioned parent/child workspaces, then parent workspace 259a9f4b-c380-4673-b887-a70289794482 moved to failed at 19:15:14Z and did not recover before teardown. AWS leak check was clean.
  • Secret/security contexts sampled at this head are green where completed: Secret scan success, forbidden tenant-env lint success, ci-required-drift success.

Impact: staging SaaS/canary coverage is currently red for both tenant DNS readiness and workspace bootstrap/recovery paths, so this is not just a stale status row. Please decide whether this should be owned under the controlplane tenant-DNS/provisioning queue or the workspace bootstrap watcher queue; I did not rerun workflows, mutate branch protection, rotate secrets, merge, force-push, or push to main.

needs-hongming hourly CI/security triage evidence (2026-05-30 15:10 PDT / 22:10 UTC) Fresh current-head evidence for molecule-core/main@5fce77aac914faf67681f8f5d712d0ef2ad26258: - Latest per-context status counts from Gitea commit-status API: failure=1, pending=3, success=35. - Log-backed failure 1: Continuous synthetic E2E run 99508 job 0 reached tenant provisioning, then timed out waiting for TLS/DNS. Diagnostic showed no DNS resolution for e2e-20260530-synth-164223.staging.moleculesai.app; teardown was accepted and AWS leak check found no live EC2 for the slug. - Log-backed failure 2: full-lifecycle E2E run 99468 job 1 reached tenant URL and provisioned parent/child workspaces, then parent workspace 259a9f4b-c380-4673-b887-a70289794482 moved to failed at 19:15:14Z and did not recover before teardown. AWS leak check was clean. - Secret/security contexts sampled at this head are green where completed: Secret scan success, forbidden tenant-env lint success, ci-required-drift success. Impact: staging SaaS/canary coverage is currently red for both tenant DNS readiness and workspace bootstrap/recovery paths, so this is not just a stale status row. Please decide whether this should be owned under the controlplane tenant-DNS/provisioning queue or the workspace bootstrap watcher queue; I did not rerun workflows, mutate branch protection, rotate secrets, merge, force-push, or push to main.
hongming commented 2026-05-30 23:12:37 +00:00
Owner
Copy Link
Copy Source

needs-hongming hourly CI/security triage evidence (2026-05-30 16:10 PDT / 23:10 UTC)

Fresh current-head evidence for molecule-core/main@5fce77aac9:

  • Robust latest-per-context status calculation currently has no latest failure/error rows, but 4 latest pending contexts: Continuous synthetic E2E, full-lifecycle E2E, staging SaaS smoke, and ci-arm64-advisory.
  • Direct logs show the live/pending E2E surfaces are still unhealthy and are converging on the same workspace bootstrap failure class:
    • Continuous synthetic E2E run 99517/job0: tenant reached DNS/TLS and parent workspace 3d181108-788d-4e49-8019-8b6ebe8274d6 moved provisioning -> failed at 21:46:47Z, then waited for bootstrap-watcher recovery.
    • Staging SaaS smoke run 99479/job0: tenant reached DNS/TLS and parent workspace aa8bb479-568d-473a-9c27-1e39b6fd06ab moved provisioning -> failed at 19:16:09Z, then waited for bootstrap-watcher recovery.
    • Full-lifecycle rerun 99468/job1: tenant reached DNS/TLS and parent workspace c747f572-0528-4e9f-9940-b2e30b04d5d4 moved provisioning -> failed at 23:11:09Z, then waited for bootstrap-watcher recovery.
  • This updates the prior hour's evidence: the DNS timeout class was not reproduced in these newer runs; the current repeating failure is workspace bootstrap/recovery.
  • OBS/Loki query for workspace c747f572-0528-4e9f-9940-b2e30b04d5d4 was attempted but returned HTTP 403 from obs.moleculesai.app, so this comment uses retained Gitea logs as evidence.

Impact: staging canaries are not clean even when tenant DNS/TLS succeeds. Please route ownership to the bootstrap-watcher/workspace provisioning path (or confirm if this belongs under an existing cp#245 follow-up). I did not rerun workflows, mutate branch protection, rotate secrets, deploy, restart runners, merge, force-push, or push to main.

needs-hongming hourly CI/security triage evidence (2026-05-30 16:10 PDT / 23:10 UTC) Fresh current-head evidence for molecule-core/main@5fce77aac914faf67681f8f5d712d0ef2ad26258: - Robust latest-per-context status calculation currently has no latest failure/error rows, but 4 latest pending contexts: Continuous synthetic E2E, full-lifecycle E2E, staging SaaS smoke, and ci-arm64-advisory. - Direct logs show the live/pending E2E surfaces are still unhealthy and are converging on the same workspace bootstrap failure class: - Continuous synthetic E2E run 99517/job0: tenant reached DNS/TLS and parent workspace 3d181108-788d-4e49-8019-8b6ebe8274d6 moved provisioning -> failed at 21:46:47Z, then waited for bootstrap-watcher recovery. - Staging SaaS smoke run 99479/job0: tenant reached DNS/TLS and parent workspace aa8bb479-568d-473a-9c27-1e39b6fd06ab moved provisioning -> failed at 19:16:09Z, then waited for bootstrap-watcher recovery. - Full-lifecycle rerun 99468/job1: tenant reached DNS/TLS and parent workspace c747f572-0528-4e9f-9940-b2e30b04d5d4 moved provisioning -> failed at 23:11:09Z, then waited for bootstrap-watcher recovery. - This updates the prior hour's evidence: the DNS timeout class was not reproduced in these newer runs; the current repeating failure is workspace bootstrap/recovery. - OBS/Loki query for workspace c747f572-0528-4e9f-9940-b2e30b04d5d4 was attempted but returned HTTP 403 from obs.moleculesai.app, so this comment uses retained Gitea logs as evidence. Impact: staging canaries are not clean even when tenant DNS/TLS succeeds. Please route ownership to the bootstrap-watcher/workspace provisioning path (or confirm if this belongs under an existing cp#245 follow-up). I did not rerun workflows, mutate branch protection, rotate secrets, deploy, restart runners, merge, force-push, or push to main.
devops-engineer commented 2026-05-31 00:15:53 +00:00
Member
Copy Link
Copy Source

17:10 PDT heartbeat re-check with fresh Gitea status/log evidence:

  • molecule-core/main@5fce77aac9 latest statuses: no failure/error, but 4 contexts still report pending.
  • Fresh full lifecycle run 99468/job/1 started at 2026-05-31T00:13Z and is actively running; log reached tenant provisioning (status -> provisioning) after CP/secret preflights passed.
  • Older continuous synthetic run 99517/job/0 got tenant running/TLS OK, created parent+child workspaces, then parent workspace moved provisioning -> failed at 21:46Z and entered heartbeat-recovery wait.
  • Older 30-minute smoke run 99479/job/0 got tenant running/TLS OK, created parent workspace, then parent workspace moved provisioning -> failed at 19:16Z and entered heartbeat-recovery wait.
  • ci-arm64-advisory run 99462/job/0 is still queued/not started (job is not started).

So the current head is not red, but the stale/pending SaaS contexts are still backed by real workspace bootstrap/recovery failures plus queue lag. No secret values were printed; evidence came from token-authenticated Gitea logs.

17:10 PDT heartbeat re-check with fresh Gitea status/log evidence: - `molecule-core/main@5fce77aac9` latest statuses: no `failure`/`error`, but 4 contexts still report `pending`. - Fresh full lifecycle run `99468/job/1` started at 2026-05-31T00:13Z and is actively running; log reached tenant provisioning (`status -> provisioning`) after CP/secret preflights passed. - Older continuous synthetic run `99517/job/0` got tenant running/TLS OK, created parent+child workspaces, then parent workspace moved `provisioning -> failed` at 21:46Z and entered heartbeat-recovery wait. - Older 30-minute smoke run `99479/job/0` got tenant running/TLS OK, created parent workspace, then parent workspace moved `provisioning -> failed` at 19:16Z and entered heartbeat-recovery wait. - `ci-arm64-advisory` run `99462/job/0` is still queued/not started (`job is not started`). So the current head is not red, but the stale/pending SaaS contexts are still backed by real workspace bootstrap/recovery failures plus queue lag. No secret values were printed; evidence came from token-authenticated Gitea logs.
gitea-actions bot commented 2026-05-31 00:37:13 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165292

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165292
gitea-actions bot commented 2026-05-31 01:04:24 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165458

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165458
devops-engineer commented 2026-05-31 01:12:36 +00:00
Member
Copy Link
Copy Source

18:10 PDT heartbeat re-check with fresh status/log evidence:

  • molecule-core/main@5fce77aac9 latest-per-context is now red again: E2E Staging SaaS (full lifecycle) / E2E Staging SaaS (push) failed in run 99468/job/1 at 2026-05-31T00:18:15Z.
  • This is a different terminal point than the earlier bootstrap-watcher failures:
    • CP reachable, staging tenant provisioned and TLS/DNS worked.
    • Parent and child workspaces both reached online and were routable.
    • Image upload/download, canvas-terminal diagnose, files API config.yaml PUT, and post-PUT routing recovery all passed.
    • Failure occurred at step 8/11 Sending A2A message to parent: A2A returned an error-shaped response: Error: message contained no text content.
    • Teardown was accepted and AWS leak check reported no live EC2 instances for slug e2e-20260531-163572-4.
  • Remaining stale/pending context: ci-arm64-advisory / fast-checks (push) is still queued/not started from run 99462/job/0.

Security/secret posture around this run: latest secret-token scans remain green (Secret scan, Lint no tenant GITEA or GITHUB token write, and Sweep stale AWS Secrets Manager secrets all succeeded). No secret values were printed.

18:10 PDT heartbeat re-check with fresh status/log evidence: - `molecule-core/main@5fce77aac9` latest-per-context is now red again: `E2E Staging SaaS (full lifecycle) / E2E Staging SaaS (push)` failed in run `99468/job/1` at 2026-05-31T00:18:15Z. - This is a different terminal point than the earlier bootstrap-watcher failures: - CP reachable, staging tenant provisioned and TLS/DNS worked. - Parent and child workspaces both reached `online` and were routable. - Image upload/download, canvas-terminal diagnose, files API `config.yaml` PUT, and post-PUT routing recovery all passed. - Failure occurred at step `8/11 Sending A2A message to parent`: `A2A returned an error-shaped response: Error: message contained no text content.` - Teardown was accepted and AWS leak check reported no live EC2 instances for slug `e2e-20260531-163572-4`. - Remaining stale/pending context: `ci-arm64-advisory / fast-checks (push)` is still queued/not started from run `99462/job/0`. Security/secret posture around this run: latest secret-token scans remain green (`Secret scan`, `Lint no tenant GITEA or GITHUB token write`, and `Sweep stale AWS Secrets Manager secrets` all succeeded). No secret values were printed.
gitea-actions bot commented 2026-05-31 01:34:13 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165615

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165615
gitea-actions bot commented 2026-05-31 02:04:42 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165775

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165775
gitea-actions bot commented 2026-05-31 02:35:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165946

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/165946
gitea-actions bot commented 2026-05-31 03:05:59 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166096

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166096
gitea-actions bot commented 2026-05-31 03:34:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166251

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166251
gitea-actions bot commented 2026-05-31 04:04:24 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166402

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166402
gitea-actions bot commented 2026-05-31 04:34:22 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166558

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166558
gitea-actions bot commented 2026-05-31 05:04:01 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166713

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166713
gitea-actions bot commented 2026-05-31 05:34:24 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166871

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/166871
gitea-actions bot commented 2026-05-31 06:04:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/167022

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/167022
gitea-actions bot commented 2026-05-31 08:36:15 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/167831

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/167831
gitea-actions bot commented 2026-05-31 09:05:29 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168028

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168028
gitea-actions bot commented 2026-05-31 09:45:04 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168333

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168333
gitea-actions bot commented 2026-05-31 10:04:52 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168506

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168506
gitea-actions bot commented 2026-05-31 10:34:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168674

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168674
gitea-actions bot commented 2026-05-31 11:04:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168831

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168831
gitea-actions bot commented 2026-05-31 11:34:31 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168986

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/168986
gitea-actions bot commented 2026-05-31 12:07:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169137

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169137
gitea-actions bot commented 2026-05-31 12:34:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169292

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169292
gitea-actions bot commented 2026-05-31 13:04:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169442

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169442
gitea-actions bot commented 2026-05-31 13:34:34 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169599

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169599
gitea-actions bot commented 2026-05-31 14:04:57 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169750

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169750
gitea-actions bot commented 2026-05-31 14:37:36 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169905

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/169905
gitea-actions bot commented 2026-05-31 15:06:05 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170055

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170055
gitea-actions bot commented 2026-05-31 15:34:37 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170210

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170210
gitea-actions bot commented 2026-05-31 16:06:41 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170360

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170360
gitea-actions bot commented 2026-05-31 16:36:50 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170515

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170515
gitea-actions bot commented 2026-05-31 17:04:57 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170665

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170665
gitea-actions bot commented 2026-05-31 17:36:03 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170820

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170820
gitea-actions bot commented 2026-05-31 18:04:30 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170971

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/170971
gitea-actions bot commented 2026-05-31 18:34:15 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171127

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171127
gitea-actions bot commented 2026-05-31 19:05:27 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171283

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171283
gitea-actions bot commented 2026-05-31 19:34:11 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171441

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171441
gitea-actions bot commented 2026-05-31 20:04:35 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171652

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171652
gitea-actions bot commented 2026-05-31 20:34:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171807

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171807
gitea-actions bot commented 2026-05-31 21:09:06 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171969

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/171969
gitea-actions bot commented 2026-05-31 21:35:04 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172132

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172132
gitea-actions bot commented 2026-05-31 22:04:43 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172282

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172282
gitea-actions bot commented 2026-05-31 22:34:15 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172437

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172437
gitea-actions bot commented 2026-05-31 23:04:33 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172587

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172587
gitea-actions bot commented 2026-05-31 23:34:43 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172800

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172800
gitea-actions bot commented 2026-06-01 00:05:03 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172970

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/172970
gitea-actions bot commented 2026-06-01 00:34:30 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173143

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173143
gitea-actions bot commented 2026-06-01 01:04:11 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173303

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173303
gitea-actions bot commented 2026-06-01 01:34:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173466

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173466
gitea-actions bot commented 2026-06-01 02:19:10 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173654

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173654
gitea-actions bot commented 2026-06-01 02:34:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173812

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173812
gitea-actions bot commented 2026-06-01 03:04:36 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173965

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/173965
gitea-actions bot commented 2026-06-01 03:34:24 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/174160

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/174160
gitea-actions bot commented 2026-06-01 08:46:47 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/177946

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/177946
gitea-actions bot commented 2026-06-01 09:04:29 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178098

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178098
gitea-actions bot commented 2026-06-01 09:35:28 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178277

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178277
gitea-actions bot commented 2026-06-01 10:04:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178532

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178532
gitea-actions bot commented 2026-06-01 10:34:31 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178706

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178706
gitea-actions bot commented 2026-06-01 11:04:42 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178876

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/178876
gitea-actions bot commented 2026-06-01 11:35:09 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/179056

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/179056
gitea-actions bot commented 2026-06-01 12:04:53 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/179286

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/179286
gitea-actions bot commented 2026-06-01 12:38:58 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/179456

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/179456
gitea-actions bot commented 2026-06-01 15:44:26 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/180770

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/180770
gitea-actions bot commented 2026-06-01 16:05:11 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181040

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181040
gitea-actions bot commented 2026-06-01 16:34:08 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181241

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181241
gitea-actions bot commented 2026-06-01 17:05:44 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181474

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181474
gitea-actions bot commented 2026-06-01 17:34:54 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181637

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181637
gitea-actions bot commented 2026-06-01 18:04:09 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181789

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/181789
gitea-actions bot commented 2026-06-01 18:34:49 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182009

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182009
gitea-actions bot commented 2026-06-01 19:04:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182209

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182209
gitea-actions bot commented 2026-06-01 19:35:30 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182439

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182439
gitea-actions bot commented 2026-06-01 20:05:41 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182589

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182589
gitea-actions bot commented 2026-06-01 20:35:00 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182796

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182796
gitea-actions bot commented 2026-06-01 21:06:13 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182969

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/182969
gitea-actions bot commented 2026-06-01 21:34:14 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/183130

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/183130
gitea-actions bot commented 2026-06-01 22:02:42 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/183304

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/183304
gitea-actions bot commented 2026-06-01 22:34:59 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/183463

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/183463
gitea-actions bot commented 2026-06-03 01:04:39 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194157

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194157
gitea-actions bot commented 2026-06-03 01:34:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194382

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194382
gitea-actions bot commented 2026-06-03 02:04:39 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194559

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194559
gitea-actions bot commented 2026-06-03 02:34:22 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194774

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194774
gitea-actions bot commented 2026-06-03 03:07:13 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194988

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/194988
gitea-actions bot commented 2026-06-03 03:34:15 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195151

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195151
gitea-actions bot commented 2026-06-03 04:04:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195313

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195313
gitea-actions bot commented 2026-06-03 04:34:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195486

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195486
gitea-actions bot commented 2026-06-03 05:04:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195682

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195682
gitea-actions bot commented 2026-06-03 05:34:05 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195856

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/195856
gitea-actions bot commented 2026-06-03 06:04:59 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196054

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196054
gitea-actions bot commented 2026-06-03 06:35:27 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196343

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196343
gitea-actions bot commented 2026-06-03 07:06:53 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196546

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196546
gitea-actions bot commented 2026-06-03 07:34:40 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196785

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196785
gitea-actions bot commented 2026-06-03 08:04:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196959

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/196959
gitea-actions bot commented 2026-06-03 08:34:54 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197160

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197160
gitea-actions bot commented 2026-06-03 09:05:48 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197349

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197349
gitea-actions bot commented 2026-06-03 09:36:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197568

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197568
gitea-actions bot commented 2026-06-03 10:04:36 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197729

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197729
gitea-actions bot commented 2026-06-03 10:34:02 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197926

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/197926
gitea-actions bot commented 2026-06-03 11:05:38 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198153

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198153
gitea-actions bot commented 2026-06-03 11:37:42 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198373

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198373
gitea-actions bot commented 2026-06-03 12:06:10 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198593

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198593
gitea-actions bot commented 2026-06-03 12:36:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198817

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/198817
gitea-actions bot commented 2026-06-03 13:06:32 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199026

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199026
gitea-actions bot commented 2026-06-03 13:34:38 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199259

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199259
gitea-actions bot commented 2026-06-03 14:05:45 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199490

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199490
gitea-actions bot commented 2026-06-03 15:34:26 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199709

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/199709
gitea-actions bot commented 2026-06-03 15:41:52 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200041

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200041
gitea-actions bot commented 2026-06-03 16:08:31 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200197

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200197
gitea-actions bot commented 2026-06-03 16:34:36 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200359

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200359
gitea-actions bot commented 2026-06-03 18:03:50 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200547

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200547
gitea-actions bot commented 2026-06-03 18:08:51 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200882

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/200882
gitea-actions bot commented 2026-06-03 18:34:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201055

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201055
gitea-actions bot commented 2026-06-03 19:04:37 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201226

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201226
gitea-actions bot commented 2026-06-03 19:35:36 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201461

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201461
gitea-actions bot commented 2026-06-03 20:04:54 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201676

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201676
gitea-actions bot commented 2026-06-03 20:34:29 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201887

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/201887
gitea-actions bot commented 2026-06-03 21:04:39 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202125

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202125
gitea-actions bot commented 2026-06-03 21:34:36 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202334

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202334
gitea-actions bot commented 2026-06-03 22:04:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202615

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202615
gitea-actions bot commented 2026-06-03 22:34:05 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202895

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/202895
gitea-actions bot commented 2026-06-03 23:04:12 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203118

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203118
gitea-actions bot commented 2026-06-03 23:34:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203340

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203340
gitea-actions bot commented 2026-06-04 00:06:19 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203590

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203590
gitea-actions bot commented 2026-06-04 00:34:26 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203798

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/203798
gitea-actions bot commented 2026-06-04 01:05:03 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/204088

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/204088
gitea-actions bot commented 2026-06-04 01:34:27 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/204520

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/204520
gitea-actions bot commented 2026-06-04 02:04:11 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/204784

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/204784
gitea-actions bot commented 2026-06-04 02:34:16 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205054

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205054
gitea-actions bot commented 2026-06-04 03:06:01 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205400

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205400
gitea-actions bot commented 2026-06-04 03:32:18 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205585

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205585
gitea-actions bot commented 2026-06-04 04:02:28 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205802

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/205802
gitea-actions bot commented 2026-06-04 04:33:31 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/206160

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/206160
gitea-actions bot commented 2026-06-04 05:02:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/206400

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/206400
gitea-actions bot commented 2026-06-04 05:32:26 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/206655

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/206655
gitea-actions bot commented 2026-06-04 06:02:25 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/207003

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/207003
gitea-actions bot commented 2026-06-04 06:32:17 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/207416

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/207416
gitea-actions bot commented 2026-06-04 07:32:20 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/207945

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/207945
molecule-code-reviewer commented 2026-06-04 07:40:16 +00:00
Member
Copy Link
Copy Source

MECHANISM: The current scheduled staging failures are now failing before the A2A empty-content path tracked in #2204. Both staging-smoke.yml and continuous-synth-e2e.yml pin the claude-code canary to E2E_MODEL_SLUG=MiniMax-M2 (.gitea/workflows/staging-smoke.yml:112-117, .gitea/workflows/continuous-synth-e2e.yml:130-136; full SaaS has the same fallback at .gitea/workflows/e2e-staging-saas.yml:175). tests/e2e/test_staging_full_saas.sh:412-418 sends that model in the parent /workspaces create payload; the tenant is reachable, secrets are present, then the POST returns HTTP 400 and exits because tenant_call uses curl -f.

EVIDENCE: smoke job 277091 on core main 376e6ab89abf reaches TENANT_URL=https://e2e-smoke-20260604-smoke-207945..., logs MODEL_SLUG=MiniMax-M2, then curl: (22) ... 400. synth job 277121 shows the same sequence for synth-207973. The secret checks passed (LLM key present, admin token evaluated as masked), so this is not a missing-token failure.

RECOMMENDED FIX SHAPE: In molecule-core, update the staging smoke/synth/full-SaaS workflow model defaults to a provider-registry-valid claude-code MiniMax slug, or have the harness resolve the model from the same runtime/provider registry used by workspace create. Also improve tenant_call error capture so future 400 responses include the JSON body instead of losing the server's validation reason behind curl -f.

MECHANISM: The current scheduled staging failures are now failing before the A2A empty-content path tracked in #2204. Both `staging-smoke.yml` and `continuous-synth-e2e.yml` pin the claude-code canary to `E2E_MODEL_SLUG=MiniMax-M2` (`.gitea/workflows/staging-smoke.yml:112-117`, `.gitea/workflows/continuous-synth-e2e.yml:130-136`; full SaaS has the same fallback at `.gitea/workflows/e2e-staging-saas.yml:175`). `tests/e2e/test_staging_full_saas.sh:412-418` sends that model in the parent `/workspaces` create payload; the tenant is reachable, secrets are present, then the POST returns HTTP 400 and exits because `tenant_call` uses `curl -f`. EVIDENCE: smoke job `277091` on core main `376e6ab89abf` reaches `TENANT_URL=https://e2e-smoke-20260604-smoke-207945...`, logs `MODEL_SLUG=MiniMax-M2`, then `curl: (22) ... 400`. synth job `277121` shows the same sequence for `synth-207973`. The secret checks passed (`LLM key present`, admin token evaluated as masked), so this is not a missing-token failure. RECOMMENDED FIX SHAPE: In `molecule-core`, update the staging smoke/synth/full-SaaS workflow model defaults to a provider-registry-valid claude-code MiniMax slug, or have the harness resolve the model from the same runtime/provider registry used by workspace create. Also improve `tenant_call` error capture so future 400 responses include the JSON body instead of losing the server's validation reason behind `curl -f`.
gitea-actions bot commented 2026-06-04 08:02:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208130

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208130
molecule-code-reviewer commented 2026-06-04 08:09:20 +00:00
Member
Copy Link
Copy Source

MECHANISM: Recurrence on runs 208130 and 208163 confirms the scheduled smoke/synth failure is still the same invalid canary model-default path. The workflows evaluate E2E_MODEL_SLUG=MiniMax-M2; tests/e2e/test_staging_full_saas.sh sends it in /workspaces, and staging returns HTTP 400 immediately after tenant/admin-token setup. This remains before the #2204 A2A empty-content stage.

EVIDENCE: smoke job 277299 and synth job 277336 both log tenant/admin-token success, MODEL_SLUG=MiniMax-M2, then curl: (22) ... 400. Secrets are present (LLM key present, admin token retrieved). Log excerpt: MODEL_SLUG=MiniMax-M2.

RECOMMENDED FIX SHAPE: Update the scheduled staging canary workflow defaults to a provider-registry-valid claude-code MiniMax slug or resolve from registry, and capture the 400 response body in tenant_call so future validation failures keep the server reason.

MECHANISM: Recurrence on runs `208130` and `208163` confirms the scheduled smoke/synth failure is still the same invalid canary model-default path. The workflows evaluate `E2E_MODEL_SLUG=MiniMax-M2`; `tests/e2e/test_staging_full_saas.sh` sends it in `/workspaces`, and staging returns HTTP 400 immediately after tenant/admin-token setup. This remains before the #2204 A2A empty-content stage. EVIDENCE: smoke job `277299` and synth job `277336` both log tenant/admin-token success, `MODEL_SLUG=MiniMax-M2`, then `curl: (22) ... 400`. Secrets are present (`LLM key present`, admin token retrieved). Log excerpt: `MODEL_SLUG=MiniMax-M2`. RECOMMENDED FIX SHAPE: Update the scheduled staging canary workflow defaults to a provider-registry-valid claude-code MiniMax slug or resolve from registry, and capture the 400 response body in `tenant_call` so future validation failures keep the server reason.
gitea-actions bot commented 2026-06-04 08:32:32 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208393

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208393
gitea-actions bot commented 2026-06-04 09:02:45 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208686

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208686
gitea-actions bot commented 2026-06-04 09:32:23 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208956

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/208956
gitea-actions bot commented 2026-06-04 10:02:22 +00:00
Copy Link
Copy Source

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/209200

Smoke still failing. https://git.moleculesai.app/molecule-ai/molecule-core/actions/runs/209200
core-be commented 2026-06-04 10:05:28 +00:00
Member
Copy Link
Copy Source

Fixed in PR !2240.

  • Updated canary default model slug from MiniMax-M2 to MiniMax-M2.7 in all workflow files and dispatch logic.
  • Updated regression tests and error messages to match the new default.
  • The next scheduled smoke/synth run should pick up the new slug and hopefully go green.
Fixed in PR !2240. - Updated canary default model slug from `MiniMax-M2` to `MiniMax-M2.7` in all workflow files and dispatch logic. - Updated regression tests and error messages to match the new default. - The next scheduled smoke/synth run should pick up the new slug and hopefully go green.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
approved
area/ci
CI/CD pipeline issues
 do-not-auto-merge
Opt out of autonomous merge-queue merging
 do-not-merge
hold from auto-merge (design review in progress)
 kind/infrastructure
Infrastructure-related issues
 merge-queue
Ready for serialized Gitea merge queue
 merge-queue-hold
Temporarily hold PR in merge queue
 needs-engineer
platform/go
Go platform test issues
 ready-to-build
release-blocker
Blocks the staging→main promotion / a release
 release-test
security
test-label-sre
tier:high
High risk per dev-sop §SOP-6 — ceo only, 24h cooldown
 tier:low
Low risk per dev-sop §SOP-6 — engineers/managers/ceo can approve
 tier:medium
Medium risk per dev-sop §SOP-6 — managers/ceo can approve
 triage-test
test
 wip
Work in progress — do not auto-merge
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
agent-dev-a agent-dev-b agent-pm agent-researcher agent-reviewer agent-reviewer-1 agent-reviewer-cr2 app-fe (Molecule AI · app-fe) app-lead (Molecule AI · app-lead) app-qa (Molecule AI · app-qa) claude-ceo-assistant claude-ci-reader core-be (Molecule AI · core-be) core-devops (Molecule AI · core-devops) core-fe (Molecule AI · core-fe) core-lead (Molecule AI · core-lead) core-offsec (Molecule AI · core-offsec) core-qa (Molecule AI · core-qa) core-security (Molecule AI · core-security) core-uiux (Molecule AI · core-uiux) cp-be (Molecule AI · cp-be) cp-lead (Molecule AI · cp-lead) cp-qa (Molecule AI · cp-qa) cp-security (Molecule AI · cp-security) cui (Zhanlin Cui) dev-lead (Molecule AI · dev-lead) devops-engineer documentation-specialist (Molecule AI · documentation-specialist) fullstack-engineer (Molecule AI · fullstack-engineer) godwin hongming hongming-ceo-delegated hongming-codex-laptop hongming-kimi-laptop hongming-pc2 hongming-personal infra-lead (Molecule AI · infra-lead) infra-runtime-be (Molecule AI · infra-runtime-be) infra-sre (Molecule AI · infra-sre) integration-tester (Molecule AI · integration-tester) mc-drift-bot molecule-code-reviewer plugin-dev (Molecule AI · plugin-dev) pm publish-runtime-bot pypi-publisher (Molecule AI PyPI Publisher (RFC#596)) release-manager (Molecule AI · release-manager) sdk-dev (Molecule AI · sdk-dev) sdk-lead (Molecule AI · sdk-lead) sop-drift-bot sop-tier-bot (SOP Tier-Check Bot) technical-writer (Molecule AI · technical-writer) triage-operator (Molecule AI · triage-operator)
No Assignees
5 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: molecule-ai/molecule-core#1997
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?