Files
molecule-core/canvas/playwright.config.ts
core-devops 10b7f8a99a
ci-arm64-advisory / fast-checks (pull_request) Waiting to run
Lint shellcheck (arm64 pilot) / shellcheck-arm64 (pilot) (pull_request) Successful in 2s
Block internal-flavored paths / Block forbidden paths (pull_request) Successful in 3s
CI / Python Lint & Test (pull_request) Successful in 3s
CI / Detect changes (pull_request) Successful in 7s
E2E API Smoke Test / detect-changes (pull_request) Successful in 5s
E2E Chat / detect-changes (pull_request) Successful in 5s
Handlers Postgres Integration / detect-changes (pull_request) Successful in 3s
Harness Replays / detect-changes (pull_request) Successful in 3s
Lint curl status-code capture / Scan workflows for curl status-capture pollution (pull_request) Successful in 2s
E2E Staging Canvas (Playwright) / detect-changes (pull_request) Successful in 6s
Lint forbidden tenant-env keys / Scan workspace_secrets writers for forbidden env keys (pull_request) Successful in 3s
Lint forbidden tenant-env keys / Scan for repo-host token write into tenant workspace surface (pull_request) Successful in 2s
lint-required-workflows-docker-host-pinned / Lint docker-host pin on docker-touching workflows (pull_request) Successful in 4s
gate-check-v3 / gate-check (pull_request_target) Successful in 3s
Secret scan / Scan diff for credential-shaped strings (pull_request) Successful in 6s
qa-review / approved (pull_request_target) Failing after 4s
sop-checklist / all-items-acked (pull_request) acked: 0/7 — missing: comprehensive-testing, local-postgres-e2e, staging-smoke, +4 — body-unfilled: comprehensive-testing, local-postgres-e2
sop-checklist / na-declarations (pull_request) N/A: (none)
sop-checklist / review-refire (pull_request_target) Has been skipped
sop-checklist / all-items-acked (pull_request_target) Successful in 3s
security-review / approved (pull_request_target) Failing after 7s
sop-tier-check / tier-check (pull_request_target) Successful in 6s
lint-continue-on-error-tracking / lint-continue-on-error-tracking (pull_request) Failing after 58s
lint-required-no-paths / lint-required-no-paths (pull_request) Successful in 55s
lint-required-context-exists-in-bp / lint-required-context-exists-in-bp (pull_request) Successful in 1m11s
Lint pre-flip continue-on-error / Verify continue-on-error flips have run-log proof (pull_request) Successful in 1m14s
Lint workflow YAML (Gitea-1.22.6-hostile shapes) / Lint workflow YAML for Gitea-1.22.6-hostile shapes (pull_request) Successful in 1m18s
CI / Platform (Go) (pull_request) Successful in 3s
E2E Chat / E2E Chat (pull_request) Successful in 2s
Handlers Postgres Integration / Handlers Postgres Integration (pull_request) Successful in 2s
Harness Replays / Harness Replays (pull_request) Successful in 1s
E2E Staging Canvas (Playwright) / Canvas tabs E2E (pull_request) Successful in 2s
CI / Shellcheck (E2E scripts) (pull_request) Successful in 18s
E2E API Smoke Test / E2E API Smoke Test (pull_request) Successful in 55s
E2E Staging External Runtime / E2E Staging External Runtime (pull_request) Successful in 5m16s
CI / Canvas (Next.js) (pull_request) Successful in 6m17s
CI / Canvas Deploy Status (pull_request) Has been skipped
CI / all-required (pull_request) Successful in 2s
qa-review / approved (pull_request_review) Has been skipped
security-review / approved (pull_request_review) Has been skipped
sop-tier-check / tier-check (pull_request_review) Successful in 5s
audit-force-merge / audit (pull_request_target) Successful in 14s
test(e2e): harden staging-external + chat E2Es fail-closed (promotion-readiness)
Both lanes stay continue-on-error (CTO's irreversible call) but are now
fail-closed so they can become required gates. No "flaky" dispositions —
each flake mechanism is named + fixed deterministically (internal#828).

e2e-staging-external + test_staging_external_runtime.sh:
- REQUIRE_LIVE guard (E2E_REQUIRE_LIVE=1 in CI): exit 5 if the harness
  reaches a clean exit without proving all four awaiting_agent
  transitions — a silent skip / early-return / dropped assertion can no
  longer show green. Mirrors CP serving-e2e SERVING_E2E_REQUIRE_LIVE.
- Sweep-cadence flake (step 6): replaced fixed `sleep $STALE_WAIT_SECS`
  + one-shot assert with a bounded readiness-poll up to
  STALE_POLL_DEADLINE_SECS. A slow-but-working sweep tick was being
  misread as a stuck 'online'.
- Cold-boot transient flake (register / re-register): single-shot POST
  /registry/register failed on Caddy 502/503/504 during cold TLS/agent
  boot. Added register_with_retry mirroring the full-saas bounded
  retry-on-transient loop — retries ONLY the transport class (5xx + body
  match), fails closed on 4xx (real contract bug) and on exhausted budget.
- Token redaction (sanitize_http_body) on all transient-error logs.

e2e-chat + Playwright:
- passWithNoTests:false + forbidOnly(CI) in playwright.config.ts: a
  renamed/moved spec or stray test.only can no longer green the lane with
  zero executed tests.
- REQUIRE-LIVE guard in the run step: chat==true must execute >=1 test.
- chat-desktop "activity log" test no longer swallows its assertion with
  `.catch(() => {})` (always-passed before) — now presence-gated skip or
  a real visibility assertion.

PROMOTION-READINESS comments added to each workflow listing what's now
fail-closed and what still blocks promotion-to-required (infra-vs-code
signal split for external; server-received A2A assertion for chat).

Verified without live infra: bash -n + shellcheck clean on the harness
(only a pre-existing SC2015 info on untouched teardown line); both
workflow YAMLs parse; embedded run-step bash -n clean; pure-logic unit
tests for REQUIRE_LIVE fail-closed, sweep-deadline guard, and transient
retry classification all pass. Live staging suite NOT run (no infra).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-04 19:23:07 -07:00

27 lines
898 B
TypeScript

import { defineConfig } from "@playwright/test";
export default defineConfig({
testDir: "./e2e",
timeout: 30_000,
expect: { timeout: 10_000 },
fullyParallel: false,
workers: 1,
retries: 0,
// Fail CLOSED when an explicit spec selection matches zero tests.
// Playwright defaults this to true, so `playwright test e2e/chat-*.spec.ts`
// would exit 0 (green) if those files were renamed/moved/deleted — a
// false-green that would silently gut the e2e-chat gate after a refactor.
// forbidOnly likewise stops a stray `test.only` from green-ing the suite
// while skipping every other case.
passWithNoTests: false,
forbidOnly: !!process.env.CI,
use: {
baseURL: process.env.PLAYWRIGHT_BASE_URL || "http://localhost:3000",
headless: true,
screenshot: "only-on-failure",
},
projects: [
{ name: "chromium", use: { browserName: "chromium" } },
],
});