Commit Graph
73 Commits
Author SHA1 Message Date
Krzysztof Moch eddf577526 feat(reporters): build the built-in reporters on the public Reporter API (#1936)
* feat(reporters): build the built-in reporters on the public Reporter API

The built-in list, dot, json, junit, and markdown reporters now use only
the public Reporter contract: factories on e2e/reporters, printsTo for the
terminal stream a reporter prints to (one reporter per stream), live
onOutput, onStepPrompt, and onSummary hooks for any number of reporters,
and reportFiles for files the runner writes atomically. The list and dot
ids beside json print to stderr, so list,json now works as dot,json does.
@e2e-dev/html-reporter writes through reportFiles.

* docs(reporters): bring the Japanese and Chinese reporter pages up to date

Translates the reporter reference, the config reporters table, the
--reporter row, and the debugging output paragraph. In English, the name
section now says a reporter may share a built-in's name, and two lines
read less ambiguously.
2026-11-19 15:58:33 +00:00
github-actions[bot] e8068cbff5 chore: version packages (#1763) 2026-11-19 16:37:27 +02:00
Szymon Rybczak 60d29cfe4c chore: move the conduct and contributor emails to e2e.com (#1965)
Code of conduct reports go to conduct@e2e.com, the domain SECURITY.md and the README already use. The contributors entries in the root manifest and the 11 packages that list them, and the Apple Pay lab podspec's author, move to @e2e.com with a patch changeset so npm picks them up. tester@tester.army stays: it is the benchmark apps' sign-in fixture, baked into the committed recordings and device snapshots.
2026-11-19 11:13:48 +00:00
Oskar Kwaśniewski ad641beeac chore(deps): bump workspace deps and agent-device to 0.21.39 (#1958) 2026-11-19 12:06:00 +02:00
github-actions[bot] dd3aa19528 chore: version packages (#1590) 2026-11-13 13:25:30 +00:00
Krzysztof MochandOskar Kwaśniewski 17a2e464f0 feat(explore): explore what a pull request changed with --changed-since (#1711)
Co-authored-by: Oskar Kwaśniewski <oskar@okwasniewski.com>
2026-11-12 17:42:01 +00:00
Oskar Kwaśniewski 3735887569 chore: move from tester-army to e2e-inc GitHub org (#1672) 2026-11-10 20:11:53 +01:00
Krzysztof Moch a13380728f feat(html-reporter): write the run as one HTML page (#1642)
* feat(html-reporter): write the run as one HTML page

* fix(html-reporter): match the headline to the listed tests, fence prompts safely, and stop on the reporter signal

* docs(html-reporter): code frames need the test file in the project

* test(e2e): give the JUnit attachment test's finished run a redact
2026-11-10 15:48:15 +01:00
Oskar Kwaśniewski 0c0469605a chore: replace e2e.tester.army with e2e.com (#1572) 2026-11-05 09:23:45 +01:00
Oskar KwaśniewskiandClaude Opus 5.5 38e9ae0fd4 test(report): count serial retry attempts in a file, name copied memberRan (#1525)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-03 19:30:26 +01:00
Samanyu DasandClaude Opus 5.5 b8485ba2e7 fix(report): count a serial member executed when its body ran (#1470)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-03 10:52:01 +01:00
Oskar Kwaśniewski 0410fc9c74 chore(deps): bump workspace deps to latest, agent-device to 0.21.36 (#1516) 2026-11-03 09:41:11 +01:00
Oskar Kwaśniewski 108bc604cd chore(deps): bump workspace deps to latest, @agentclientprotocol/sdk to 2.2.0 (#1491) 2026-10-31 10:35:18 +01:00
github-actions[bot] cad17c3200 chore: version packages (#1378) 2026-10-30 17:25:27 +01:00
Oskar Kwaśniewski d181e2645f fix(github): give an e2e explore run its own pull request comment (#1438) 2026-10-28 17:45:34 -07:00
Oskar Kwaśniewski 3a8d6f1b6c chore(deps): bump workspace deps to latest (#1382) 2026-10-26 09:02:14 -07:00
github-actions[bot] 69e123b17e chore: version packages (#1346) 2026-10-23 14:31:37 -05:00
Oskar Kwaśniewski da13624d31 feat(runner): run only the tests a pull request can affect (#1206) 2026-10-23 12:29:15 -05:00
github-actions[bot] 393005aa69 chore: version packages (#1176) 2026-10-16 18:23:09 +02:00
aa9699a688 fix(github): distinguish API throttling from token permissions (#1038)
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Oskar Kwaśniewski <oskar@okwasniewski.com>
2026-10-16 15:38:08 +02:00
github-actions[bot] a7b13a6cda chore: version packages (#1158)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-10-15 14:42:30 +02:00
Oskar Kwaśniewski ce4dac3737 fix(github): update only the reporter's own PR comment (#1161)
* fix(github): update only the reporter's own PR comment

* docs(changeset): say any bot author matches for installation tokens
2026-10-15 12:30:10 +02:00
Oskar Kwaśniewski 1b92a6ddfa feat: e2e trace pages replace the Playwright trace (#869) 2026-10-07 11:28:27 +02:00
github-actions[bot] b2a28d4813 chore: version packages (#825) 2026-10-06 14:49:38 +02:00
Oskar Kwaśniewski 8657c8b710 test(mobile): fake clock in engine tests, drop the simulator suite CI never ran (#808)
* test(mobile): fake the clock and shrink PNGs in engine tests, trim duplicates

engine.test.ts 6.4s -> 0.4s: retry backoff and transition budgets on fake timers, small screenshots. Merge or drop tests restating constants or covered elsewhere; prose asserts in errors.test check the headline and recovery only.

* test(mobile): delete the simulator suite no workflow runs

E2E_AGENT_DEVICE_SIMULATOR was never set in CI; the mobile benchmark drives real simulators and emulators. Drops test:simulator and the integration project.

* test(mobile): cover duplicate refind, clipboard step label, unreadable secure screenshot

* test(eas): restore Date.now in afterEach, unique run ids, drop constant asserts

* test(github): drop the factory tautology and markdown asserts core owns

* test(mobile): keep the videoTouches and interactive snapshot option checks

* test(mobile): name the openApp permission refusal by what it checks
2026-10-04 10:10:57 +02:00
Oskar Kwaśniewski 0d1ed15871 fix(e2e)!: load TypeScript with e2e's own oxc loader, so pnpm 11+ installs pass (#790)
* fix(e2e): load TypeScript with an oxc loader instead of tsx

* fix(e2e): close loader edge cases: sourceless CommonJS, export maps without extensions, unreadable tsconfig, chained source maps, Windows require paths

* fix(e2e): refuse Bun and Deno runtimes, name oxc load failures, follow Yarn PnP export targets

* perf(e2e): skip the syntax check for files whose only @ is in a package import

* fix(e2e): allow type-only exports in .cts, warn from runner only, Bun check first, docs

* fix(e2e): workers warn about tsconfigs runner did not, FILE: urls, foreign infra errors, review tests
2026-10-04 09:22:50 +02:00
github-actions[bot] 09733be70a chore: version packages (#774) 2026-10-04 09:12:59 +02:00
Oskar Kwaśniewski 3a9667c046 fix(run): keep --last-failed reruns honest: failure-limit skips, carried debts, kept evidence (#724)
* fix(run): keep --last-failed reruns honest: failure-limit skips, carried debts, kept evidence

--last-failed now reruns tests --max-failures skipped. A test or failed
suite hook another filter leaves out stays owed in the report's new
run.carried until a rerun runs it; the github fold shows carried rows and
errors and stays red while anything is carried. A rerun prunes artifacts/
to what the previous report names and writes its attempts under
artifacts/rerun-<n>/ instead of wiping the tree and reusing attempt paths.

* fix(run): carry a setup's hook debt when no selected test needs it

The report has no row for an unneeded setup, so carryForward now asks the
collection whether a test still exists instead of the report's rows.

* fix(run): reject malformed artifacts in --last-failed reports, tighten rerun docs

Distinct ids in the carried fixture row.

* fix(run): keep carrying tests of a file a narrowed rerun could not collect

* fix(github): a carried interrupted test reads interrupted, not failed, in the folded page
2026-10-03 16:36:53 +02:00
Oskar Kwaśniewski 7ab80bc610 fix(report)!: count interrupted tests apart from failures (#713)
* fix(report)!: count interrupted tests apart from failures

* fix(report): tell a failed test from its last failed attempt, whatever the cut retry left
2026-10-03 09:30:44 +02:00
github-actions[bot] a0ee3e9061 chore: version packages (#761)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-10-02 19:15:15 +02:00
Oskar Kwaśniewski 62bfe0a896 fix(github): long marker fields keep a digest so distinct keys never share a comment (#720)
* fix(github): long marker fields keep a digest so distinct keys never share a comment

* docs(changeset): note one-time duplicate for long marker fields
2026-10-02 18:17:26 +02:00
Oskar Kwaśniewski b573756818 fix(e2e): slim the install - split MCP server SDK, no sourcemaps (#763) 2026-10-02 15:17:58 +02:00
Oskar Kwaśniewski 6fa2bc2222 ci(release): publish through npm trusted publishing (OIDC) (#707)
Drops NPM_TOKEN from release.yml; each package grants release.yml publish
rights via an npm trusted publisher. Release job moves to ubuntu-latest
because npm rejects OIDC from self-hosted runners (Blacksmith included).
publishConfig.provenance pins removed so provenance attaches automatically
once the repo is public. Setup recipe documented in CONTRIBUTING.md.
2026-10-01 11:35:22 +02:00
github-actions[bot] ba9a8b6727 chore: version packages (#714)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-10-01 09:58:06 +02:00
Oskar Kwaśniewski 1a80c23d87 chore(npm): e2e ships the repo README, revised keywords for every package (#706)
* chore(npm): e2e ships the repo README, revised keywords for every package

* test(skill): follow the skill copy into prepare-build.ts

* fix(npm): keep README links relative on GitHub, rewrite them for the npm copy
2026-10-01 09:41:33 +02:00
Oskar Kwaśniewski 079a50e36d chore: release 2026-09-30 21:03:02 +02:00
Oskar Kwaśniewski 4d488f8286 feat!: the app is declared on its target; engines only drive it (#698)
* feat!: the app is declared on its target; engines only drive it

The app under test moves from the engine's options to `targets: [{ engine,
app }]`: `url`, `bundleId`, `appPath`, `identity`, `environment`,
`launchArguments`, `permissions`, `command`, and `readyUrl`. `web()` and
`mobile()` refuse every moved option in one `INVALID_CONFIG` naming the
target block; `defineEngine({ app })` is gone and engines check what their
platform needs in `validateApp`. `requires: ['browser' | 'native-app']` is
derived from the target's app. Replay cache and session keys are byte for
byte what they were, pinned by target-identity.test.ts.

Dependency services are not part of this version: `services` anywhere, and
`web({ services })`, fail saying so. `app.command` on port 0 without a
command, and `reuseExisting` on a free port, are refused. An `e2e mcp`
open cancelled or disconnected mid-start stops what it started, and a hung
shared start is abandoned once no session waits on it.

* fix: review follow-ups: cancelled opens, abandoned starts, null targets, stale docs

* refactor: drop the moved-option messages; old app keys are unknown keys

* test: give the replaced-nodes suite a budget that survives a loaded runner

* test: size the replaced-nodes hook budget to its seven tests
2026-09-30 19:48:00 +02:00
Oskar Kwaśniewski e4fca9debd chore(release): versioned releases publish to latest, ship the github reporter with the stable runner (#682)
* chore(release): versioned releases publish to latest, ship the github reporter with the stable runner

Versioned releases went to the beta dist-tag while latest stayed on a July placeholder, so a bare npx e2e init installed 0.1.0. The release script now passes no --tag and publishConfig.tag reads latest on every package.

@e2e-dev/github had no pending changeset; its only published builds peer on one exact canary runner and refuse a stable e2e. A patch changeset ships it alongside 0.15.0 with the wide peer range.

Quickstart and the skill setup reference install plain e2e instead of @canary. CONTRIBUTING and AGENTS describe the latest channel.

* chore(changeset): word the github reporter entry for the changelog
2026-09-30 16:38:52 +02:00
Oskar Kwaśniewski a5b3eaccfd fix(release): restore the wide e2e peer range the canary release pinned (#628) 2026-09-29 10:05:21 +02:00
Oskar Kwaśniewski 640a73ef75 chore: release 2026-09-28 20:50:21 +02:00
Oskar Kwaśniewski 67c29fc6b2 chore!: publish engines and reporter under the @e2e-dev npm scope (#602) 2026-09-28 19:05:05 +02:00
Oskar Kwaśniewski 61603e6c2c fix(github): a --last-failed rerun updates the pull request comment as one run (#537) 2026-09-25 17:09:09 +02:00
Oskar Kwaśniewski 60cd81f70e chore: restore the engine peer ranges the canary release pinned (#518) 2026-09-25 10:54:35 +02:00
Oskar Kwaśniewski 9a8e1cfc8d chore: release 2026-09-25 09:56:08 +02:00
Oskar Kwaśniewski 48c9e10d9b chore: release 2026-09-24 16:13:16 +02:00
Oskar Kwaśniewski cdc41098c7 fix(report): markdown cells cannot mention, autolink, or start a block, and all-dot names are rejected (#448) 2026-09-23 10:53:49 +02:00
dependabot[bot] 2e1a3107e1 chore(deps): bump the dev-tooling group across 1 directory with 7 updates (#464)
Signed-off-by: dependabot[bot] <support@github.com>
2026-09-23 10:48:59 +02:00
Oskar Kwaśniewski 9614834797 fix(release): engine and reporter peers on e2e stay >=0.15.0 <1 after a canary, and pnpm check enforces it (#432) 2026-09-23 08:24:35 +02:00
Oskar Kwaśniewski b84fefb5d2 chore: release 2026-09-22 18:14:46 +02:00
Oskar Kwaśniewski b71ecc0f09 fix(report): leave unselected results off the page and JUnit, link sources under the project path (#422) 2026-09-22 18:14:28 +02:00