Commit Graph
240 Commits
Author SHA1 Message Date
dependabot[bot] 3393d1e7f9 ci: bump taiki-e/install-action in / (#2753)
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) in `/` from 2.90.2 to 2.90.3.


Updates `taiki-e/install-action` from 2.90.2 to 2.90.3
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/3a3daafd3b7f23b8f65d9f5ba2db203fb59b79e2...cfdb7ed4ccc7c7dce37759eae89dc5674b469b39)

Updates `taiki-e/install-action` from 2.90.2 to 2.90.3
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/3a3daafd3b7f23b8f65d9f5ba2db203fb59b79e2...cfdb7ed4ccc7c7dce37759eae89dc5674b469b39)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-version: 2.90.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github_actions
- dependency-name: taiki-e/install-action
  dependency-version: 2.90.3
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github_actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-19 14:32:02 -08:00
utsav-oaiandutsav-oai e224a3314b fix(cli): hillclimb dependency investigation eval & speed (#2737)
* feat(cli): add independently reviewed dependency checks

* Compare frozen Python advisory versions as releases

* fix(cli): bind unnamed root manifests to observed services

* test(cli): evaluate dependency investigations across public fixtures

* test(sdk): bound the budget wait after the mock scan starts

* test(cli): exercise MCP evidence and missing caller access

* Bind graded citations to the approved use evidence

* test: restore dependency investigation quality controls

* fix(cli): restore dependency investigation and report compatibility

* test: grade malformed dependency baseline answers

* fix(cli): scope headless tool access to the investigator

* test(cli): lock down reviewer and external evidence tool access

* fix(cli): keep linked evidence tied to its originating call

* Reconcile application mappings and expose original evidence hashes

* test: verify selected catalog rows against original replies

* fix(cli): recover incomplete reviews and preserve selected evidence rows

* fix(cli): preserve wire evidence and verify finding citations

* Finalize from approved submissions and explain remaining uses

* fix(cli): restore coordinator recovery, independent review and report contracts

* Review withdrawals under the original dependency assessment ID

* test(cli): compare trace progress with completed search scopes

* Recheck dependency coverage after concurrent investigation changes

* Preserve exploratory scope explanations during dependency review

* feat(cli): track shared source work in dependency investigations

* Include shared source work in final coverage checks

* Require deciding evidence on the caller it establishes

* Preserve generic MCP search outcomes and scopes in dependency reports

* Share pinned source notes between dependency investigators

* Ship the source worklist and search audit modules

* refactor(cli): name the dependency coordinator for its ability to resume

* refactor(cli): simplify the tools for dependency investigations

* fix(cli): keep investigation tool arguments visible to Codex and reuse the evidence store

* fix(cli): send missing verdict citations back to the reviewer

* fix(cli): verify caller bindings and input flow across investigation steps

* fix(cli): require direct citations for asserted runtime facts on every use

* test(cli): verify failed catalog lookups without a timed source scan

---------

Co-authored-by: utsav-oai <348536218+utsav-oai@users.noreply.github.com>
2026-11-19 11:10:07 -08:00
utsav-oaiandutsav-oai 5353212b03 test(cli): evaluate dependency investigations across public fixtures (#2716)
* feat(cli): add independently reviewed dependency checks

* Compare frozen Python advisory versions as releases

* fix(cli): bind unnamed root manifests to observed services

* test(cli): evaluate dependency investigations across public fixtures

* test(sdk): bound the budget wait after the mock scan starts

* test(cli): exercise MCP evidence and missing caller access

* Bind graded citations to the approved use evidence

---------

Co-authored-by: utsav-oai <348536218+utsav-oai@users.noreply.github.com>
2026-11-19 07:28:56 -08:00
dependabot[bot] 29b002fe8b ci: bump docker/login-action from 4.7.0 to 4.8.0 (#2642)
Bumps [docker/login-action](https://github.com/docker/login-action) from 4.7.0 to 4.8.0.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](https://github.com/docker/login-action/compare/81c6f93d4bc991e510b342a00b419b3bb4efc5c6...8aa5831fb8d48d8f76594c7ddde61ae58019f550)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-version: 4.8.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-18 10:17:39 -08:00
dependabot[bot] 4fb506fd79 ci: bump taiki-e/install-action in / (#2641)
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) in `/` from 2.90.1 to 2.90.2.


Updates `taiki-e/install-action` from 2.90.1 to 2.90.2
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/c509219cf42fba86913069efd0ade2458c59337b...3a3daafd3b7f23b8f65d9f5ba2db203fb59b79e2)

Updates `taiki-e/install-action` from 2.90.1 to 2.90.2
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/c509219cf42fba86913069efd0ade2458c59337b...3a3daafd3b7f23b8f65d9f5ba2db203fb59b79e2)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-version: 2.90.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github_actions
- dependency-name: taiki-e/install-action
  dependency-version: 2.90.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github_actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-18 10:17:33 -08:00
Michael D'Angelo 4259c76c99 test(plugin): apply saved patch bytes on Windows (#2693)
* test(plugin): apply saved patch bytes on Windows

* test(ci): provide ripgrep for the Windows MCP smoke test

* test(sdk): preserve env utility name in inventory fixture

(cherry picked from commit 5ce7e7c53c)
2026-11-16 10:25:05 -08:00
Michael D'Angelo c6432d1131 test(plugin): make Deep Scan worker fixtures portable (#2665)
* test(plugin): make Deep Scan worker fixtures portable

* test(ci): exercise Deep Scan worker fixtures on Windows

* test(plugin): isolate worker PATH fixtures from the SDK

* test(plugin): format the worker search path fixture
2026-11-15 21:58:39 -08:00
Michael D'Angelo 6b6c5251cf ci: stabilize campaign executable lookup tests (#2621) 2026-11-11 16:25:58 -08:00
dependabot[bot] 0676faa3eb ci: update install-action to v2.90.1 (#2599)
ci: bump taiki-e/install-action in /

Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) in `/` from 2.90.0 to 2.90.1.


Updates `taiki-e/install-action` from 2.90.0 to 2.90.1
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/b80e2bb2635f28eb98b9fce1e2f0887e1535c6b2...c509219cf42fba86913069efd0ade2458c59337b)

Updates `taiki-e/install-action` from 2.90.0 to 2.90.1
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/b80e2bb2635f28eb98b9fce1e2f0887e1535c6b2...c509219cf42fba86913069efd0ade2458c59337b)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-version: 2.90.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github_actions
- dependency-name: taiki-e/install-action
  dependency-version: 2.90.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github_actions
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-11 09:53:40 -08:00
dependabot[bot] ea9114512e ci: update install-action to v2.90.0 (#2561)
Pin the workflow-quality and lockfile-audit installer to the v2.90.0 commit.
2026-11-10 06:59:01 -08:00
Michael D'Angelo 41c53a297a fix(release): allow more time for npm package availability (#2532) 2026-11-09 21:41:36 -08:00
dependabot[bot] f784450fed ci: update taiki-e/install-action to v2.89.1 (#2486) 2026-11-09 12:03:57 -08:00
Michael D'Angelo c40e2cba18 fix(release): bind Darwin signing to builds from protected main (#2495) 2026-11-09 11:32:47 -08:00
Michael D'Angelo 61fc3a061f fix(release): sign macOS addons for packaged review items (#2331)
* fix(release): sign macOS addons for packaged review items

* fix(release): bind signing to the verified release artifacts

* chore(ci): retry GitHub Code Quality after upload rate limit

* fix(release): sign Darwin addons through Signer Service
2026-11-09 08:37:24 -08:00
Michael D'Angeloandmldangelo-oai 884b7b657a refactor!: consolidate scan, workbench and release rules (#2452)
* refactor(workbench): share schema repair and saved finding projections

* refactor(cli): resolve the command route once

* refactor(settings): share Deep Scan configuration and restore saved inputs

* refactor(imports): reuse scanner projections at the file boundary

* refactor(publish): share pending request and receipt handling

* refactor(telemetry): classify publication failures in the recorder

* refactor(package): share plugin inventory and archive checks

* refactor(release): reuse verified provenance and release decisions

* fix(ci): reconcile release labels with an empty array on Bash 3.2

* ci: report failed source checks after cancelled PR edits

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-09 05:02:21 -08:00
Michael D'Angelo 590e3909a0 ci(release): share npm setup and verification (#2476)
* ci(release): share npm setup and verification

Use the same local composite action after checkout in both release jobs. Keep the Node and registry settings, Socket Firewall installation and next-step PATH verification in one place. Each job retains its own checkout, credentials and publication controls. Existing tags continue to use the workflow in their release commit. No public interface migration is required.

Both release suites pass (318 tests), including 312 tests with the separate bootstrap and release-history changes applied. Five mocked setup runs checked success and failures during installation, version validation and executable selection. Compared workflow selection for npm-v0.8.2 and npm-v0.8.3 and linted both workflows. These checks did not dispatch a release or publish a package.

* ci(release): scope the workflow lint exception to the verified npm path

Moving the shared setup into a composite action brings its existing PATH write under the github-env audit. Both release jobs install the pinned npm from the firewall, verify the executable in a fixed directory under RUNNER_TEMP and recheck it on PATH in the next step. Explain that input on the installation step.

Reproduced the initial diagnostic with zizmor 1.30.1. Its repository-wide workflow check now passes, and it still reports an unchecked PATH write added to a neighboring fixture step. Both release automation and release PR suites pass (429 tests).
2026-11-09 04:07:40 -08:00
Michael D'Angelo 5b1e8a53de refactor(release): resolve history in the GitHub publisher (#2475)
Read published versions, release tags, and reachable tags in the publisher before generating notes. Keep the previous tag and latest decision in their native types and remove the intermediate workflow outputs. The internal release-history command had one workflow caller. No public API or client migration is required.

Verified with 318 release automation and release progress workflow tests. Thirteen synthetic comparisons of the previous and revised pipelines matched command arguments, generated notes, and exit codes for initial releases, backfills, partial histories, and failures.
2026-11-09 04:07:32 -08:00
Michael D'Angelo f956b5792f refactor(release): retire first-publish npm bootstrap (#2472)
The public package has already shipped 0.1.0 and npm permanently reserves
that name and version. Remove the first-publish token step and the local
adapter that treated an E404 as an empty release history. Both workflows
stop on lookup failure. Normal publication still uses trusted publishing.
Historical GitHub release verification keeps its original recovery path.

Across 22 synthetic release-cut and publisher comparisons, only the two
initial-404 cases changed. The candidate passed 407 release, Action, and
container tests. The historical 0.1.0 npm and GitHub archives matched
byte for byte. The pinned npm signature audit and both revisions'
provenance and publication checks accepted the same archive and run.
No package user or downstream release command needs to change.
2026-11-09 04:07:11 -08:00
Michael D'Angelo 28d25b80d3 ci: pass the selected Invoice Desk target directly to the scan (#2467)
The protected workflow schedules one main baseline or a manually selected
PR revision. Carry that SHA and optional PR number through job outputs,
and recheck the same identity after approval. The trusted cache gates,
visible job and artifact names, and revision-specific concurrency persist.

Check actual PR, baseline and skipped CLI outputs. The 5 resolver and 10
workflow tests passed on both revisions. Also compared both resolvers
across 504 cases and the emitted CLI outputs and workflow expressions
across 33 dispatch, eligibility, approval and cache scenarios.
2026-11-09 04:06:33 -08:00
dependabot[bot] af7bb86108 ci: update taiki-e/install-action to v2.89.0 (#2451)
Update the installer pin used by workflow linting and lockfile audits. Keep the existing ShellCheck, zizmor and Trivy versions.
2026-11-08 18:25:49 -08:00
Michael D'Angelo 9e38dd3084 chore(ci): share the pinned Bun version (#2422)
* chore(ci): share the pinned Bun version

* test(ci): match the shared Bun setup step directly
2026-11-07 00:30:33 -08:00
khai-oaiandMichael D'Angelo 794edbe957 chore(deps): update the Bun toolchain to 1.4.4 (#2417)
* ci(deps): update Bun to 1.4.4

* test(ci): align the Bun workflow version assertion

* chore(deps): align remaining Bun toolchain pins

* fix(ci): preserve test timeouts with Bun 1.4 options

---------

Co-authored-by: Michael D'Angelo <mdangelo@openai.com>
2026-11-06 18:38:02 -08:00
Michael D'Angelo 2d50d7aff8 chore(deps): reduce the dependency tree for evals, SDK and tooling (#2409)
* chore(deps): reduce the dependency tree for evals, SDK and tooling

* docs(evals): explain how to enable optional Promptfoo peers
2026-11-06 18:08:28 -08:00
dependabot[bot] dc0815adfc ci: update the workflow lint installer to v2.88.1 (#2396)
Pin taiki-e/install-action to its v2.88.1 release and group future updates across workflows and local composite actions.
2026-11-06 13:38:12 -08:00
Michael D'Angeloandmldangelo-oai 1f95245b15 fix: retry Windows native wrapper publication (#2381)
* fix: finish Windows native wrapper publications before reporting failure

* test(plugin): verify Windows wrapper retries and cleanup before rejection

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-06 06:45:52 -08:00
Michael D'Angeloandmldangelo-oai e8d6251cbd fix: allow bundled helpers to start on Windows UNC shares (#2376)
* fix: give bundled MCP helpers a package scope on Windows UNC shares

* ci: exercise the bundled UNC helper on Windows Node 26

* ci: keep the Windows machine-policy check on Node 22

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-06 06:45:26 -08:00
Michael D'Angeloandmldangelo-oai 1cc9df5e09 test(deep-scan): make worker lifecycle fixtures deterministic on Windows (#2375)
* test(deep-scan): make worker lifecycle fixtures deterministic on Windows

* ci: cover Deep Scan cleanup and deadlines on Windows

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-06 06:45:15 -08:00
Michael D'Angeloandmldangelo-oai 083fccf8c0 test(mcp): resolve the native binding in candidate fixtures (#2372)
* test(mcp): resolve the native binding in candidate fixtures

* ci: exercise candidate normalization on the Windows runner

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-06 06:44:53 -08:00
Michael D'Angelo 4d83ce9195 refactor: share workbench arguments and simplify SDK and eval workflows (#2325)
* Simplify workbench dispatch, SDK helpers, and their test fixtures

* test(sdk): keep distinct progress matrix helpers

* test(sdk): expect canceled lifecycle for aborted component scans
2026-11-05 01:28:44 -08:00
Michael D'Angelo d031235b91 ci: build the bundled plugin for rotating property tests (#2337) 2026-11-04 13:14:20 -08:00
Michael D'Angelo bd59acf5cc build(sdk): ship only the embedding tokenizer and its encoding (#2333)
* ci: audit bundled MCP and triage eval dependencies

* build(sdk): ship only the embedding tokenizer and its encoding

* fix(packaging): require complete tokenizer inventories

* test(sdk): check installed tokenizer parity without build dependencies
2026-11-04 12:58:43 -08:00
Michael D'Angelo f86dc7bb73 test: isolate the SDK mutation testing dependencies (#2330) 2026-11-04 11:14:09 -08:00
Michael D'Angelo b63d38afc7 ci: audit bundled MCP and triage eval dependencies (#2328) 2026-11-04 11:08:26 -08:00
dependabot[bot] 38c2684a2d ci: bump taiki-e/install-action from 2.87.32 to 2.88.0 (#2283)
Use the verified v2.88.0 installer commit for the workflow-quality job.
2026-11-04 05:43:50 -08:00
Michael D'Angeloandmldangelo-oai f601cd659b feat(action)!: prepare hosted runners and require completed PR checks (#1580)
* fix(sdk): restore GPT-6 Sol cost estimates and budgets

* feat(action)!: prepare hosted runners and require complete CI reviews

* fix(action): handle containers and retargeted pull requests

* Align the main Action quick start with sandbox and coverage behavior

* test(packaging): await tar extraction in package fixtures

* fix(action): preserve required scans across metadata edits

* fix(action): verify sandbox startup before hosted setup

* fix(action): only provision Ubuntu after sandbox startup failures

* fix(action): preserve setup diagnostics and check native configuration

* fix(action): preserve runner setup and PR check semantics

* fix(action): verify live PR targets on the triggering host

* docs(action): clarify check migration and SARIF permissions

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-02 18:23:46 -08:00
Michael D'Angelo d408c1e4a0 refactor!: share sealed scan reads with tracking (#1846)
Use the shared Node reader to verify sealed scan artifacts before tracking selects findings. Direct callers of the former Python helper can use the plugin launcher.
2026-11-02 15:59:40 -08:00
Michael D'Angelo c40e7bbf38 test(ci): pass JUnit shard files directly to the comparator (#2250) 2026-11-02 04:17:37 -08:00
dependabot[bot] f61dc8092f ci: bump taiki-e/install-action from 2.87.31 to 2.87.32 (#2244)
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.87.31 to 2.87.32.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/taiki-e/install-action/compare/1e29709c0ec63babbe8f266397a465f29a825f91...5488ac5a951645ce95062214902ac4b6bc1a1037)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-version: 2.87.32
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-02 02:22:58 -08:00
Michael D'Angelo 94462cdafb ci: share smoke inputs and native artifact upload settings (#2220)
* ci: share repeated workflow inputs and steps

* ci: keep distribution release steps explicit

* test: isolate native metadata fixture from marketplace sync
2026-11-01 15:21:04 -08:00
dependabot[bot] 73e944f9d9 ci: update taiki-e/install-action to 2.87.31 (#2156)
Update the pinned taiki-e/install-action release to 2.87.31 in the workflow tooling.
2026-10-30 15:23:25 -07:00
dependabot[bot] 87a5c0afa4 ci: update docker/login-action to 4.7.0 (#2155)
Update the pinned docker/login-action release to 4.7.0 in the container publication workflows.
2026-10-30 08:29:40 -07:00
Michael D'Angelo 12cbba751a chore(release): approve npm and scanner images together (#2143) 2026-10-29 16:10:11 -07:00
dependabot[bot] fd82505ab4 ci: bump actions/attest from 4.2.1 to 4.2.2 (#2131)
Update the provenance and SPDX attestation steps to the verified v4.2.2 release commit.
2026-10-29 10:00:20 +00:00
Michael D'Angelo e3e688758e feat(container): release Debian and Wolfi from the verified scanner package (#2116) 2026-10-28 22:24:44 -07:00
dependabot[bot] b4dddc19b2 ci: bump actions/setup-python to 7.1.0 (#2106)
Use the v7.1.0 release commit in the Python setup steps.
2026-10-28 20:13:56 -07:00
dependabot[bot] 506d832930 ci: bump taiki-e/install-action to 2.87.30 (#2108)
Pin the workflow-quality installer to the v2.87.30 release commit.
2026-10-28 13:47:38 -07:00
andy-tang-oai 5094179a10 feat(container): publish a versioned Wolfi amd64 scanner (#2091)
* feat(container): publish a versioned Wolfi amd64 scanner

* fix(container): verify and inventory the published Wolfi payload
2026-10-28 09:15:03 -05:00
Michael D'Angelo d3593955b4 ci: skip container builds for SDK test-only pull requests (#2069) 2026-10-27 20:06:08 +05:30
Michael D'Angelo dab067b6ac ci: skip the native bundle runner on verified cache hits (#2042) 2026-10-26 20:11:46 +05:30
Michael D'Angelo 131fac9720 ci: skip the unused ripgrep install in deterministic evals (#2037) 2026-10-26 19:39:17 +05:30