Commit Graph
114 Commits
Author SHA1 Message Date
utsav-oai bcf39188a3 fix(cli): assess captured stacks against public advisory conditions (#2760)
* fix(cli): assess captured stacks against public advisory conditions

Resolve advisory records once per captured-stack investigation and extract necessary conditions with supporting quotations. Share the combined conditions with the investigator and proof validator, and freeze the evidence for replay.

* refactor(cli): share advisory trigger guidance across investigations

* fix(package): include the stack advisory module in the distribution manifest

* fix(cli): review captured-stack investigations before publication

Verify cited checks for unresolved questions during assessment and finalization. Add independent stack review and share the repository workflow’s one-shot correction loop.

* fix(cli): expose each stack report in the command output schema

* refactor(cli): use one report format for captured stacks

* fix(evals): grade stack reports against their review and advisory evidence
2026-11-19 21:28:34 -05:00
dependabot[bot]andMichael D'Angelo bd09ff8254 chore(deps): bump promptfoo from 0.124.1 to 0.125.1 in /evals/triage-finding (#2335)
* chore(deps): bump promptfoo in /evals/triage-finding

Bumps [promptfoo](https://github.com/promptfoo/promptfoo) from 0.124.1 to 0.125.1.
- [Release notes](https://github.com/promptfoo/promptfoo/releases)
- [Changelog](https://github.com/promptfoo/promptfoo/blob/main/CHANGELOG.md)
- [Commits](https://github.com/promptfoo/promptfoo/compare/0.124.1...0.125.1)

---
updated-dependencies:
- dependency-name: promptfoo
  dependency-version: 0.125.1
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix(evals): bind Promptfoo to the scanner’s pinned Codex SDK

Supply the eval SDK and its entry point to the native provider. Forward cancellation through custom CLI version probes and cover version mismatch in the provider fixtures. Prune obsolete overrides and optional packages, and refresh the affected HTTP and FTP dependencies.

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Michael D'Angelo <mdangelo@openai.com>
2026-11-19 15:00:27 -08:00
dependabot[bot] 42fa0fc519 chore(deps): update linkify-it to 5.0.2 in the reviews eval fixture (#2758)
Share the expected linkify-it versions across the grader and synthetic release evidence. Check that the fixed reviews build cites its own installed version.
2026-11-19 14:35:11 -08:00
utsav-oaiandutsav-oai e224a3314b fix(cli): hillclimb dependency investigation eval & speed (#2737)
* feat(cli): add independently reviewed dependency checks

* Compare frozen Python advisory versions as releases

* fix(cli): bind unnamed root manifests to observed services

* test(cli): evaluate dependency investigations across public fixtures

* test(sdk): bound the budget wait after the mock scan starts

* test(cli): exercise MCP evidence and missing caller access

* Bind graded citations to the approved use evidence

* test: restore dependency investigation quality controls

* fix(cli): restore dependency investigation and report compatibility

* test: grade malformed dependency baseline answers

* fix(cli): scope headless tool access to the investigator

* test(cli): lock down reviewer and external evidence tool access

* fix(cli): keep linked evidence tied to its originating call

* Reconcile application mappings and expose original evidence hashes

* test: verify selected catalog rows against original replies

* fix(cli): recover incomplete reviews and preserve selected evidence rows

* fix(cli): preserve wire evidence and verify finding citations

* Finalize from approved submissions and explain remaining uses

* fix(cli): restore coordinator recovery, independent review and report contracts

* Review withdrawals under the original dependency assessment ID

* test(cli): compare trace progress with completed search scopes

* Recheck dependency coverage after concurrent investigation changes

* Preserve exploratory scope explanations during dependency review

* feat(cli): track shared source work in dependency investigations

* Include shared source work in final coverage checks

* Require deciding evidence on the caller it establishes

* Preserve generic MCP search outcomes and scopes in dependency reports

* Share pinned source notes between dependency investigators

* Ship the source worklist and search audit modules

* refactor(cli): name the dependency coordinator for its ability to resume

* refactor(cli): simplify the tools for dependency investigations

* fix(cli): keep investigation tool arguments visible to Codex and reuse the evidence store

* fix(cli): send missing verdict citations back to the reviewer

* fix(cli): verify caller bindings and input flow across investigation steps

* fix(cli): require direct citations for asserted runtime facts on every use

* test(cli): verify failed catalog lookups without a timed source scan

---------

Co-authored-by: utsav-oai <348536218+utsav-oai@users.noreply.github.com>
2026-11-19 11:10:07 -08:00
utsav-oaiandutsav-oai 5353212b03 test(cli): evaluate dependency investigations across public fixtures (#2716)
* feat(cli): add independently reviewed dependency checks

* Compare frozen Python advisory versions as releases

* fix(cli): bind unnamed root manifests to observed services

* test(cli): evaluate dependency investigations across public fixtures

* test(sdk): bound the budget wait after the mock scan starts

* test(cli): exercise MCP evidence and missing caller access

* Bind graded citations to the approved use evidence

---------

Co-authored-by: utsav-oai <348536218+utsav-oai@users.noreply.github.com>
2026-11-19 07:28:56 -08:00
dependabot[bot]andMichael D'Angelo a1e56b73a5 chore(deps): bump the codex group across 3 directories with 2 updates (#2723)
* chore(deps): bump the codex group across 3 directories with 2 updates

Bumps the codex group with 1 update in the /evals/triage-finding directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript).
Bumps the codex group with 1 update in the /plugins/codex-security/mcp-app directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript).
Bumps the codex group with 2 updates in the /sdk/typescript directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript) and [@openai/codex](https://github.com/openai/codex/tree/HEAD/codex-cli).


Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

Updates `@openai/codex` from 0.167.1 to 0.170.0

Updates `@openai/codex-sdk` from 0.167.1 to 0.170.0

---
updated-dependencies:
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.170.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: codex
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix(container): record the Wolfi source for Codex 0.170.0

* test(sdk): keep remote Git fetches out of provider fixtures

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Michael D'Angelo <mdangelo@openai.com>
2026-11-18 10:48:04 -08:00
dependabot[bot]andMichael D'Angelo b1ae8bf6a0 chore(deps): bump the codex group across 3 directories with 2 updates (#2626)
* chore(deps): bump the codex group across 3 directories with 2 updates

Bumps the codex group with 1 update in the /evals/triage-finding directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript).
Bumps the codex group with 1 update in the /plugins/codex-security/mcp-app directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript).
Bumps the codex group with 2 updates in the /sdk/typescript directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript) and [@openai/codex](https://github.com/openai/codex/tree/HEAD/codex-cli).


Updates `@openai/codex-sdk` from 0.167.1 to 0.167.2

Updates `@openai/codex-sdk` from 0.167.1 to 0.167.2

Updates `@openai/codex-sdk` from 0.167.1 to 0.167.2

Updates `@openai/codex` from 0.167.1 to 0.167.2

---
updated-dependencies:
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.167.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.167.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.167.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
- dependency-name: "@openai/codex"
  dependency-version: 0.167.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix(container): record the Wolfi source for Codex 0.167.2

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Michael D'Angelo <mdangelo@openai.com>
2026-11-18 10:17:04 -08:00
Michael D'Angelo a881fe1a5d feat(plugin): guide Codex through scanner imports and workbench publication (#2604)
* feat(plugin): guide Codex through scanner acquisition and reviewed publication

* docs(plugin): name the stored publication calls and explain partial imports
2026-11-11 11:14:49 -08:00
dependabot[bot]andMichael D'Angelo fc8240e154 chore(deps): update the Codex CLI and SDK to 0.167.1 (#2600)
* chore(deps): bump the codex group across 3 directories with 2 updates

Bumps the codex group with 1 update in the /evals/triage-finding directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript).
Bumps the codex group with 1 update in the /plugins/codex-security/mcp-app directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript).
Bumps the codex group with 2 updates in the /sdk/typescript directory: [@openai/codex-sdk](https://github.com/openai/codex/tree/HEAD/sdk/typescript) and [@openai/codex](https://github.com/openai/codex/tree/HEAD/codex-cli).


Updates `@openai/codex-sdk` from 0.167.0 to 0.167.1

Updates `@openai/codex-sdk` from 0.167.0 to 0.167.1

Updates `@openai/codex-sdk` from 0.167.0 to 0.167.1

Updates `@openai/codex` from 0.167.0 to 0.167.1

---
updated-dependencies:
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.167.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.167.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
- dependency-name: "@openai/codex-sdk"
  dependency-version: 0.167.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
- dependency-name: "@openai/codex"
  dependency-version: 0.167.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: codex
...

Signed-off-by: dependabot[bot] <support@github.com>

* fix(wolfi): record the source for the Codex 0.167.1 binary

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Michael D'Angelo <mdangelo@openai.com>
2026-11-11 05:54:27 -08:00
dependabot[bot] 6a6e8dc9ac chore(deps): bump fast-xml-parser from 5.11.1 to 5.12.0 in /evals/triage-finding (#2587)
chore(deps): bump fast-xml-parser in /evals/triage-finding

Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 5.11.1 to 5.12.0.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v5.11.1...v5.12.0)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-version: 5.12.0
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-10 23:05:52 -08:00
dependabot[bot] 13f70eb628 chore(deps): bump node-forge from 1.4.2 to 1.4.3 in /evals/triage-finding (#2588)
chore(deps): bump node-forge in /evals/triage-finding

Bumps [node-forge](https://github.com/digitalbazaar/forge) from 1.4.2 to 1.4.3.
- [Changelog](https://github.com/digitalbazaar/forge/blob/main/CHANGELOG.md)
- [Commits](https://github.com/digitalbazaar/forge/compare/v1.4.2...v1.4.3)

---
updated-dependencies:
- dependency-name: node-forge
  dependency-version: 1.4.3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-11-10 23:05:41 -08:00
Michael D'AngeloandCodex 5f5b5f225e docs(plugin): add a guide to security skills (#2586)
* docs(plugin): add a guide to security skills

* docs(plugin): simplify the skills index

* docs(plugin): organize skills by the task and evidence at hand

* docs(plugin): use plainer language in the skills guide

* test(evals): enumerate skill directories when preparing routing cases

* docs(plugin): list each security skill under its task

* docs(plugin): clarify policy and threat model outputs

---------

Co-authored-by: Codex <codex@users.noreply.github.com>
2026-11-10 21:07:29 -08:00
ianw-oaiandmldangelo-oai e90a30ac25 fix(scan): reduce setup and tool output in Standard scans (#2046)
* fix(scan): reduce setup and tool output in Standard scans

* fix(workbench): keep policy paths optional for scan lookups

* fix(sdk): retain the preflight callback before scan dispatch

* fix(workbench): only advertise scoped inventory for Standard scans

* docs(workbench): explain optional scope report failures

* fix(workbench): preserve the Deep Scan registration response

* test(workbench): use the current scan context request in the Deep Scan fixture

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-10 15:26:19 -08:00
dependabot[bot] 1579aeb514 chore(deps): update semver to 7.8.6 across SDK and tooling (#2562)
Align the SDK, mutation tools and triage eval locks on the comparator parsing fix.
2026-11-10 06:56:07 -08:00
dependabot[bot] 985a3e577f chore(deps): update pdfjs-dist to 6.5.438 in the TypeScript SDK (#2484) 2026-11-09 04:15:31 -08:00
Michael D'Angelo 7bffa9552e fix(evals): fetch calibration revisions as source refs (#2425) 2026-11-09 04:11:41 -08:00
Michael D'AngeloandMichael D'Angelo 6e677445f9 feat(imports): publish Guardian findings and clarify scanner evidence (#2377)
* docs(imports): correct scanner results and ticket intake checks

* refactor(imports): reuse scanner severity mappings

* feat(imports): publish selected Semgrep Guardian findings to Cloud

* feat(cli): show readable imported findings in the terminal

* docs(imports): explain scanner fields and source references

---------

Co-authored-by: Michael D'Angelo <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-08 07:40:48 -08:00
Michael D'Angelo 2d50d7aff8 chore(deps): reduce the dependency tree for evals, SDK and tooling (#2409)
* chore(deps): reduce the dependency tree for evals, SDK and tooling

* docs(evals): explain how to enable optional Promptfoo peers
2026-11-06 18:08:28 -08:00
dependabot[bot] 9b3ce7a08d chore(deps): update Codex SDK and CLI to 0.167.0 (#2398)
Align the SDK, MCP app, and eval dependency trees and record the source revision of the Linux x64 binary for Wolfi packaging.
2026-11-06 07:46:26 -08:00
Michael D'Angelo 4d83ce9195 refactor: share workbench arguments and simplify SDK and eval workflows (#2325)
* Simplify workbench dispatch, SDK helpers, and their test fixtures

* test(sdk): keep distinct progress matrix helpers

* test(sdk): expect canceled lifecycle for aborted component scans
2026-11-05 01:28:44 -08:00
Michael D'Angelo 258d7a6c33 docs: make scan and integration guides evergreen (#2350) 2026-11-05 01:26:22 -08:00
Michael D'Angelo 366093f77b fix(deep-scan): report completed audits and batch consolidation (#2305)
* fix(deep-scan): report completed audits and batch consolidation

* fix(deep-scan): include measured usage in the completion receipt

* docs(deep-scan): use the completion receipt for final reporting

* ci: retry managed Code Quality after GitHub installation rate limit

* test(deep-scan): restore the coordinator stop error import

(cherry picked from commit 7630eea34c)
2026-11-04 15:30:51 -08:00
Michael D'Angelo 6de45f81ac feat(import): collect and import Checkmarx SAST findings (#2269)
* feat(import): collect and import Checkmarx SAST findings

* fix(import): bind Checkmarx evidence and isolate vendor collection

* fix(import): protect collector inputs and preserve upload retries

* fix(import): isolate CxFlow startup and validate retained scan scope

* fix(import): constrain authenticated collection and verify projected evidence

* fix(import): preserve trusted startup and match Checkmarx repository scope

* fix(import): reap vendor processes interrupted during startup

* fix(import): isolate CxFlow credentials and preserve Checkmarx report scope

* fix(import): verify Checkmarx collector scope and credential source

* refactor(import): simplify Checkmarx collection and repository checks

* refactor(import): verify Checkmarx scan scope while reading occurrence evidence

* Exclude in-flight schema writes from eval runtime staging
2026-11-04 13:37:09 -08:00
Michael D'Angeloandmldangelo-oai 2160e38340 chore(deps): refresh triage eval transitive dependencies (#2293)
Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-04 10:15:05 -08:00
dependabot[bot] d95e55303d chore(deps): bump the triage eval OpenCode SDK to 1.19.5 (#2281)
Upgrade @opencode-ai/sdk to 1.19.5 in the triage eval harness. Keep Promptfoo 0.124.1 because 0.125.1 rejects the pinned Codex SDK at runtime.
2026-11-04 05:44:12 -08:00
ianw-oaiandmldangelo-oai cb92c4fb41 feat!: deep scan upgrade (#2118)
* refactor(deep-scan): merge repeated Standard scans in the host

* test(deep-scan): cover comparison turns and resumed discovery

* refactor(deep-scan): simplify finding counts and receipt handling

* test(deep-scan): separate comparison and runtime test registration

* test(deep-scan): exercise supported turns when replaying saved profiles

---------

Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-03 17:48:49 -08:00
683a915d3d feat(plugin): review agent skills before installation (#2088)
* feat(plugin): review agent skills before installation

* docs(evals): reproduce skill review boundary cases

---------

Co-authored-by: Michael D'Angelo <269034524+mldangelo-oai@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
2026-11-02 18:23:14 -08:00
Michael D'Angelo d5177fa4f7 fix(plugin): honor signed-in tracker connections for finding reads (#2212)
Use the selected Jira, Linear, or GitHub connection for scoped ticket reads. Verify the active GitHub account when reading from a source or tracking to a destination.
2026-11-02 16:42:22 -08:00
Michael D'Angelo cb63f2e2cb fix(plugin): reuse scoped GitHub connections for finding intake (#2223)
* fix(plugin): reuse scoped GitHub connections for finding intake

* fix(plugin): pin paginated GitHub reads and isolate intake checks

* test(evals): reject incomplete GitHub alert intake plans
2026-11-02 04:23:26 -08:00
Michael D'Angelo 6942ebf3ef fix(scan): restore concrete discovery guidance for Standard and Deep scans (#2246)
* fix(scan): restore concrete discovery guidance for Standard and Deep scans

* fix(evals): grade role-labelled code evidence at affected lines
2026-11-02 02:59:56 -08:00
e936fa9e29 test(evals): verify findings survive scan completion (#2150)
* test(evals): cover finding survival through canonical completion

* test(evals): check deferred work in the archived checkpoint

* test: exercise validation survival through the shipped draft tool

* test: isolate workbench state and preserve deferred candidates

* test(evals): verify checkpoint contents and report sections

* test(evals): distinguish candidate and rule identities

* test(evals): verify both draft checkpoints retain findings

---------

Co-authored-by: Michael D'Angelo <mdangelo@openai.com>
Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-02 01:46:45 -08:00
Michael D'Angelo 627eef708f refactor(evals): parse fenced triage results in one pass (#2214) 2026-11-01 15:19:58 -08:00
Michael D'Angeloandmldangelo-oai a43a30db9f test(evals): share intake grading and discovery fixtures (#2184)
Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-11-01 01:36:59 -07:00
dependabot[bot] eb263134e9 chore(deps): update Codex SDK and CLI to 0.166.0 (#2154)
Update the Codex SDK and CLI pins to 0.166.0 and record the matching upstream source for the Wolfi native payload.
2026-10-30 08:44:17 -07:00
dependabot[bot] 474d0a0665 chore(deps): update OpenCode SDK and Bun types (#2157)
Update the evaluation OpenCode SDK to 1.19.4 and the Bun development types to 1.4.4.
2026-10-30 08:11:55 -07:00
Michael D'Angeloandmldangelo-oai 607038e139 fix: accept UTF-8 BOMs in scan inputs and calibration datasets (#2151)
Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-10-30 06:46:46 -07:00
Michael D'Angelo 5f5ccd898a fix(evals): update vulnerable triage dependencies (#2142) 2026-10-29 16:17:32 -07:00
Michael D'AngeloandMichael D'Angelo 45228eac44 feat: resolve dependency alerts (#2084)
* feat: resolve dependency alerts through existing security workflows

* refactor: simplify dependency alert resolution

* fix: keep dependency alert assessment read-only

---------

Co-authored-by: Michael D'Angelo <269034524+mldangelo-oai@users.noreply.github.com>
2026-10-28 17:32:48 -07:00
dependabot[bot] b0a8db485c chore(deps): upgrade Codex CLI and SDK to 0.165.0 (#2107)
Update the TypeScript SDK, MCP app, and triage evals together.
2026-10-28 09:25:23 -07:00
Michael D'Angelo 9fe805efa9 test(evals): drop redundant triage instruction wording checks (#2074) 2026-10-27 15:24:25 +01:00
dependabot[bot] 2d2e86680d chore(deps): bump fast-uri to 3.1.9 in the triage eval (#2063)
Update the triage eval lockfile to fast-uri 3.1.9 within Ajv's existing version range.
2026-10-27 07:53:09 +05:30
ianw-oai 621bad47e6 refactor!: simplify scan completion and recovery (#1762) 2026-10-26 17:19:54 +00:00
Michael D'Angeloandmldangelo-oai b3e9d40f5a test(tooling): reduce repeated Action and eval setup (#2040)
Co-authored-by: mldangelo-oai <269034524+mldangelo-oai@users.noreply.github.com>
2026-10-26 22:06:56 +05:30
Michael D'Angelo 9836313403 chore(deps): update ip-address in triage evals (#2034) 2026-10-26 20:16:39 +05:30
Michael D'Angelo 30fd1851b1 test: retain replay, SARIF, and credential coverage (#1994)
* test: retain replay, SARIF, and credential coverage

* test: time launcher selection and saved replay separately
2026-10-26 01:12:07 +05:30
Michael D'Angelo 3dfed19297 test: reuse triage replay builds and exercise native Action SARIF (#1977) 2026-10-25 19:10:49 +08:00
Michael D'Angelo f50b6aeb28 test(evals): isolate the Promptfoo version fixture (#1953) 2026-10-25 12:07:08 +08:00
Michael D'Angelo 72a48522d3 chore(deps): refresh triage eval transport dependencies (#1935)
Refresh the triage eval lockfile within existing dependency ranges. All seven versions satisfy the publication cooldown. Frozen installs, SDK and native builds, deterministic contracts, configuration validation, transport smoke checks, and current-head CI passed. Existing residual audit advisories remain documented in the pull request.
2026-10-25 09:33:36 +08:00
Michael D'Angelo 7a5ea281f2 docs(evals): document the deterministic triage CI checks (#1932) 2026-10-25 09:01:53 +08:00
Michael D'AngeloandMichael D'Angelo 0aeb39d501 test(evals): add SSRF discovery and an allowlisted control (#1917)
Co-authored-by: Michael D'Angelo <269034524+mldangelo-oai@users.noreply.github.com>
2026-10-24 22:34:31 +08:00