mirror of
https://github.com/headroomlabs-ai/headroom.git
synced 2026-11-22 13:29:19 +08:00
## Description Every third-party action in `.github/` ran from a version tag like `actions/checkout@v7`. A tag can be moved to other code at any time. That is how `tj-actions/changed-files` leaked CI secrets from ~23,000 repos in March 2025. Here a moved tag would run with the release job's PyPI OIDC token (`id-token: write`) and the Docker job's `packages: write` token. Pinning to a commit SHA closes that, and a new test keeps it closed. Closes # ## Type of Change - [ ] Bug fix (non-breaking change that fixes an issue) - [ ] New feature (non-breaking change that adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) - [ ] Documentation update - [ ] Performance improvement - [x] Code refactoring (no functional changes) ## Changes Made - All 195 third-party `uses:` refs in 25 files now name the commit their tag points to today, with the version as a comment: `actions/checkout@3d3c42e5... # v7.0.1`. No action version changes. - Dependabot's existing `github-actions` config updates SHA pins and their version comments, so the pins stay current. - Pin dtolnay/rust-toolchain stable and 1.95.0 branches to their existing commit heads. The stable action retains its runtime toolchain input/default; the 1.95.0 action embeds toolchain: 1.95.0. This preserves each call site's existing toolchain selection. - New `test_every_action_is_pinned_to_a_commit_sha` in `scripts/tests/test_ci_workflow.py` fails on any tag-pinned action and lists each one. - Three tests in `tests/test_release_workflows.py` matched the old tag text (`setup-buildx-action@v4`, `gh-action-pypi-publish@vX.Y.Z`, `release-please-action@v4/v5`). They now match the SHA pin and its version comment. ## Testing - [x] Unit tests pass (`pytest`) - [x] Linting passes (`ruff check .`) - [ ] Type checking passes (`mypy headroom`) - [x] New tests added for new functionality - [x] Manual testing performed ### Test Output ```text $ uv run --frozen --extra dev pytest -q scripts/tests/test_ci_workflow.py scripts/tests/test_pr_health_workflow.py scripts/tests/test_normalize_release_pr_bodies.py tests/test_release_workflows.py 87 passed in 0.87s $ uv run --frozen --extra dev pytest -q scripts/tests/test_pr_health_labels.py scripts/tests/test_version_sync.py tests/test_cli/test_wrap_copilot.py tests/test_learn/test_subagent_scanning.py tests/test_plugin_manifests.py tests/test_pr208_changes.py 114 passed in 1.32s $ uvx ruff check scripts/tests/test_ci_workflow.py tests/test_release_workflows.py && uvx ruff format --check <same> All checks passed! ``` ## Real Behavior Proof - Environment: macOS, Python 3.12 via `uv run --frozen --extra dev`, branch cut from `main` atc01cf07d. - Exact command / steps: resolved each tag with `git ls-remote --tags --heads https://github.com/<owner>/<repo>` (peeled for annotated tags), rewrote only the `uses:` lines, then ran the test files above and a `yaml.safe_load` over every file in `.github/`. - Observed result: 195 lines changed, 195 removed, no other line touched (mixed LF/CRLF in `pr-health.yml` kept). All 201 tests pass. On `main` the new test fails and lists the unpinned refs. - Not tested: `scripts/validate-workflows.sh` (actionlint plus act dry runs) was not run locally. The `workflow-validation` job runs it on this PR. ## Runtime Rollout Safety - Rollout-managed feature(s): None. CI workflow files and their tests only. - Minimum rollout channel: N/A, no runtime code changes. - Stable/default behavior changed: No. Each SHA is the commit its tag points to today. - Kill switch / disable path: N/A, revert the commit. - Unsafe override required: No. - Qualification impact: None. - Rollback path: Revert this PR. ## Review Readiness - [x] I have performed a self-review - [x] This PR is ready for human review ## Checklist - [x] My code follows the project's style guidelines - [x] I have performed a self-review of my code - [x] I have commented my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [x] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [x] I did **not** edit `CHANGELOG.md` — it is generated by release-please from my Conventional Commit PR title (a CI guard enforces this) ## Screenshots (if applicable) N/A, no UI change. ## Additional Notes - mypy and docs are N/A: no `headroom/` code or documented behavior changes. - Dependabot does not bump branch pins, so the two `dtolnay/rust-toolchain` pins stay on today's branch head until someone moves them. That action rarely changes. 🤖 Generated with [Claude Code](https://claude.com/claude-code) <!-- devin-review-badge-begin --> --- <a href="https://app.devin.ai/review/headroomlabs-ai/headroom/pull/4671" target="_blank"><picture><source media="(prefers-color-scheme: dark)" srcset="https://static.devin.ai/assets/gh-devin-review-dark.svg?v=4"><img src="https://static.devin.ai/assets/gh-devin-review-light.svg?v=4" alt="Devin Review"></picture></a> <!-- devin-review-badge-end --> ### Maintainer current-main requalification Exact head `57b7edd8d05b6dc5e3bc4eac1dff55f21519afe8`, upstream main `c01cf07d943d816cfd9d97e6838ed4e38f1ff9a4`. Reviewed the27-file delta and existing discussion/Devin no-issues result against current upstream mainc01cf07d94, already included in the contributor head. Independent full-workflow comparison proves only uses refs/comments change across the25 workflow/action files. All195 replaced refs resolve exactly to their original upstream tag/branch commits (29 unique pins across26 repositories), with annotated tags peeled; no mismatches. Pinned dtolnay action source independently confirms stable runtime default versus embedded1.95.0 branch behavior, preserving toolchain selection.87 workflow/release tests and113 adjacent tests pass,1skip; changed Python lint/format passes. Maintainer fix only removes CRLF endings on two edited pr-health lines to clear whitespace; provenance reverified afterward. No contributor workflow logic altered. Description is corrected to explain embedded1.95.0 semantics. No publish/release workflow execution claimed; full hosted qualification must run on this new mechanical-fix head. Maintainers handle CI. Nothing merged. Exact-head hosted checks are being handled by maintainers. No new finding in the reviewed scope; formal approval awaits exact-head hosted qualification; nothing merged. --------- Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com> Co-authored-by: JerrettDavis <mxjerrett@gmail.com>
169 lines
5.9 KiB
YAML
169 lines
5.9 KiB
YAML
name: Network Diff Capture
|
|
|
|
on:
|
|
workflow_dispatch:
|
|
|
|
permissions:
|
|
contents: read
|
|
|
|
concurrency:
|
|
group: network-diff-capture-${{ github.ref }}
|
|
cancel-in-progress: ${{ github.ref != 'refs/heads/main' }}
|
|
|
|
env:
|
|
PY_VERSION: "3.12"
|
|
|
|
jobs:
|
|
offline:
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 20
|
|
steps:
|
|
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
|
|
|
|
- uses: actions/setup-python@6d4fd22b20465ccc0f7354476588e8df7c9ca0e0 # v7.1.0
|
|
with:
|
|
python-version: ${{ env.PY_VERSION }}
|
|
|
|
- name: Install offline test tools
|
|
run: |
|
|
python -m pip install --upgrade pip
|
|
python -m pip install \
|
|
'tiktoken>=0.5.0' \
|
|
'pydantic>=2.0.0' \
|
|
'litellm==1.82.3' \
|
|
'click>=8.1.0' \
|
|
'rich>=13.0.0' \
|
|
'opentelemetry-api>=1.24.0' \
|
|
'ast-grep-cli>=0.30.0' \
|
|
'fastapi>=0.100.0' \
|
|
'uvicorn>=0.23.0' \
|
|
'httpx[http2]>=0.24.0' \
|
|
'openai>=2.14.0' \
|
|
'mcp>=1.0.0' \
|
|
'magika>=0.6.0' \
|
|
'zstandard>=0.20.0' \
|
|
'websockets>=13.0' \
|
|
'onnxruntime>=1.24' \
|
|
'transformers>=4.30.0' \
|
|
'watchdog>=4.0.0' \
|
|
'sqlite-vec>=0.1.6' \
|
|
pytest ruff mypy
|
|
|
|
- name: Lint capture code
|
|
run: ruff check headroom/capture headroom/cli/capture.py tests/test_network_diff_capture.py
|
|
|
|
- name: Format check capture code
|
|
run: ruff format --check headroom/capture headroom/cli/capture.py tests/test_network_diff_capture.py
|
|
|
|
- name: Type-check capture code
|
|
run: mypy headroom/capture/network_diff.py headroom/cli/capture.py
|
|
|
|
- name: Run capture tests
|
|
run: python -m pytest tests/test_network_diff_capture.py
|
|
|
|
- name: Validate compose model
|
|
env:
|
|
ANTHROPIC_API_KEY: dummy
|
|
HEADROOM_PROXY_TOKEN: capture-proof
|
|
run: docker compose -f docker/differential-network-capture/docker-compose.yml --profile run config
|
|
|
|
- name: Build Claude Code runner image
|
|
env:
|
|
ANTHROPIC_API_KEY: dummy
|
|
HEADROOM_PROXY_TOKEN: capture-proof
|
|
run: docker compose -f docker/differential-network-capture/docker-compose.yml --profile run build claude-direct
|
|
|
|
- name: Smoke Claude Code runner image
|
|
run: docker run --rm -e CLAUDE_COMMAND="claude --version" headroom-network-diff-claude-direct:latest
|
|
|
|
live-anthropic:
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 90
|
|
needs: offline
|
|
env:
|
|
ANTHROPIC_API_KEY: ${{ secrets.ANTHROPIC_API_KEY }}
|
|
CLAUDE_PROMPT: "Summarize this repository in one sentence. Keep the answer under 30 words."
|
|
steps:
|
|
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
|
|
|
|
- uses: actions/setup-python@6d4fd22b20465ccc0f7354476588e8df7c9ca0e0 # v7.1.0
|
|
with:
|
|
python-version: ${{ env.PY_VERSION }}
|
|
|
|
- name: Install report dependencies
|
|
run: |
|
|
python -m pip install --upgrade pip
|
|
python -m pip install \
|
|
'tiktoken>=0.5.0' \
|
|
'pydantic>=2.0.0' \
|
|
'litellm==1.82.3' \
|
|
'click>=8.1.0' \
|
|
'rich>=13.0.0' \
|
|
'opentelemetry-api>=1.24.0' \
|
|
'ast-grep-cli>=0.30.0' \
|
|
'fastapi>=0.100.0' \
|
|
'uvicorn>=0.23.0' \
|
|
'httpx[http2]>=0.24.0' \
|
|
'openai>=2.14.0' \
|
|
'mcp>=1.0.0' \
|
|
'magika>=0.6.0' \
|
|
'zstandard>=0.20.0' \
|
|
'websockets>=13.0' \
|
|
'onnxruntime>=1.24' \
|
|
'transformers>=4.30.0' \
|
|
'watchdog>=4.0.0' \
|
|
'sqlite-vec>=0.1.6'
|
|
|
|
- name: Run live Claude Code differential capture
|
|
if: env.ANTHROPIC_API_KEY != ''
|
|
working-directory: docker/differential-network-capture
|
|
run: |
|
|
set -euo pipefail
|
|
HEADROOM_PROXY_TOKEN="$(openssl rand -hex 32)"
|
|
export HEADROOM_PROXY_TOKEN
|
|
mkdir -p captures
|
|
docker compose up -d --build mitm-direct mitm-headroom-upstream headroom-proxy mitm-headroom-client
|
|
trap 'docker compose --profile run down -v' EXIT
|
|
|
|
for i in $(seq 1 90); do
|
|
if docker compose exec -T headroom-proxy curl --fail --silent http://127.0.0.1:8787/readyz >/dev/null; then
|
|
break
|
|
fi
|
|
if [ "$i" -eq 90 ]; then
|
|
docker compose logs headroom-proxy
|
|
exit 1
|
|
fi
|
|
sleep 2
|
|
done
|
|
|
|
docker compose --profile run run --rm claude-direct
|
|
docker compose --profile run run --rm claude-headroom
|
|
|
|
- name: Report skipped live capture
|
|
if: env.ANTHROPIC_API_KEY == ''
|
|
run: |
|
|
echo "::warning title=Live network diff skipped::ANTHROPIC_API_KEY is not configured for this repository; offline harness checks ran, but live Claude Code capture was skipped."
|
|
mkdir -p docker/differential-network-capture/captures
|
|
cat > docker/differential-network-capture/captures/skipped.md <<'EOF'
|
|
# Live Network Diff Capture Skipped
|
|
|
|
`ANTHROPIC_API_KEY` is not configured for this repository.
|
|
EOF
|
|
|
|
- name: Generate network diff report
|
|
if: env.ANTHROPIC_API_KEY != ''
|
|
run: |
|
|
python -m headroom.cli capture network-diff \
|
|
--direct docker/differential-network-capture/captures/direct.jsonl \
|
|
--headroom docker/differential-network-capture/captures/headroom-client.jsonl \
|
|
--output docker/differential-network-capture/captures/report.md \
|
|
--json-output docker/differential-network-capture/captures/report.json
|
|
|
|
- name: Upload capture artifacts
|
|
if: always()
|
|
uses: actions/upload-artifact@cf430e030ddbb5b0abf93d22962f4752f3646cd9 # v7.0.2
|
|
with:
|
|
name: network-diff-capture-${{ github.run_number }}
|
|
path: docker/differential-network-capture/captures/
|
|
if-no-files-found: warn
|