mirror of https://github.com/NVIDIA/OpenShell.git synced 2026-10-13 04:51:00 +08:00

Files

T

History

Evan LezarandDrew Newberry 1e1a8b5810 test(e2e): keep lifecycle sandboxes running (#3128 )

* test(e2e): keep lifecycle sandboxes running

Signed-off-by: Evan Lezar <elezar@nvidia.com>

* test(e2e): cover sandbox terminal lifecycle semantics

Signed-off-by: Drew Newberry <anewberry@nvidia.com>

* test(e2e): synchronize detached main exit checks

Signed-off-by: Drew Newberry <anewberry@nvidia.com>

---------

Signed-off-by: Evan Lezar <elezar@nvidia.com>
Signed-off-by: Drew Newberry <anewberry@nvidia.com>
Co-authored-by: Drew Newberry <anewberry@nvidia.com>

2026-09-02 18:58:02 +00:00

existing-endpoint-auto-approve.sh

fix(policy): validate the applicable advisor candidate (#2850 )

2026-08-21 19:05:53 +00:00

mechanistic-smoke.sh

test(e2e): keep lifecycle sandboxes running (#3128 )

2026-09-02 18:58:02 +00:00

policy.template.yaml

feat: agent-driven policy management MVP (#1151 )

2026-05-08 17:14:27 -07:00

README.md

fix(policy): validate the applicable advisor candidate (#2850 )

2026-08-21 19:05:53 +00:00

sandbox-runner.sh

fix(e2e): clean up temp files in sandbox-runner on exit (#1647 )

2026-06-01 15:35:11 +00:00

test.sh

test(e2e): keep lifecycle sandboxes running (#3128 )

2026-09-02 18:58:02 +00:00

wait-smoke.sh

test(e2e): keep lifecycle sandboxes running (#3128 )

2026-09-02 18:58:02 +00:00

README.md

Policy Advisor end-to-end test

Deterministic, no-LLM exercise of the agent-driven policy loop:

Start a sandbox with a read-only GitHub L7 policy.
From inside the sandbox, attempt a GitHub contents PUT and assert OpenShell returns a structured policy_denied 403.
Submit a narrow addRule proposal through http://policy.local/v1/proposals.
Approve the draft from the host and retry until the write succeeds.

This proves the proxy, the structured deny body, the policy.local HTTP API, the gateway proposal path, and the hot-reload of approved rules — without involving an LLM. The user-facing demo (examples/agent-driven-policy-management/) runs the same loop with Codex driving from inside the sandbox.

Run it

Run against an ephemeral Docker gateway:

DEMO_GITHUB_OWNER=<your-handle> \
DEMO_GITHUB_REPO=openshell-policy-demo \
e2e/with-docker-gateway.sh bash -lc '
  target/debug/openshell settings set --global \
    --key agent_policy_proposals_enabled \
    --value true \
    --yes
  OPENSHELL_BIN="$PWD/target/debug/openshell" bash e2e/policy-advisor/test.sh
'

To keep the sandbox for debugging, start a local gateway first with mise run gateway:docker, then run:

target/debug/openshell settings set --global \
  --key agent_policy_proposals_enabled \
  --value true \
  --yes

OPENSHELL_GATEWAY=docker-dev \
OPENSHELL_BIN="$PWD/target/debug/openshell" \
DEMO_KEEP_SANDBOX=1 \
DEMO_GITHUB_OWNER=<your-handle> \
DEMO_GITHUB_REPO=openshell-policy-demo \
bash e2e/policy-advisor/test.sh

Requires Docker, agent_policy_proposals_enabled=true, and a GitHub token with contents write on the repository. The test auto-resolves the token from DEMO_GITHUB_TOKEN, GITHUB_TOKEN, GH_TOKEN, or gh auth token.

Mechanistic smoke

Lightweight regression for the L4 CONNECT deny → mechanistic chunk pipeline. No GitHub token or LLM required.

mise run e2e:mechanistic-smoke

Or manually against a running gateway with agent_policy_proposals_enabled=true:

OPENSHELL_BIN=target/debug/openshell bash e2e/policy-advisor/mechanistic-smoke.sh

The #2821 regression additionally verifies that a denial on an existing inspected endpoint becomes a binary expansion, auto-approves, hot-reloads, and does not downgrade the endpoint to L4:

mise run e2e:mechanistic-existing-endpoint