mirror of https://github.com/NVIDIA/OpenShell.git synced 2026-10-25 06:42:52 +08:00

Files

T

Simon Scatton 1959ea19be build(bazel): establish RFC 0012 Rust reference graph (#2414 )

Establish the Phase 1 reference implementation proposed by RFC 0012
while retaining the existing Cargo and Mise workflows during evaluation.

- pin Bazel 9.1.1 and configure Bzlmod, rules_rs, LLVM, protobuf, and
  Rust 1.95 toolchains
- import third-party crates from Cargo metadata and propagate the
  workspace version into Bazel targets
- add library, binary, proc-macro, unit-test, and integration-test
  targets across the supported Rust workspace crates and drivers
- generate protobuf Rust sources and descriptor sets under Bazel while
  preserving Cargo-compatible generated-code imports
- annotate aws-lc-sys and zstd-sys native dependencies, build Z3 4.15.2
  from source, and generate z3-sys bindings
- make CLI and procfs test fixtures available as explicit Bazel inputs
  without relying on fixed host binary paths
- define optimized release targets for Linux x86_64 and aarch64 CLI,
  sandbox, and gateway binaries, plus macOS aarch64 artifacts
- add Bazel, buildifier, and lcov to the Nix development environment

RFC: 0012 (rfc12 branch)
Refs: #2491

Signed-off-by: Simon Scatton <sscatton@nvidia.com>

2026-08-03 09:05:40 +00:00

src

fix: assorted byte-index slicing safety fixes (#2452 )

2026-07-27 14:38:09 +00:00

tests

fix(router): strip unsupported Anthropic beta fields from Vertex rawPredict body (#2465 )

2026-07-27 14:37:33 +00:00

BUILD.bazel

build(bazel): establish RFC 0012 Rust reference graph (#2414 )

2026-08-03 09:05:40 +00:00

Cargo.toml

feat(telemetry): add build-time option to compile out telemetry (#1845 )

2026-06-09 14:19:26 -07:00

README.md

docs(architecture): reset subsystem docs (#1184 )

2026-05-07 08:59:02 -07:00

README.md

openshell-router

openshell-router is the inference routing and upstream execution engine used by the sandbox proxy and gateway inference validation paths.

Responsibilities

Select an upstream route from a candidate set (based on protocol compatibility).
Forward raw HTTP requests to the selected upstream backend.
Normalize upstream failures into router-level errors (unauthorized, unavailable, protocol/internal errors).
Keep routing decision logic in one place so strategies can evolve (fallbacks, scoring, health-based routing).

Non-responsibilities

Authentication and sandbox identity.
Authorization and policy enforcement.
Persistence of routes/entities.
Loading sandbox or policy objects.

These are owned by openshell-server and openshell-sandbox.

Integration Contract

Current split:

openshell-server:
- authenticates user-facing inference configuration changes
- resolves managed route candidates from provider records
- validates backend endpoints
openshell-sandbox:
- intercepts https://inference.local
- detects the source inference protocol
- passes sanitized requests and resolved route candidates to the router
openshell-router:
- picks a route from candidates (proxy_with_candidates)
- forwards the HTTP request upstream and returns the raw response

Public APIs

Router::proxy_with_candidates(source_protocol, method, path, headers, body, &[ResolvedRoute])
- Filters candidates by protocol compatibility, then forwards the request to the first match.
- Preferred path for entity-driven server routing.

Notes

Route selection matches candidates by protocol field (e.g. openai_chat_completions).
Route selection is intentionally simple and will evolve.