mirror of https://github.com/NVIDIA/OpenShell.git synced 2026-10-16 05:20:22 +08:00

Files

T

History

Adel ZaaloukandClaude Opus 4.6 600bbae845 feat(ocsf): emit AI inference events via ai_operation profile on ApiActivity (#2664 )

Apply the official OCSF ai_operation profile (introduced in v1.8.0) to
ApiActivity [6003] events when the inference proxy routes a model call
through inference.local. Attaches an ai_model object (name, ai_provider)
and puts token counts and latency in unmapped fields.

ApiActivity [6003] is the schema-correct class for the ai_operation
profile in v1.8.0 (HttpActivity only gets it in v1.9.0). In Splunk CIM,
ApiActivity maps to the "Change" data model, naturally separating
inference events from regular HTTP proxy traffic.

Changes:
- Add AiModel object and ai_model field on BaseEventData
- Add ApiActivityEvent struct and ApiActivityBuilder
- Add emit_ai_inference in proxy.rs using ApiActivity with ai_operation
- Vendor OCSF v1.8.0 schemas including api_activity class, ai_model
  object, and ai_operation profile definitions
- Bump OCSF_VERSION to 1.8.0
- Update schema validation to skip profile-gated required fields

Shorthand: API:INFERENCE [INFO] claude-3-haiku via anthropic 701ms [POST /v1/messages]

Splunk/SIEM backward compatibility (v1.1/v1.3 CIM mapping) is tracked
separately in #2662 as a configurable serialization concern.

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-08-18 16:30:03 +00:00

src

feat(ocsf): emit AI inference events via ai_operation profile on ApiActivity (#2664 )

2026-08-18 16:30:03 +00:00

tests

fix(router): strip unsupported Anthropic beta fields from Vertex rawPredict body (#2465 )

2026-07-27 14:37:33 +00:00

BUILD.bazel

feat(bazel): add rustfmt checks to tests (#2599 )

2026-08-03 16:37:15 +00:00

Cargo.toml

feat(telemetry): add build-time option to compile out telemetry (#1845 )

2026-06-09 14:19:26 -07:00

README.md

docs(architecture): reset subsystem docs (#1184 )

2026-05-07 08:59:02 -07:00

README.md

openshell-router

openshell-router is the inference routing and upstream execution engine used by the sandbox proxy and gateway inference validation paths.

Responsibilities

Select an upstream route from a candidate set (based on protocol compatibility).
Forward raw HTTP requests to the selected upstream backend.
Normalize upstream failures into router-level errors (unauthorized, unavailable, protocol/internal errors).
Keep routing decision logic in one place so strategies can evolve (fallbacks, scoring, health-based routing).

Non-responsibilities

Authentication and sandbox identity.
Authorization and policy enforcement.
Persistence of routes/entities.
Loading sandbox or policy objects.

These are owned by openshell-server and openshell-sandbox.

Integration Contract

Current split:

openshell-server:
- authenticates user-facing inference configuration changes
- resolves managed route candidates from provider records
- validates backend endpoints
openshell-sandbox:
- intercepts https://inference.local
- detects the source inference protocol
- passes sanitized requests and resolved route candidates to the router
openshell-router:
- picks a route from candidates (proxy_with_candidates)
- forwards the HTTP request upstream and returns the raw response

Public APIs

Router::proxy_with_candidates(source_protocol, method, path, headers, body, &[ResolvedRoute])
- Filters candidates by protocol compatibility, then forwards the request to the first match.
- Preferred path for entity-driven server routing.

Notes

Route selection matches candidates by protocol field (e.g. openai_chat_completions).
Route selection is intentionally simple and will evolve.