mirror of
https://github.com/NVIDIA/OpenShell.git
synced 2026-10-18 05:39:50 +08:00
Piotr Mlocek
31d7ca53ff
Remove multi-route CRUD system and replace with single managed cluster route (inference.local). Key changes: - Remove inference route CRUD RPCs and CLI commands - Remove InspectForInference OPA action; policy is binary allow/deny - Introduce AuthHeader enum and InferenceProviderProfile in navigator-core - Router is now provider-agnostic: auth style carried on ResolvedRoute - Replace InferenceRouteSpec with ClusterInferenceConfig (2 fields vs 8) - Rename proto: routing_hint->name, SandboxResolvedRoute->ResolvedRoute, GetSandboxInferenceBundle->GetInferenceBundle, drop sandbox_id param - Rename RouteConfig.route -> RouteConfig.name; use inference.local - Add 'nemoclaw cluster inference update' for partial config changes - Delete stale navigator.inference.v1.rs checked-in proto file - Update architecture docs, agent skills, and CLI reference Closes #133
17 lines
525 B
Python
17 lines
525 B
Python
# SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
|
|
# SPDX-License-Identifier: Apache-2.0
|
|
|
|
from openai import OpenAI
|
|
|
|
client = OpenAI(api_key="dummy", base_url="https://inference.local/v1")
|
|
|
|
response = client.chat.completions.create(
|
|
model="router",
|
|
messages=[{"role": "user", "content": "Reply with exactly: NAV_OK"}],
|
|
temperature=0,
|
|
)
|
|
|
|
content = (response.choices[0].message.content or "").strip()
|
|
print(f"model={response.model}")
|
|
print(f"content={content}")
|