Files
Divesh Chowdary 585bcf0b82 (Fix) ha sandbox resilience with k8s (#3644)
* fix(server): retry internal store updates on version conflict

- Re-read and reapply internal CAS updates (expected version 0) up to 5 times on conflict
- Client-supplied versions still fail on conflict
- Add concurrent-writer test

Signed-off-by: divesh <dgude@nvidia.com>

* fix(kubernetes): keep sandboxes running while the supervisor reconnects

- Treat a running but not-Ready supervisor Pod as degraded, not unavailable
- Report degraded sandboxes as not ready without suspending them
- Suspend only when the supervisor Pod is missing, terminated, or deleting
- Add availability test

Signed-off-by: divesh <dgude@nvidia.com>

* fix(kubernetes): skip fence generation check for suspended sandboxes

- Check the fence generation only for running or bootstrapping sandboxes
- Stop re-suspending stopped sandboxes and logging a warning every reconcile

Signed-off-by: divesh <dgude@nvidia.com>

* fix(kubernetes): rank degraded supervisor above unknown dependencies

- Report a degraded supervisor as unavailable even when another dependency read is unknown
- Extract dependency aggregation and readiness mapping into pure helpers
- Add mixed degraded and unknown regression test

Signed-off-by: divesh <dgude@nvidia.com>

---------

Signed-off-by: divesh <dgude@nvidia.com>
2026-09-25 18:10:55 +00:00
..