Skip to content

Polish GPU dashboard and inference recovery checks - #92

Merged
saiyam1814 merged 1 commit into
mainfrom
codex/inference-lab-polish
Nov 15, 2026
Merged

saiyam1814 merged 1 commit into
mainfrom
codex/inference-lab-polish

Conversation

@saiyam1814

Copy link
Copy Markdown
Owner

Dashboard polling replaces GPU controls and can discard keyboard focus. Preserve focus on the Mac hardware button and GPU details summary, add accessible GPU control labels, and make the explicit inference preset choose at least four vCPUs per node with 4 GiB worker memory. Larger CPU selections and sizing entered before enabling GPU mode are preserved.

Align the serving lab with its 35-minute startup deadline, wait for LoadBalancer health before a bounded completion request, and explain Pod-scoped model storage and download diagnostics. The GPU runtime profile now pins its inference workload to the worker it restarts and repeats completion, Venus identity, and full layer-offload checks after worker restart and whole-cluster resume without redeploying the workload.

Validation:

  • Complete make ci passed, including race tests, vet, embedded asset checks and builds.
  • Updated dashboard JavaScript behavior checks cover focus retention/removal and explicit sizing; actual-browser checks verified native M1 Max / Metal 4 inventory, focus across polling, CPU 1 to 4, and preservation of CPU 6.
  • Shellcheck, shell syntax and diff checks passed. Five offline shell scenarios exercised initial deployment, recovery, failed health, invalid completion and missing GPU offload; initial-only hostname patch and ordering were checked.
  • Two independent reviews completed; both reported no remaining blockers after their findings were fixed.

The GPU hardware recovery matrix was not rerun for this polish. Native inference and vLLM remain research, outside public feature documentation. No release, tag or Homebrew update is part of this PR.

@saiyam1814
saiyam1814 merged commit 7133d37 into main Nov 15, 2026
2 checks passed
@saiyam1814
saiyam1814 deleted the codex/inference-lab-polish branch November 15, 2026 20:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant