unilab.training.cuda_process_sharing.resolve_mps_visibility_entries¶
- unilab.training.cuda_process_sharing.resolve_mps_visibility_entries(entries, *, run_command=<function run>)[source]¶
Return
CUDA_VISIBLE_DEVICESentries with numeric indices as UUIDs.A per-GPU MPS server enumerates only its own device, so a client whose one-entry visibility mask holds a nonzero numeric index overruns that namespace and fails CUDA initialization with “No CUDA GPUs are available”. UUID entries survive that server-side remapping, so an explicit
training.cuda_process_sharing=mpslaunch normalizes visibility before CUDA latches the mask. Non-numeric entries (UUID, MIG,-1) pass through unchanged; the returned UUIDs keep thenvidia-smidisplay form.