CrashLens: local GPU log triage for OOM, NCCL and Xid errors
PyTorch Forums
CrashLens: local GPU log triage for OOM, NCCL and Xid errors
Hi everyone — I’m Vivaan, building ThermaCompute AI to help teams understand GPU failures and wasted compute. Our current work is passive diagnostics: turning logs and telemetry into evidence engineers can investigate, without changing GPU settings. A failed training run can leave pages of logs and several errors pointing in different directions. Finding a useful starting point can take longer than spotting the final timeout. So we made CrashLens to turn that log into a focused investigation. C...
0 comments
No comments yet.