Sean
@seangeng
had a box where nvidia-smi reported one model loaded but the process table showed two. turns out a crashed inference server can leave VRAM allocated without the PID surviving. health check saw memory usage and called it healthy.
0 reply
0 recast
0 reaction