c7241e00be
The 5090 kept about 1.5 GB of CUDA allocator pool after evicting every model, so a card that fits flux2-dev refused it (30510 MB free reported, 32090 MB in a fresh process). Admission now trims the pool when the last resident is gone and re-measures before refusing; usable VRAM is measured after the same trim; the refusal names the pool it released. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| kernels | ||
| src | ||
| tests/data | ||
| build.rs | ||
| Cargo.toml | ||