[CUDA] Reduce use of managed memory#2725

Merged

awni merged 10 commits intomainfrom

async_cuda_malloc

Nov 6, 2025

Commits on Nov 5, 2025

Use async cuda malloc managed with cuda 13
Awni Hannun
committed
add pool threshold
Awni Hannun
committed
refactor for regular cuda malloc
Awni Hannun
committed
load eval gpu for cuda
Awni Hannun
committed
remove use of cuda pool, use cuda free async
Awni Hannun
committed
fix
Awni Hannun
committed
fix
Awni Hannun
committed
fix
Awni Hannun
committed
fix
Awni Hannun
committed
fix + comment
Awni Hannun
committed