-
-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
The latest version of Bitsandbytes now includes support for XPU on Windows and Linux. It should therefore be installed by default when an Intel GPU is detected.
In addition, there is now a third-party package containing Metal kernels. It can be implemented separately using code from the upstream integration PR (bitsandbytes#1853). This will make NF4 quantization available on all platforms except ROCm.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels