[Feature Request] SDNQ Quantization #61
Description
SDNQ is a quantizer for Diffusers that was originally developed for SD.Next. It includes a cross-platform implementation of SVDQuant, previously only available in the NVIDIA-specific Nunchaku, which supports near-lossless 4-bit compression. This should allow for inference with ~12GB of VRAM.
Looking at the current codebase, it appears that Diffusers is primarily utilized for Z-Image rather than LTX itself. It will probably be necessary to wait for the recently merged diffusers#13217 PR to be released in the next version of Diffusers before this FR can be actioned.
Update 3/23: Diffusers PR merged but not yet released