[Possible Feature] Test Group Offloading #78
Description
Group Offloading is a recently added Diffusers feature that promises improved speeds over standard CPU offloading when configured correctly.
It may be worth testing Group Offloading with the various dgenerate architectures to see whether they are compatible with this offloading approach. As the documentation notes, "weight-dependent device casting of inputs [...] may clash with group offloading’s device casting mechanism".