offload support

[zwukong]

Some models are very large ,like hunyuan image 3.0,can this method support offload ? i think it will be very cool without large amount of ram

[painebenjamin]

Hello! This is in the works. You can use the standard .cpu() or .to("cpu") to offload after loading from FlashPack, but it definitely will result in a large amount of RAM being consumed.

I'll update this issue when I have more to share. Thanks for bringing it up!

[zwukong]

Cool, disk offload will help a lot to the community. to("cpu") will lose that advantage i think, disk directly to gpu is great