Describe the bug
Investigate using AsyncDiff to split across GPUs and speed up inference.
https://github.com/czg1225/AsyncDiff
Reproduction steps
- Go to '...'
- Click on '....'
- Scroll down to '....'
- See error
Expected behaviour
No response
Severity
None
Screenshots / Live demo link
No response
OS
None
Running on
None
AI-worker version
No response
Additional context
No response