Why is it not working?

[MMMazart]

./wasmedge --dir .:. sd-api-server.wasm --model-name sd-v1.4 --model /mnt/data/zhangmingyang/t2i/models/stable-diffusion-v-1-4-GGUF/stable-diffusion-v1-4-Q8_0.gguf I executed this command, and the result is as follows, but when I send the request 'curl -X POST 'http://localhost:8080/v1/images/generations' --header 'Content-Type: application/json' --data '{"model": "sd-v1.4", "prompt": "A cute baby sea otter"}'', there is no response. What is going on?

[MMMazart]

现在它可以正常运行，我不知道是为什么。

[MMMazart]

另外一个问题是，stable-diffusion每次都是迅速响应，flux每次要加载很久，这是因为在加载模型吗？每次post请求，都需要重新加载flux模型吗？

[MMMazart]

另外一个问题是，stable-diffusion每次都是迅速响应，flux每次要加载很久，这是因为在加载模型吗？每次post请求，都需要重新加载flux模型吗？

时间都花费在了加载模型上

[apepkuss]

现在它可以正常运行，我不知道是为什么。

If no new log messages show on the screen, please check if the port you're using is in use or not.

另外一个问题是，stable-diffusion每次都是迅速响应，flux每次要加载很久，这是因为在加载模型吗？每次post请求，都需要重新加载flux模型吗？

The model is loaded ONLY at the stage of context initialization, and ONLY loaded once. Could you please share with us the following environment info?

• Operating system
• CPU
• Memory
• GPU and vRAM if present

Thanks a lot!

[MMMazart]

现在它可以正常运行，我不知道是为什么。

If no new log messages show on the screen, please check if the port you're using is in use or not.

另外一个问题是，stable-diffusion每次都是迅速响应，flux每次要加载很久，这是因为在加载模型吗？每次post请求，都需要重新加载flux模型吗？

The model is loaded ONLY at the stage of context initialization, and ONLY loaded once. Could you please share with us the following environment info?

• Operating system
• CPU
• Memory
• GPU and vRAM if present

Thanks a lot!

感谢您的回复！

• Operating system
  
• CPU
  
• Memory
  
  -GPU
  A100-SXM4-80GB

[MMMazart]

他每次会卡在这里重新加载。抱歉我操作失误关闭了这个issue

[MMMazart]

他每次会卡在这里重新加载。抱歉我操作失误关闭了这个issue

Thank you. This is very important to me.

[MMMazart]

他每次会卡在这里重新加载。抱歉我操作失误关闭了这个issue

Thank you. This is very important to me.

Flux1-dev is like this every time as well. 每次运行完，gpu显存就被释放了。

[apepkuss]

Thanks for the feedback. We'll check the issue ASAP. Thanks!