How are you running AnythingLLM?
AnythingLLM Desktop (Portable USB/SSD version)
What happened?
I am using the Portable AI USB build on an external 128GB SSD. Smaller models like Phi-3.5 Mini (3.8B) work perfectly. However, when I attempt to load larger models such as NemoMix Unleashed 12B or Qwen 2.5 7B, the chat fails immediately with the error:
llama runner process has terminated with exit code 2
System Specs:
RAM: 24 GB
Storage: 128 GB External SSD (Used for the Portable AI installation)
Internal Storage: 256 GB SSD + 1 TB HDD
OS: Windows 11
Steps to Reproduce:
Connect the external 128GB SSD.
Launch AnythingLLM via the start-windows.bat script.
In AnythingLLM settings, select NemoMix-local:latest or Qwen-2.5-7B.
Initiate a chat.
Observe the "exit code 2" error in the chat interface.
How are you running AnythingLLM?
AnythingLLM Desktop (Portable USB/SSD version)
What happened?
I am using the Portable AI USB build on an external 128GB SSD. Smaller models like Phi-3.5 Mini (3.8B) work perfectly. However, when I attempt to load larger models such as NemoMix Unleashed 12B or Qwen 2.5 7B, the chat fails immediately with the error:
llama runner process has terminated with exit code 2
System Specs:
RAM: 24 GB
Storage: 128 GB External SSD (Used for the Portable AI installation)
Internal Storage: 256 GB SSD + 1 TB HDD
OS: Windows 11
Steps to Reproduce:
Connect the external 128GB SSD.
Launch AnythingLLM via the start-windows.bat script.
In AnythingLLM settings, select NemoMix-local:latest or Qwen-2.5-7B.
Initiate a chat.
Observe the "exit code 2" error in the chat interface.