how to start a serve on a local network with cli

[XMoyas]

Now, Only I can start a serve on local network with GUI, but i will do this with cli, so others can visit it with OpenAI SDK, how to do this?

[ryan-the-crayon]

Once you have this on, starting the server with CLI should just work.

[ryan-the-crayon]

If you wish to change this setting without opening the GUI, you can edit the config file manually in ~/.lmstudio/.internal/http-server-config.json (if it doesn't exist, ~/.cache/lm-studio/.internal/http-server-config.json), and change "networkInterface" to "0.0.0.0".

(Disclaimer: The format/structure of config files are not considered stable interface of LM Studio. We may change them at any time.)

[XMoyas]

ok， it works! thx!!!

[itobey]

This does not work for me. When editing the file and setting it to 0.0.0.0 it will change to 127.0.0.1 after running lms server start. When I restrict the access to the file after editing it, it stays on 0.0.0.0 but lms still serves 127.0.0.1

tobey@aiserver:~$ sudo ss -tulpn | grep 1234
tcp   LISTEN 0      511        127.0.0.1:1234       0.0.0.0:*    users:(("llmster",pid=4274,fd=43))

Is that a bug or is there anything I am missing? I installed by following the guide on "Setup llmster as a Startup Task on Linux".

[anantshri]

This does not work for me. When editing the file and setting it to 0.0.0.0 it will change to 127.0.0.1 after running lms server start. When I restrict the access to the file after editing it, it stays on 0.0.0.0 but lms still serves 127.0.0.1

tobey@aiserver:~$ sudo ss -tulpn | grep 1234
tcp   LISTEN 0      511        127.0.0.1:1234       0.0.0.0:*    users:(("llmster",pid=4274,fd=43))

Is that a bug or is there anything I am missing? I installed by following the guide on "Setup llmster as a Startup Task on Linux".

same for me. editing the file and restarted reverts the file and lms always listens on 127.0.0.1

[anantshri]

Alright I have found the solution

https://deepwiki.com/lmstudio-ai/lms/5.1-server-commands

Bind Option (--bind):

Specifies the network interface to bind to
"127.0.0.1" (default) restricts access to localhost
"0.0.0.0" allows connections from the local network
Can also be set via LMS_SERVER_HOST environment variable
Priority: CLI flag > environment variable > default ("127.0.0.1")

So option 1

[Unit]
Description=LM Studio Server

[Service]
Type=oneshot
RemainAfterExit=yes
User=user
Environment="HOME=/home/user"
ExecStartPre=/home/user/.lmstudio/bin/lms daemon up
ExecStart=/home/user/.lmstudio/bin/lms server start --bind 0.0.0.0
ExecStop=/home/user/.lmstudio/bin/lms daemon down

[Install]
WantedBy=multi-user.target

or

sudo systemctl edit lmstudio.service

add this in the file

[Service]
Environment="LMS_SERVER_HOST=0.0.0.0"

Dont do both

after doing any one of these

sudo systemctl daemon-reload
sudo systemctl enable lmstudio.service
sudo systemctl start lmstudio.service

And this would start server in right place

found an option pull for this also lmstudio-ai/docs#179

[pavelzamyatin]

So basically what you need it is to bind it to 0.0.0.0. This command just works:
lms server start --bind 0.0.0.0

W Server will accept connections from the network. Only use this if you know what you are doing!
Success! Server is now running on port 1234

I don't know why it's not in the docs: