Skip to content

Comments

feat: add llm base url env support#633

Open
jtracey93 wants to merge 5 commits intocjpais:mainfrom
jtracey93:copilot/add-llm-base-url-env-support
Open

feat: add llm base url env support#633
jtracey93 wants to merge 5 commits intocjpais:mainfrom
jtracey93:copilot/add-llm-base-url-env-support

Conversation

@jtracey93
Copy link

@jtracey93 jtracey93 commented Jan 20, 2026

Before Submitting This PR

Please confirm you have done the following:

Human Written Description

I use Windows foundry local on my machine to provide my local LLMs. However, every time the service starts, it will pick a non-deterministic port to start on, which therefore means I need a way to provide the latest base URL for the custom LLMs every time. This pull request adds support for adding an environment variable which will be used and checked every time the LLM is needed to be called, which will meet the needs of my use case and many others.

Related Issues/Discussions

Fixes #483

Testing

Screenshots/Videos (if applicable)

AI Assistance

  • No AI was used in this PR
  • AI was used (please describe below)

If AI was used:

  • Tools used: GitHub Copilot + Claude Opus 4.5
  • How extensively: Fairly minor change so fully let it do its thing, but have reviewed and looks good

Copilot AI and others added 4 commits January 20, 2026 13:33
Co-authored-by: jtracey93 <41163455+jtracey93@users.noreply.github.com>
Co-authored-by: jtracey93 <41163455+jtracey93@users.noreply.github.com>
Co-authored-by: jtracey93 <41163455+jtracey93@users.noreply.github.com>
@cjpais
Copy link
Owner

cjpais commented Feb 7, 2026

@jtracey93 I see you mention this fixes #483, but it seems to do something different than what is requested there?

@jtracey93
Copy link
Author

@cjpais Very fair. I must have associated this very loosely in my mind.

However, it does add the ability to set the URL for a custom LLM via an environment variable, which I would find very useful as today using Windows Foundry Local or other services such as ollama, etc.. I'm having to start those manually and then update the settings via the UI each time I launch Handy or restart my PC and its painful

@cjpais
Copy link
Owner

cjpais commented Feb 11, 2026

yeah understood, I will also get this in, I just wanted to clarify

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] Handy does not support reading API keys from environment variables

3 participants