feat: Ollama + Gemma 3 4B config and Windows desktop launcher#249
Open
Methu20-BIM wants to merge 3 commits intoopen-jarvis:mainfrom
Open
feat: Ollama + Gemma 3 4B config and Windows desktop launcher#249Methu20-BIM wants to merge 3 commits intoopen-jarvis:mainfrom
Methu20-BIM wants to merge 3 commits intoopen-jarvis:mainfrom
Conversation
Switch default inference config from vLLM/GLM-4.7-Flash (A100-optimised) to Ollama with gemma3:4b so the project runs out-of-the-box on a consumer Windows machine without cloud APIs or specialist hardware. - configs/openjarvis/config.toml: set engine to ollama, model to gemma3:4b, temperature 0.7 (conversational default) - jarvis.bat: Windows batch launcher — activates the project venv and prompts the user for a question, making Jarvis accessible from the desktop without opening a terminal manually Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Three issues fixed for Windows desktop users: - Set chcp 65001 + PYTHONUTF8=1 so emoji/unicode in model responses no longer crash the terminal (cp1252 UnicodeEncodeError) - Use full path to .venv\Scripts\jarvis.exe instead of relying on venv activation via call, which silently failed in some cmd contexts - Add a :loop so users can ask multiple questions in one session without reopening the window; type "avslutt" to exit Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Adds a full-featured browser-based chat UI for Jarvis, mirroring the core UX of Claude Sonnet, running entirely locally via Ollama. dashboard/index.html: - Sidebar with model selector (gemma3:4b / gemma4), new-chat, clear, and live Ollama status indicator - Markdown rendering via marked.js (headers, lists, tables, bold, etc.) - Syntax-highlighted code blocks via highlight.js with one-click copy - Artifact panel: HTML code blocks open as live previews in an iframe - Copy-message button on every turn (appears on hover) - Image upload via file picker, drag-and-drop, or Ctrl+V clipboard paste - Suggestion chips on the welcome screen - Streaming responses with animated typing indicator start_dashboard.bat: - Launches Python's built-in HTTP server on port 8765 and opens the browser automatically, so users can start the dashboard with one click Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
vllm(requires A100 GPUs) toollamaand the default model fromGLM-4.7-Flashtogemma3:4b, making OpenJarvis usable on a standard consumer Windows PC with no cloud API keysMotivation
The existing
config.tomlis tuned for an 8×A100-80 GB eval cluster. For developers who want to run OpenJarvis locally on a Windows machine with Ollama, there was no ready-made example config. This PR provides that, along with a zero-friction desktop shortcut script.Test plan
ollama pull gemma3:4b+ollama serveuv sync(Python 3.12, pinned via.python-version)uv run jarvis ask "What is the capital of France?"→ returns correct answerjarvis.baton Windows desktop → prompts for question, returns answer🤖 Generated with Claude Code