Skip to content

Commit 85877f3

Browse files
authored
Merge pull request #56 from shipsing/instructlab-podman-desktop-integration
docs: Added a procedure to use InstructLab with Podman Desktop
2 parents e319539 + e858d6e commit 85877f3

File tree

4 files changed

+38
-0
lines changed

4 files changed

+38
-0
lines changed
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
2+
---
3+
title: Start InstructLab as a container
4+
description: Covers the procedure to start an InstructLab container using the Podman Desktop UI
5+
logo: images/ilab_dog.png
6+
---
7+
8+
9+
# Using InstructLab with Podman Desktop
10+
11+
With InstructLab-Podman Desktop integration, you can easily use the Podman Desktop UI to create an InstructLab container to work with. Podman Desktop provides the Podman AI Lab extension to work with Large Language Models (LLMs) in a local development environment. The extension also provides an option to start InstructLab as a container.
12+
13+
With a running InstructLab container, you can initialize an InstructLab session and train models with specialized knowledge and skill tuning. In the container's terminal, configure the InstructLab CLI to run relevant commands to download, serve, and chat with the model.
14+
15+
#### Prerequisites
16+
Make sure you have:
17+
18+
- [Installed Podman Desktop](https://podman-desktop.io/docs/installation)
19+
- [A running Podman machine](https://podman-desktop.io/docs/podman/creating-a-podman-machine).
20+
- Installed the [AI Lab extension](https://podman-desktop.io/tutorial/running-an-ai-application#installing-the-extension).
21+
22+
#### Procedure
23+
24+
1. Click **AI Lab** in the left navigation pane.
25+
1. In the TUNING section, click **Try InstructLab**.
26+
1. Click the **Start InstructLab Container** button on the opened page. This step might take some time to start the container.
27+
1. Click the **Open InstructLab container** button to access the container's terminal.
28+
29+
1. Run the `ilab config init` command to configure the InstructLab CLI.
30+
![configure the InstructLab CLI](../images/initializing-ilab.png)
31+
32+
#### Verification
33+
34+
1. View the InstructLab container running on the Containers page.
35+
![updated context details](../images/instructlab-container-running.png)
36+
1. Click the name of the container to view its logs.
37+
1. Click the **Terminal** tab to run `ilab` commands, such as `ilab model download`, `ilab model serve`, and `ilab model chat`.

docs/images/initializing-ilab.png

342 KB
Loading
110 KB
Loading

mkdocs.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,6 +14,7 @@ nav:
1414
- Install on Mac Metal: getting-started/mac_metal.md
1515
- Install on Linux NVIDIA: getting-started/linux_nvidia.md
1616
- Install on Linux AMD: getting-started/linux_amd.md
17+
- Start InstructLab as a container: getting-started/using-instructlab-with-podman-desktop.md
1718
- Initialize InstructLab: getting-started/initilize_ilab.md
1819
- Download models: getting-started/download_models.md
1920
- Intro to serve and chat: getting-started/serve_and_chat.md

0 commit comments

Comments
 (0)