-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathengine.html
More file actions
173 lines (170 loc) · 8.41 KB
/
engine.html
File metadata and controls
173 lines (170 loc) · 8.41 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
<!DOCTYPE html>
<html lang="en">
<head>
<script src="/config.js"></script>
<meta charset="UTF-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Kolosal - Engine</title>
<link rel="stylesheet" href="styles/global.css">
<link rel="stylesheet" href="styles/engine.css">
<link href="https://cdn.jsdelivr.net/npm/remixicon@4.5.0/fonts/remixicon.css" rel="stylesheet"/>
<meta name="robots" content="noindex, nofollow">
</head>
<body>
<sidebar></sidebar>
<main class="container">
<div class="header" data-title="Engine"></div>
<div class="content">
<div class="col-4">
<div class="card">
<h2 class="text-14px medium">Total</h2>
<h3 class="text-20px medium" id="TotalModel">0</h3>
</div>
<div class="card">
<h2 class="text-14px medium">Loaded</h2>
<h3 class="text-20px medium" id="LoadedModel">0</h3>
</div>
<div class="card">
<h2 class="text-14px medium">Unloaded</h2>
<h3 class="text-20px medium" id="UnloadedModel">0</h3>
</div>
<div class="card">
<h2 class="text-14px medium">Autoscaling</h2>
<div class="status" id="AutoScaling">
<i class="ri-lock-unlock-line"></i>
<h3 class="text-14px medium"></h3>
</div>
</div>
</div>
<div class="list">
<div class="list-title">
<div class="col">
<div class="tab">
<button class="btn-sm">LLM</button>
<button class="btn-sm">Embedding</button>
</div>
<div class="divider"></div>
<div class="refresh">
<button id="RefreshData"><i class="ri-reset-right-line"></i></button>
<p class="text-14px reguler" id="RefreshDataTime">Last updated</p>
</div>
</div>
<div class="col">
<button class="btn-md btn-primary" data-popup="AddModel">Add Model</button>
</div>
</div>
<div class="list-blank">
<h3 class="text-14px medium">No engines added yet</h3>
<p class="text-12px reguler">Add a model to get started and enhance how you retrieve information.</p>
</div>
<div class="list-content"></div>
</div>
</div>
</main>
<div class="popup" data-popup="AddModel">
<div class="popup-body add-model">
<div class="popup-title">
<div class="col">
<h2 class="text-14px medium">Add New Model</h2>
<p class="text-12px reguler">Configure and add a new AI model to the engine</p>
</div>
<div class="btn-md-icon btn-ghost close-popup"><i class="ri-close-large-line"></i></div>
</div>
<div class="popup-content">
<div class="col-2">
<div class="input-text">
<h2 class="text-12px reguler">Model ID:</h2>
<input type="text" placeholder="Search or type manually" id="InputModelId" autocomplete="off">
<div class="search-model"></div>
</div>
<div class="dropdown">
<h4 class="text-12px reguler">Model Type:</h4>
<div class="dropdown-trigger dropdown-form">
<h3 class="text-14px reguler" id="InputModelType">Select model</h3>
<i class="ri-arrow-down-s-line"></i>
</div>
<div class="dropdown-list">
<a class="dropdown-item" href="#">
<h2 class="text-14px reguler">LLM (Text Generation)</h2>
</a>
<a class="dropdown-item" href="#">
<h2 class="text-14px reguler">Embedding (Text Vectorization)</h2>
</a>
</div>
</div>
</div>
<div class="text-area">
<h2 class="text-12px reguler">Model Path or URL</h2>
<textarea placeholder="Enter your query here..." id="InputModelPath"></textarea>
</div>
<div class="col-3">
<div class="dropdown">
<h4 class="text-12px reguler">Inference engine:</h4>
<div class="dropdown-trigger dropdown-form">
<h3 class="text-14px reguler" id="InputModelInference">llama-cpu</h3>
<i class="ri-arrow-down-s-line"></i>
</div>
<div class="dropdown-list">
<a class="dropdown-item" href="#">
<h2 class="text-14px reguler">llama-cpu</h2>
</a>
<a class="dropdown-item" href="#">
<h2 class="text-14px reguler">llama-gpu</h2>
</a>
</div>
</div>
<div class="input-text">
<h2 class="text-12px reguler">Main GPU ID</h2>
<input type="number" placeholder="0" value="-1" id="InputModelGPU">
</div>
<div class="checkbox" style="margin-top: 20px;">
<input type="checkbox" checked id="InputModelLoad">
<h2 class="text-14px medium">Load Immediately</h2>
</div>
</div>
<div class="parameter">
<div class="title">
<h3 class="text-14px medium">Loading Parameters</h3>
<i class="ri-arrow-down-s-line"></i>
</div>
<div class="body">
<div class="col-2">
<div class="input-text">
<h2 class="text-12px reguler">Context Size</h2>
<input type="number" placeholder="0" value="4096" id="InputModelContext">
</div>
<div class="input-text">
<h2 class="text-12px reguler">Batch Size</h2>
<input type="number" placeholder="0" value="512" id="InputModelBatch">
</div>
</div>
<div class="col-2">
<div class="input-text">
<h2 class="text-12px reguler">GPU Layers</h2>
<input type="number" placeholder="0" value="0" id="InputModelLayer">
</div>
<div class="input-text">
<h2 class="text-12px reguler">Parallel Sequences</h2>
<input type="number" placeholder="0" value="1" id="InputModelParallel">
</div>
</div>
<div class="col-2">
<div class="checkbox">
<input type="checkbox" checked id="InputModelMemory">
<h2 class="text-14px medium">Use Memory Mapping</h2>
</div>
<div class="checkbox">
<input type="checkbox" checked id="InputModelPerform">
<h2 class="text-14px medium">Perform Warmup</h2>
</div>
</div>
</div>
</div>
<button class="btn-lg btn-primary add-model-action">Add Model</button>
</div>
</div>
</div>
<script type="module" src="script/component.js"></script>
<script type="module" src="script/engine.js"></script>
</body>
</html>