Skip to content

Commit 855aa8d

Browse files
Update README.md
1 parent 6b5e782 commit 855aa8d

File tree

1 file changed

+15
-22
lines changed

1 file changed

+15
-22
lines changed

README.md

Lines changed: 15 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -1,35 +1,28 @@
1-
![llama.cpp](
2-
https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png
3-
"llama.cpp")
1+
![llama.cpp](https://user-images.githubusercontent.com/1991296/230134379-7181e485-c521-4d23-a0d6-f7b3b61ba524.png "llama.cpp")
42
# Ampere® optimized llama.cpp
5-
Ampere® optimized build of [llama.cpp](
6-
https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#llamacpp)
7-
with full support for rich collection of GGUF models available at HuggingFace: [GGUF models](
8-
https://huggingface.co/models?search=gguf)
3+
Ampere® optimized build of [llama.cpp](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#llamacpp) with full support for rich collection of GGUF models available at HuggingFace: [GGUF models](https://huggingface.co/models?search=gguf)
94

105
This Docker image can be run on bare metal Ampere® CPUs and Ampere® based VMs available in the cloud.
116

127
Release notes and binary executables are available on our [GitHub](https://github.com/AmpereComputingAI/llama.cpp/releases)
138

149
## Starting container
15-
10+
Default entrypoint runs the server binary of llama.cpp, mimicking behavior of original llama.cpp server image: [docker image](https://github.com/ggerganov/llama.cpp/blob/master/.devops/server.Dockerfile)
11+
12+
To launch shell instead, do this:
13+
1614
```bash
17-
docker run --name llama -it --rm ghcr.io/amperecomputingai/llama.cpp:latest
15+
sudo docker run --privileged=true --name llama --entrypoint /bin/bash -it amperecomputingai/llama.cpp:latest
1816
```
1917
Quick start example will be presented at docker container launch:
20-
21-
![quick start](
22-
https://ampereaimodelzoo.s3.eu-central-1.amazonaws.com/pictures/Screenshot+2024-04-30+at+22.37.13.png
23-
"quick start")
24-
25-
Make sure to visit us at [Ampere Solutions Portal](
26-
https://solutions.amperecomputing.com/solutions/ampere-ai)!
27-
18+
19+
![quick start](https://ampereaimodelzoo.s3.eu-central-1.amazonaws.com/pictures/Screenshot+2024-04-30+at+22.37.13.png "quick start")
20+
21+
Make sure to visit us at [Ampere Solutions Portal](https://solutions.amperecomputing.com/solutions/ampere-ai)!
22+
2823
## Support
29-
24+
3025
Please contact us at <ai-support@amperecomputing.com>
31-
26+
3227
## LEGAL NOTICE
33-
By accessing, downloading or using this software and any required dependent software (the “Ampere AI Software”), you agree to the terms and conditions of the software license agreements for the Ampere AI Software, which may also include notices, disclaimers, or license terms for third party software included with the Ampere AI Software. Please refer to the [Ampere AI Software EULA v1.6](
34-
https://ampereaidevelop.s3.eu-central-1.amazonaws.com/Ampere+AI+Software+EULA+-+v1.6.pdf)
35-
or other similarly-named text file for additional details.
28+
By accessing, downloading or using this software and any required dependent software (the “Ampere AI Software”), you agree to the terms and conditions of the software license agreements for the Ampere AI Software, which may also include notices, disclaimers, or license terms for third party software included with the Ampere AI Software. Please refer to the [Ampere AI Software EULA v1.6](https://ampereaidevelop.s3.eu-central-1.amazonaws.com/Ampere+AI+Software+EULA+-+v1.6.pdf) or other similarly-named text file for additional details.

0 commit comments

Comments
 (0)