A quick homebrew for running llama2.c on the PSP.
You will need docker and can use the pspdev/pspdev docker image.
docker pull pspdev/pspdev- Clone this repo and
cdinto the repo folder.
Mac/Linux Run:
docker run -it --rm -v "$PWD:/src" -w /src pspdev/pspdev makeWindows Run:
docker run -it --rm -v "%cd%:/src" -w /src pspdev/pspdev make-
Put the
EBOOT.PBPin the following directoryms0:/PSP/GAME/llama2psp/EBOOT.PBPas well as the model namedmodel.binand tokenizer namedtok.bin -
Models and tokenizer have to be in the llama2.c format and can be downloaded here
-
Due to the hardware limitations of the PSP, I used the smallest 260k model and its tokenizer.
