To get a better understanding and introduction to NLP, decided to do a pet project about it. You need a gpu to run this, since the glove and llama model need one to function. It takes in regular text, and transforms it into caveman text. It uses a brute force method I made, and generated text from llama. It then produces whether the original text is similar / more caveman like.
venvs are optional, but highly recommended just in general
To create your virtual enviornment, open the terminal in your repository folder and enter
/path/to/python.exe -m venv venv_name
For the word movers distance, install one of the gloves and extract the zip into the repository. then edit the gloveInputFile String in the code with the path to the glove model of your choosing
https://nlp.stanford.edu/projects/glove/
Make sure you have installed c++ tools from this link
https://visualstudio.microsoft.com/visual-cpp-build-tools/
And install the nvidia cuda toolkit
https://developer.nvidia.com/cuda-toolkit
run the requirements.txt file
and run this command to install the spacy english language model
python -m spacy download en_core_web_sm
- Open an admin access terminal and run this code so you can activate the virtual enviornment
Set-ExecutionPolicy -ExecutionPolicy RemoteSigned
- Then open the terminal in your repository folder and enter
venv_name/Scripts/activate
- Run the
llamathing.pypython file like usual, and follow the directions
- Once your done running your code, run this in a terminal inside your repository folder
venv_name/Scripts/deactivate
- And run this in an admin access terminal
Set-ExecutionPolicy -ExecutionPolicy Undefined