Instructions to Run Server File on GPU via CLI (Ubuntu 20.04.6 LTS)

[NandanChebbi123]

Description:
I’m trying to run the server file on GPU using the command line in Ubuntu (20.04.6 LTS). Could you please provide a clear step-by-step guide?

Details:

OS: Ubuntu 20.04.6 LTS

Hardware: GPU-enabled machine (CUDA installed)

Requirement: Instructions on how to properly run the server file so that it utilizes the GPU from the CLI.

What I’m Looking For:

Any environment setup required (CUDA, drivers, dependencies).

CLI command(s) to launch the server file with GPU support.

Verification steps to confirm that the GPU is actually being used.

Expected Outcome:
A step-by-step procedure that ensures the server file runs on GPU without issues.

[danielzgtg]

GPU doesn't work because there are many bugs with TTS.cpp's memory management. See #58 for previous work