Skip to content

Whisper.cpp fails because gpu is enabled for whisper.cpp #24

@migraine-user

Description

@migraine-user

From the log:

[transcriber] whisper.cpp failed:
stderr: whisper_init_from_file_with_params_no_state: loading model from '/home/user/.local/share/voxd/models/ggml-tiny.en.bin'
whisper_init_with_params_no_state: use gpu    = 1
whisper_init_with_params_no_state: flash attn = 0
whisper_init_with_params_no_state: gpu_device = 0
whisper_init_with_params_no_state: dtw        = 0

I had similar issues from other dictation software. I can't find a way to disable use gpu for whisper. I think it tries to do so because of some gpu drivers I installed that do not work for installing Steam. Below is my system info in case it is helpful:

OS: EndeavourOS Linux x86_64 
Host: 2324CA3 ThinkPad X230 
Kernel: 6.17.9-arch1-1 
Uptime: 10 mins 
Packages: 1315 (pacman) 
Resolution: 1366x768 
DE: Xfce 4.20 
WM: Xfwm4 
CPU: Intel i7-3520M (4) @ 3.600GHz 
GPU: Intel 3rd Gen Core processor Graphics Controller 

Alternately, I thought about editing the code, but it would make sense if this could be a config attribute I could set in config.yaml:

        cmd = [
            self.binary_path,
            "-m", self.model_path,
            "-f", str(audio_file),
            "-l", self.language,
            "-of", str(self.output_dir / audio_file.stem),
            "-otxt",  # <-- THIS is necessary to actually generate the .txt file,
            "-ng" # from whisper-cli -h:-`-ng,       --no-gpu            [false  ] disable GPU`
        ]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions