Unsupported gpu architecture 'compute_120a'

[Ezzz-dev]

WSL2 - rtx 5060ti
Ubuntu.

Windows (CUDA, use Developer Command Prompt or WSL2)

cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release -j

[ 7%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv-transpose-1d.cu.o
nvcc fatal : Unsupported gpu architecture 'compute_120a'
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:227: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv2d-transpose.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_120a'
[ 10%] Built target ggml-cpu
nvcc fatal : Unsupported gpu architecture 'compute_120a'
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:257: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/convert.cu.o] Error 1
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:242: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv2d.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_120a'
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:212: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv2d-dw.cu.o] Error 1
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:287: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/cpy.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_120a'
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:272: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/count-equal.cu.o] Error 1
nvcc fatal : Unsupported gpu architecture 'compute_120a'
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:197: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv-transpose-1d.cu.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:1917: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/all] Error 2
gmake: *** [Makefile:146: all] Error 2

[zekrom-vale]

Looks like a WSL2 specific issue I got it to work on Ubuntu 24.04 LTS directly in a docker container. Or you are using a cuda version that does not have 120a support try upgrading to CUDA 12.8 or higher. I use cuda:13.1.1-devel-ubuntu24.04 for my container that has everything I need to build it and it works fine. (Cuda version 13.1.1)

Dockerfile.txt

[Ezzz-dev]

I am using Cuda 13.2 as instructed by NVIDIA in WSL2