-
-
Notifications
You must be signed in to change notification settings - Fork 791
Error when building from source #70
Copy link
Copy link
Open
Description
x64_Native_Tools_Command_Prompt_for_VS_2022.txt
Hi, I'm trying to build llama-cpp-turboquant on Windows 11 with CUDA support, but the build fails on CUDA files. Here's my environment:
Visual Studio 2022 Professional
MSVC v143 Build Tools (x64/x86) installed
Windows 11 SDK 10.0.22621 (also have 10.0.26100 but not used)
CMake Tools for Windows installed
CUDA: 12.x installed at F:\cuda
NVCC path: F:\cuda\bin\nvcc.exe
I run the following commands:
cmake -B build -DGGML_CUDA=ON -DGGML_CUDA_FA_ALL_QUANTS=ON -DCMAKE_BUILD_TYPE=Release ..
cmake --build build --config Release -j 8
Errors appear during compilation of CUDA files, e.g.:
F:\llama-cpp-turboquant\ggml\src\ggml-cuda\clamp.cu(21): error C2146: syntax error: missing ';' before identifier 'num_blocks'
F:\llama-cpp-turboquant\ggml\src\ggml-cuda\binbcast.cu(367): error C2146: syntax error: missing ';' before identifier 'block_nums'
Other warnings about /Zc:preprocessor- and C++ exceptions appear, but the main blockers are the syntax errors in CUDA compilation.
Could you advise how to fix this for Windows + CUDA 12 + MSVC v143?
Thank you!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels