Skip to content

Error when building from source #70

@gabriel93blt

Description

@gabriel93blt

x64_Native_Tools_Command_Prompt_for_VS_2022.txt

Hi, I'm trying to build llama-cpp-turboquant on Windows 11 with CUDA support, but the build fails on CUDA files. Here's my environment:

Visual Studio 2022 Professional
MSVC v143 Build Tools (x64/x86) installed
Windows 11 SDK 10.0.22621 (also have 10.0.26100 but not used)
CMake Tools for Windows installed
CUDA: 12.x installed at F:\cuda
NVCC path: F:\cuda\bin\nvcc.exe

I run the following commands:

cmake -B build -DGGML_CUDA=ON -DGGML_CUDA_FA_ALL_QUANTS=ON -DCMAKE_BUILD_TYPE=Release ..
cmake --build build --config Release -j 8

Errors appear during compilation of CUDA files, e.g.:

F:\llama-cpp-turboquant\ggml\src\ggml-cuda\clamp.cu(21): error C2146: syntax error: missing ';' before identifier 'num_blocks'
F:\llama-cpp-turboquant\ggml\src\ggml-cuda\binbcast.cu(367): error C2146: syntax error: missing ';' before identifier 'block_nums'

Other warnings about /Zc:preprocessor- and C++ exceptions appear, but the main blockers are the syntax errors in CUDA compilation.

Could you advise how to fix this for Windows + CUDA 12 + MSVC v143?

Thank you!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions