-
Notifications
You must be signed in to change notification settings - Fork 23
Open
Labels
type: bugSomething isn't workingSomething isn't working
Description
vLLM version: 0.10.2
Compiled in amp01 (Ampere architecture)
Following the instructions in https://docs.vllm.ai/en/latest/getting_started/installation/cpu.html#build-wheel-from-source
It gives the following error during build time:
==> qemu.Vllm: /root/vllm_cpu_env/lib/python3.12/site-packages/setuptools_scm/_integration/version_inference.py:51: UserWarning: version of None already set
==> qemu.Vllm: warnings.warn(self.message)
==> qemu.Vllm: CMake Warning at /root/vllm_cpu_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
==> qemu.Vllm: static library kineto_LIBRARY-NOTFOUND not found.
==> qemu.Vllm: Call Stack (most recent call first):
==> qemu.Vllm: /root/vllm_cpu_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:125 (append_torchlib_if_found)
==> qemu.Vllm: CMakeLists.txt:80 (find_package)
==> qemu.Vllm:
==> qemu.Vllm:
==> qemu.Vllm: CMake Warning at cmake/cpu_extension.cmake:168 (message):
==> qemu.Vllm: BF16 functionality is not available
==> qemu.Vllm: Call Stack (most recent call first):
==> qemu.Vllm: CMakeLists.txt:97 (include)
==> qemu.Vllm:
==> qemu.Vllm:
==> qemu.Vllm: Traceback (most recent call last):
==> qemu.Vllm: File "/root/vllm_source/setup.py", line 648, in <module>
==> qemu.Vllm: setup(
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
==> qemu.Vllm: return distutils.core.setup(**attrs)
==> qemu.Vllm: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
==> qemu.Vllm: return run_commands(dist)
==> qemu.Vllm: ^^^^^^^^^^^^^^^^^^
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
==> qemu.Vllm: dist.run_commands()
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
==> qemu.Vllm: self.run_command(cmd)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
==> qemu.Vllm: super().run_command(command)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
==> qemu.Vllm: cmd_obj.run()
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
==> qemu.Vllm: self.run_command("build")
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
==> qemu.Vllm: self.distribution.run_command(command)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
==> qemu.Vllm: super().run_command(command)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
==> qemu.Vllm: cmd_obj.run()
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
==> qemu.Vllm: self.run_command(cmd_name)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
==> qemu.Vllm: self.distribution.run_command(command)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
==> qemu.Vllm: super().run_command(command)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
==> qemu.Vllm: cmd_obj.run()
==> qemu.Vllm: File "/root/vllm_source/setup.py", line 268, in run
==> qemu.Vllm: super().run()
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
==> qemu.Vllm: _build_ext.run(self)
==> qemu.Vllm: File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
==> qemu.Vllm: self.build_extensions()
==> qemu.Vllm: File "/root/vllm_source/setup.py", line 242, in build_extensions
==> qemu.Vllm: subprocess.check_call(["cmake", *build_args], cwd=self.build_temp)
==> qemu.Vllm: File "/usr/lib/python3.12/subprocess.py", line 413, in check_call
==> qemu.Vllm: raise CalledProcessError(retcode, cmd)
==> qemu.Vllm: subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=2', '--target=_C']' returned non-zero exit status 1.
==> qemu.Vllm:
==> qemu.Vllm: from /etc/one-appliance/service.d/Vllm/main.rb:109:in `build_llvm_cpu_aarch64'
==> qemu.Vllm: from /etc/one-appliance/service.d/Vllm/main.rb:76:in `install_dependencies'
==> qemu.Vllm: from /etc/one-appliance/service.d/Vllm/main.rb:27:in `install'
==> qemu.Vllm: from /etc/one-appliance/service:70:in `call'
==> qemu.Vllm: from /etc/one-appliance/service:70:in `block (2 levels) in <main>'
==> qemu.Vllm: from /etc/one-appliance/service:67:in `open'
==> qemu.Vllm: from /etc/one-appliance/service:67:in `block in <main>'
==> qemu.Vllm: from /etc/one-appliance/service:64:in `each'
==> qemu.Vllm: from /etc/one-appliance/service:64:in `<main>'
Metadata
Metadata
Assignees
Labels
type: bugSomething isn't workingSomething isn't working