Skip to content

vLLM appliance is not compiling for aarch64 #290

@aleixrm

Description

@aleixrm

vLLM version: 0.10.2
Compiled in amp01 (Ampere architecture)

Following the instructions in https://docs.vllm.ai/en/latest/getting_started/installation/cpu.html#build-wheel-from-source

It gives the following error during build time:

==> qemu.Vllm: /root/vllm_cpu_env/lib/python3.12/site-packages/setuptools_scm/_integration/version_inference.py:51: UserWarning: version of None already set
==> qemu.Vllm:   warnings.warn(self.message)
==> qemu.Vllm: CMake Warning at /root/vllm_cpu_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:22 (message):
==> qemu.Vllm:   static library kineto_LIBRARY-NOTFOUND not found.
==> qemu.Vllm: Call Stack (most recent call first):
==> qemu.Vllm:   /root/vllm_cpu_env/lib/python3.12/site-packages/torch/share/cmake/Torch/TorchConfig.cmake:125 (append_torchlib_if_found)
==> qemu.Vllm:   CMakeLists.txt:80 (find_package)
==> qemu.Vllm:
==> qemu.Vllm:
==> qemu.Vllm: CMake Warning at cmake/cpu_extension.cmake:168 (message):
==> qemu.Vllm:   BF16 functionality is not available
==> qemu.Vllm: Call Stack (most recent call first):
==> qemu.Vllm:   CMakeLists.txt:97 (include)
==> qemu.Vllm:
==> qemu.Vllm:
==> qemu.Vllm: Traceback (most recent call last):
==> qemu.Vllm:   File "/root/vllm_source/setup.py", line 648, in <module>
==> qemu.Vllm:     setup(
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/__init__.py", line 117, in setup
==> qemu.Vllm:     return distutils.core.setup(**attrs)
==> qemu.Vllm:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 186, in setup
==> qemu.Vllm:     return run_commands(dist)
==> qemu.Vllm:            ^^^^^^^^^^^^^^^^^^
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 202, in run_commands
==> qemu.Vllm:     dist.run_commands()
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1002, in run_commands
==> qemu.Vllm:     self.run_command(cmd)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
==> qemu.Vllm:     super().run_command(command)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
==> qemu.Vllm:     cmd_obj.run()
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/command/bdist_wheel.py", line 370, in run
==> qemu.Vllm:     self.run_command("build")
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
==> qemu.Vllm:     self.distribution.run_command(command)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
==> qemu.Vllm:     super().run_command(command)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
==> qemu.Vllm:     cmd_obj.run()
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/command/build.py", line 135, in run
==> qemu.Vllm:     self.run_command(cmd_name)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/cmd.py", line 357, in run_command
==> qemu.Vllm:     self.distribution.run_command(command)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/dist.py", line 1104, in run_command
==> qemu.Vllm:     super().run_command(command)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 1021, in run_command
==> qemu.Vllm:     cmd_obj.run()
==> qemu.Vllm:   File "/root/vllm_source/setup.py", line 268, in run
==> qemu.Vllm:     super().run()
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/command/build_ext.py", line 99, in run
==> qemu.Vllm:     _build_ext.run(self)
==> qemu.Vllm:   File "/root/vllm_cpu_env/lib/python3.12/site-packages/setuptools/_distutils/command/build_ext.py", line 368, in run
==> qemu.Vllm:     self.build_extensions()
==> qemu.Vllm:   File "/root/vllm_source/setup.py", line 242, in build_extensions
==> qemu.Vllm:     subprocess.check_call(["cmake", *build_args], cwd=self.build_temp)
==> qemu.Vllm:   File "/usr/lib/python3.12/subprocess.py", line 413, in check_call
==> qemu.Vllm:     raise CalledProcessError(retcode, cmd)
==> qemu.Vllm: subprocess.CalledProcessError: Command '['cmake', '--build', '.', '-j=2', '--target=_C']' returned non-zero exit status 1.
==> qemu.Vllm:
==> qemu.Vllm:  from /etc/one-appliance/service.d/Vllm/main.rb:109:in `build_llvm_cpu_aarch64'
==> qemu.Vllm:  from /etc/one-appliance/service.d/Vllm/main.rb:76:in `install_dependencies'
==> qemu.Vllm:  from /etc/one-appliance/service.d/Vllm/main.rb:27:in `install'
==> qemu.Vllm:  from /etc/one-appliance/service:70:in `call'
==> qemu.Vllm:  from /etc/one-appliance/service:70:in `block (2 levels) in <main>'
==> qemu.Vllm:  from /etc/one-appliance/service:67:in `open'
==> qemu.Vllm:  from /etc/one-appliance/service:67:in `block in <main>'
==> qemu.Vllm:  from /etc/one-appliance/service:64:in `each'
==> qemu.Vllm:  from /etc/one-appliance/service:64:in `<main>'

Metadata

Metadata

Assignees

No one assigned

    Labels

    type: bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions