Request for Pre-compiled QNN Backend Binary for Research

[huangzhenhua111]

Hi mllm team,

I'm conducting NPU-aware algorithm optimization research using Qualcomm Device Cloud (QDC) with Snapdragon 8 Gen 3. Due to the lack of Hexagon SDK access and compilation environment constraints on the cloud platform, I'm unable to compile the QNN backend from source.

Could you please provide:

1. Pre-compiled QNN backend binaries for Android ARM64
2. Or guidance on using QNN AOT compilation to avoid device-side operator package compilation

My setup:

• Device: QDC Snapdragon 8 Gen 3
• QNN SDK: v2.14 (device firmware V73)
• Goal: Run NPU-aware optimization experiments (token pruning, quantization, KV cache)

Models are already downloaded. I can work with any recent mllm version that's compatible.

Thank you!

[chenghuaWang]

Hello @huangzhenhua111,

We can provide help with:

• Guidance on using QNN AOT compilation to avoid device-side operator package compilation.

Currently, the device-side operator package is not used in the mllm AOT schema. The tasks/build_sdk_android_qnn_aot.yaml file does not require the Hexagon SDK.

[huangzhenhua111]

Update on QNN AOT - DSP Initialized Successfully！！！

Hi @chenghuaWang,

thanks a lot for the guidance! I have a significant update.

1. Success Verification (DSP is Alive):
   By correctly setting ADSP_LIBRARY_PATH, I have confirmed that the Hexagon DSP is successfully initialized. The logs show:
   Successfully opened file ./libQnnHtpV75Skel.so
   Created user PD on domain 3... Unsigned:Y
   This proves the QNN AOT binaries and environment setup are correct. (Log attached).

2. Current Blockers (Runtime Config):
   However, the runner halts due to two specific runtime issues:

Missing Dependency: The DSP warns: failed with 0x2 for ./QcSoCServiceUtils.dll. It seems the HTP backend requires this utility library. I plan to push libQcSoCServiceUtils.so from the SDK to the device (and maybe symlink it to .dll if needed).

Linker Constraint: The app crashes with linker : error: expected absolute path: "libQnnHtp.so". This is an Android 14 security restriction on dlopen. I will try passing the absolute path of the backend to the runner.

I will fix these configuration issues and report the performance data soon. Thanks very much!

NPU_baseline_log.txt