workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp,whisper.cpp...) and FFmpeg and opencv-mobile

the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025

🤖 On-device CLIP inference on Android with ExecuTorch + Qualcomm QNN backend. Zero-shot image classification and vision-language understanding powered by hardware-accelerated AI on Snapdragon devices.

Catalog of projects that build upon Qualcomm's platforms

QNN LLM binding for React Native

Qualcomm lib Genie binding for Node.js

Complete guide and scripts for setup, execution and testing the AI models (ONNX) performance on NPU architectures (Qualcomm QNN & Intel OpenVINO) on Windows.