Skip to content

Running single node graphs on NPU #343

@RachidFK

Description

@RachidFK

Hello,

I am trying to run a single-node graph (Add, Concat) with fixed tensor shapes on NPU, but the compiler keeps assigning the node to execute on the CPU.

I created the single-node ONNX graph and converted/quantized it using Quark to BF16. When running the model, VitisAI EP is always executing the node on the CPU. Based on the documentation, both operators should be supported on the NPU. I used the config.json file from the Whisper demo. Please find my system configuration below.

Can we run single-node graphs (single operators) on NPU? If so, could you please help me figure out how to do it?

Thank you,

NPU: STX
RyzenAI-SW Version: 1.5.1
OS: Windows 11
Driver Version: 32.0.203.329 (12/4/2025)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions