how can i get the kernelParams number ??

[pipul]

i use cudaGraphKernelNodeGetParams get the node params

 
‎  struct cudaKernelNodeParams
        {
            void* func;
            dim3 gridDim;
            dim3 blockDim;
            unsigned int sharedMemBytes;
            void **kernelParams;
            void **extra;
        };

i capture a big cuda graph, i wan't to get all params of each kernel, but it seems that has no api can do that
how can i get the kernelParams number of each kernel ??

[leofang]

Hi @pipul Indeed it seems while cudaGraphKernelNodeGetParams returns cudaKernelNodeParams, the struct does not contain the number of kernel arguments. Let me check with the team internally.

[galv]

Hello pipul, there is not a direct API, but you can do this https://github.com/pytorch/pytorch/pull/137318/files#diff-d7302d133bb5e0890fc94de9aeea4d9d442555a3b40772c9db10edb5cf36a35cR424-R429

In other words:

for(size_t i = 0; cudaFuncGetParamInfo(func, i, &param_offset, &param_size) != CUDA_ERROR_INVALID_VALUE; i++) {}
// i now contains the total number of arguments to your kernel.

I'm sure you can translate that to python.