Unable to run inference with mobilenet-ssd

[ndujar]

Hi,

I have followed instructions to create a Docker image here and successfully built and run a container with the following command:

$ docker run -it --privileged --net=host -v ~/.Xauthority:/root/.Xauthority -v /tmp/.X11-unix:/tmp/.X11-unix:rw -e DISPLAY=unix$DISPLAY -e HTTP_PROXY=$HTTP_PROXY -e HTTPS_PROXY=$HTTPS_PROXY -e http_proxy=$http_proxy -e https_proxy=$https_proxy -v /dev/video2:/dev/video2 -v ~/ffva/FFmpeg-patch:/FFmpeg-patch -v ~/ffva/data/models/intel:/root/intel_models:ro -v ~/ffva/data/models/common:/root/common_models:ro -e MODELS_PATH=/root/common_models -v ~/ffva/data/video:/root/video-examples:rw -e VIDEO_EXAMPLES_DIR=/root/video-examples ffmpeg-video-analytics-package:latest

Happily, the face detection sample works like a charm after some reconstruction from the commands in the scripts provided:

$ ffmpeg -i /root/video-examples/news.mkv -vf "detect=model=/root/face-detection-0102.xml:device=CPU,classify=model=/root/mobilenet-ssd.xml:model_proc=/root/age-gender-recognition-retail-0013.json:device=CPU,ocv_overlay" -y /root/video-examples/faces.mp4

However, I have been going through the Advanced usage examples and I keep receiving a Create network failed! message:

I would expect that

$ ffmpeg -i /root/video-examples/news.mkv -vf "detect=model=/root/mobilenet-ssd.xml:device=CPU:nireq=8,ocv_overlay" -y /root/video-examples/objects.mp4

Would also work, however this is the output I keep getting:

ffmpeg version 4.2 Copyright (c) 2000-2019 the FFmpeg developers
built with gcc 7 (Ubuntu 7.5.0-3ubuntu1~18.04)
configuration: --prefix=/usr --extra-cflags=-I/opt/intel/openvino/deployment_tools/inference_engine/include --extra-ldflags=-L/opt/intel/openvino/deployment_tools/inference_engine/lib/intel64 --libdir=/usr/lib/x86_64-linux-gnu --extra-libs='-lpthread -lm' --enable-shared --enable-gpl --enable-libass --enable-libfreetype --enable-openssl --enable-nonfree --enable-libdrm --enable-libmfx --disable-doc --disable-htmlpages --disable-manpages --disable-podpages --disable-txtpages --enable-libfdk-aac --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libx264 --enable-libx265 --enable-libjson_c --enable-libsrt --enable-libinference_engine_c_api --enable-libopencv --enable-python3
libavutil 56. 31.100 / 56. 31.100
libavcodec 58. 54.100 / 58. 54.100
libavformat 58. 29.100 / 58. 29.100
libavdevice 58. 8.100 / 58. 8.100
libavfilter 7. 57.100 / 7. 57.100
libswscale 5. 5.100 / 5. 5.100
libswresample 3. 5.100 / 3. 5.100
libpostproc 55. 5.100 / 55. 5.100
Input #0, matroska,webm, from '/root/video-examples/news.mkv':
Metadata:
COMPATIBLE_BRANDS: iso6avc1mp41
MAJOR_BRAND : dash
MINOR_VERSION : 0
ENCODER : Lavf58.35.101
Duration: 00:10:18.98, start: -0.007000, bitrate: 709 kb/s
Stream #0:0: Video: h264 (Main), yuv420p(tv, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 25 fps, 25 tbr, 1k tbn, 50 tbc (default)
Metadata:
HANDLER_NAME : ISO Media file produced by Google Inc.
DURATION : 00:10:18.960000000
Stream #0:1(eng): Audio: opus, 48000 Hz, stereo, fltp (default)
Metadata:
DURATION : 00:10:18.981000000
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
Stream #0:1 -> #0:1 (opus (native) -> aac (native))
Press [q] to stop, [?] for help
Loading model: device=CPU, path=/root/mobilenet-ssd.xml
Setting batch_size=1, nireq=8
libavfilter/inference_backend/openvino_image_inference.c:364 : OpenVINOImageInferenceCreate Create network failed!
Assertion ret == 0 failed at libavfilter/inference_backend/ff_inference_impl.c:284
Aborted (core dumped)

Any hints are much appreciated

[bhargav-sudo]

Hi @ndujar I had successfully built docker container.
can you share the steps to run a container .?
Iam using this command to run

docker run -it --privileged --net=host

-v ~/.Xauthority:/root/.Xauthority
-v /tmp/.X11-unix:/tmp/.X11-unix
-e DISPLAY=$DISPLAY
-e HTTP_PROXY=$HTTP_PROXY
-e HTTPS_PROXY=$HTTPS_PROXY
-e http_proxy=$http_proxy
-e https_proxy=$https_proxy

-v ~/ffva/data/models/intel:/root/intel_models:ro
-v ~/ffva/data/models/common:/root/common_models:ro
-e MODELS_PATH=/root/intel_models:/root/common_models

-v ~/ffva/data/video:/root/video-examples:ro
-e VIDEO_EXAMPLES_DIR=/root/video-examples

ffmpeg-video-analytics-

But there are only these 3 folders

common_models
intel_models
video-examples

As I see your issue you said there are some changes.
If you share from running a container to run a sample
It would help me more..
Because Iam trying this from the past few weeks.
Help needed.
Thanks

[ndujar]

Hi @bhargav-sudo:
As I recall, I followed the Option 2 in the Getting Started Guide
As I see in your command, you might be missing some important shared volumes. Have you tried to run the docker image with the same command as mine?
docker run -it --privileged --net=host -v ~/.Xauthority:/root/.Xauthority -v /tmp/.X11-unix:/tmp/.X11-unix:rw -e DISPLAY=unix$DISPLAY -e HTTP_PROXY=$HTTP_PROXY -e HTTPS_PROXY=$HTTPS_PROXY -e http_proxy=$http_proxy -e https_proxy=$https_proxy -v /dev/video2:/dev/video2 -v ~/ffva/FFmpeg-patch:/FFmpeg-patch -v ~/ffva/data/models/intel:/root/intel_models:ro -v ~/ffva/data/models/common:/root/common_models:ro -e MODELS_PATH=/root/common_models -v ~/ffva/data/video:/root/video-examples:rw -e VIDEO_EXAMPLES_DIR=/root/video-examples ffmpeg-video-analytics-package:latest

As you can see, then I added the following (missing in your command):
-v /dev/video2:/dev/video2
-v ~/ffva/FFmpeg-patch:/FFmpeg-patch

Hope this helps :)

[bhargav-sudo]

Hi @ndujar
But I tried option 1 in guide.
will try that and let you know.

Thanks.