Streaming Lumify Ultrasound Video to 3D Slicer via Plus Toolkit

[lagaron]

I am currently working on a project where I need to stream video from a Lumify ultrasound transducer to 3D Slicer in real-time. Here’s the setup and the issue I am facing:

1. Setup:
   I am using a Samsung tablet running the Lumify app to capture ultrasound images. The tablet streams its screen using Screen Stream Mirroring to http://192.168.1.132:8080. And I want to use Plus Toolkit to acquire this video stream and send it to 3D Slicer.

2. Configuration Attempt:
   I have created a configuration file for Plus Toolkit to acquire the video stream from the HTTP URL. I have tried using different device types (MediaFoundationVideo, MmfVideo, and OpenCVVideo) but the Plus Server stops unexpectedly with return code 1: Server stopped unexpectedly. Return code: 1

3. The XML I have tried with:

  <Device Id="VideoDevice" Type="OpenCVVideo" Url="http://192.168.1.132:8080">
    <DataSources>
      <DataSource Type="Video" Id="VideoStream" PortUsImageOrientation="MF" ImageType="RGB_COLOR"/>
    </DataSources>
    <OutputChannels>
      <OutputChannel Id="VideoStreamChannel" VideoDataSourceId="VideoStream"/>
    </OutputChannels>
  </Device>

</DeviceSet>

But I have tried others and I always get this error :(

Any help or suggestions would be greatly appreciated!

Thank you in advance

[Sunderlandkyl]

Does the video stream from the tablet work with another application such as VLC?

[Sunderlandkyl]

Also the URL should be "VideoURL".

[lagaron]

I can't open it in VLC, but i can open it in my browser

[lassoan]

Id it works in your browser then it means the ultrasound provides a web server that hosts a web app that can receive and display a video stream. You need to replace that app with PLUS (or VLC, etc.). You can load the page with browser developer tools enabled to see what web API calls the web app performs to start streaming and what URL the video is received from. If some standard syreaming protocol is ueed then you may be able to replace the browser; otherwise you may need to pretend you are the browser to get access to the stream. You can also ask advice from Lumify, maybe they have an SDK that you can use.

[lagaron]

Now, I have achieved to see it on VLC too, with another URL. So now I am able to open it in both browser and VLC, however, in my XML code I still have the same error 1, when I try to run PlusServer.
Here is the mentioned code:

[Sunderlandkyl]

Please attach the PlusServer log.