Vision Background is a custom TouchDesigner TOP that leverages Apple's Vision framework to remove background from a video stream on macOS, similar to Nvidia Background on Windows.
This project is currently in alpha, and it needs still a lot of polishing and performance improvement work. Feel free to contribute!
- Apple Silicon
- macOS 13.5+
- TouchDesigner 2023+ (any license)
-
Unzip and copy
VisionBackgroundTOP.pluginto TouchDesigner's plugin folder, which is located at/Users/<username>/Library/Application Support/Derivative/TouchDesigner099/Plugins. You might need to show hidden files by pressing⌘⇧..
Now, you should be able to run TouchDesigner and find Vision Background under the "Custom" OPs panel.
xattr -d -r com.apple.quarantine ~/Library/Application\ Support/Derivative/TouchDesigner099/Plugins/VisionBackgroundTOP.plugin
-
Unzip and copy
VisionBackgroundTOP.pluginnext to your .toe, in a folder namedPlugins.
You should now be able to open your .toe and find Vision Background under the "Custom" OPs panel.
-
Unzip and copy
VisionBackgroundTOP.pluginwherever you want on your machine. -
Add a CPlusPlus TOP to your network, and select
VisionBackgroundTOP.pluginunder "Plugin Path" in the "Load" tab.
Vision Background provides two parameters:
- Segmentation Quality: defaults to "Balanced", this currently provides roughly 50FPS on M3 Max.
- Downscale Factor: determines how much the image should be downscaled before Vision performs its magic. It seems to not impact performance for some reason, so you can leave it on 1x for the time being.
If you like this plugin, please consider donating to support further development! You can donate here via PayPal.