esencia

This is the code repository for the esencia project, a reinterpretation of the danceroom Spectroscopy interactive art installation.

esencia/dS is an interactive art and science installation to interact with atomic physics simulations. It is an immersive experience that creates energy fields from participants and put them inside a real-time physics-based particle dynamics simulation.

Learn more about this project in the paper esencia: A Case Study on Reinterpreting an Interactive Art and Science Installation Based on a Real-Time Atomic Physics Engine | https://dl.acm.org/doi/10.1145/3749893.3749972

Project goals

• Create a reinterpretation of the original artwork
• Be able to exhibit it again on modern hardware with more accessible hardware
• Make it open source for remixing

Setup

Currently working on the Orbbec Femto Bolt depth camera.

Developing environment

1. Install and setup openFrameworks 0.12

   • Windows visual studio 2019/2022 Recommended
   • Linux visual studio code Not fully tested
   • OSX/macOS via Xcode Orbbec Femto Bolt camera is not currently supported on macOS

2. Clone this repo on apps folder {openframeworks_folder}/apps/myApps/

3. Clone the following addons on the addons folder {openframeworks_folder}/addons/

   • ofxOrbbec (forked from design-io)
   • ofxGuiExtended (forked from frauzufall via radamchin fix)
   • ofxPresets
   • ofxPDSP
     • ofxAudioFile
     • ofxMidi

git clone https://github.com/IRL2/ofxOrbbec/; \
git clone https://github.com/IRL2/ofxGuiExtended; \
git clone https://github.com/IRL2/ofxPresets; \
git clone https://github.com/npisanti/ofxPDSP; \
git clone https://github.com/npisanti/ofxAudioFile; \
git clone https://github.com/danomatika/ofxMidi;

*Note this repo already includes the required orbbec shared-libraries on the bin and bin/libs folders (binaries from the ofxOrbbec addon).

Usage

1. Connect the camera

• If ther camera is not connected or detected, it will automatically play a prerecorded video instead (file included).
• Place the camera and turn it 90 degrees to the right (so it is on "vertical" position).

2. Run the project:

• For Windows Visual Studio 2019 open the solution esencia.sln
• For Linux Visual Studio Code (min 1.80) open esencia.code-workspace
• For macOS Xcode (14.1 or newer) open esencia.xcode-project
• Or just run make from the terminal

Select Release for the best performance.

3. Save a background reference image for the background subtraction:

• Once its running, expand the video source panel source and background groups
• Ensure the camera is pointing to the right space
• Clear the space
• Click on the Save Background button or press Ctrl+b on the keyboard

4. Play with the parameters, select presets or start the sequencer.

Shortcuts

On the GUI window:

• Ctrl+b Save background

On the main simulation window:

• f Toggle fullscreen
• 1-9 Change the presets (combine with shift for 10-19)
• Shift+ 1-9 Save the current preset
• Ctrl+s Save the preset on the current slot
• Ctrl+c Clear the current preset slot
• space Start/stop the sequencer
• t Mutates the current preset
• m Mutes the audio