This software implements a bio-inspired model for the control of vergence eye movements for robotic vision.
http://www.pspc.unige.it/Code/index.html
The software can be used for different purposes:
- For the binocular coordination of a robotic stereo head
- As test-bed for the study of vergence eye movements
- As a teaching tool to show vergence behavior and its implications
The robustness and adaptivity of the bio-inspired approach allows a control that is easily portable on stereo head with different kinematic characteristics, and that is robust to mechanical imprecision, as well as to changeable and unpredictable lighting condition of real environments.
- Easy portability on binocular robotic platforms with different geometries
- Real-time performance
- Effective alignment of the eyes/cameras in the 3D space (error < 0.2 deg)
- Control of both horizontal and vertical alignment of the eyes/cameras
- Software developed in C/C++ with OpenCV 3.3.1
- Cross-platform enabled using CMake
The source code is provided with an application example that loads a stereo pair from the Genoa Pesto Database. In the demo, the stereo pair is shown in anaglyph mode, and the robot fixation is simulated by the user clicking with the mouse cursor on the desired fixation point. The vergence control is then computed at fixation and vergence eye movements are simulated shifting the images proportionally to the control. If the control is working properly, the anaglyph at fixation turns to gray scale.
| The algorithm | The algorithm working on the iCub stereo head |
 |
 |
- Port the code in Python
For questions, comments or suggestions, reach out to the authors:
- Agostino Gibaldi 📧
- Mauricio Vanegas
- Andrea Canessa
- Silvio P. Sabatini
- Gibaldi, A., Vanegas, M., Canessa, A., & Sabatini, S. P. (2017). A portable bio-inspired architecture for efficient robotic vergence control. International Journal of Computer Vision, 121(2), 281-302.
- Gibaldi, A., Canessa, A., Chessa, M., Sabatini, S. P., & Solari, F. (2011). A neuromorphic control module for real-time vergence eye movements on the iCub robot head. In Humanoid Robots (Humanoids), 2011 11th IEEE-RAS International Conference on (pp. 543-550).