loading page

QuidEst: Real-Time Monocular Depth Map to Audio Signal Conversion Algorithm
  • Livio Tenze ,
  • Enrique Canessa
Livio Tenze
Author Profile
Enrique Canessa
ICTP - International Centre for Theoretical Physics

Corresponding Author:[email protected]

Author Profile

Abstract

We introduce QuidEst, a simplified computer vision-to audio signal application aiming to alert any autonomous navigator for potential threats in open spaces. It is based on associations made between real-time monocular depth map computations and spatial audio signals according to the proximity of obstacles. QuidEst is a C-based program that correlates nine specific depth map sub-regions of a video frame to spatial sound effects. The depth map is generated via MiDaS deep neural network method from a USB webcam or cellular phone camera, and the sonification within each sub-region is rendered by audio threads with a combination of faded musical notes.
QuidEst binares: https://github.com/canessae/Quidest
Supplemental video: https://www.youtube.com/watch?v=fsVbh53SRio