Binaural SoundNet: Predicting Semantics, Depth and Motion With Binaural Sounds.

Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene understanding purely based on binaural sounds.