Multiple Senses

This recently formed group focusses on methods and technologies employing more human senses than the traditional ones – seeing and hearing – in the interaction with computers.

Building on our main fields of expertise – Virtual reality and Visualization – VRVis has until now mainly dealt with the visual sense: as an output stream of data to the user in the form of interactive graphics and virtual and mixed environments, and as an input modality in the form of image and video processing. Many of the methods and technologies involved in successfully implementing a virtual environment, e.g. user tracking, real-time collision detection for interaction and registration techniques are applicable to other sensory channels such as haptics, sound and even olfactory stimuli.

Collaboration with experts on virtual acoustics enables us to integrate for precise spatial 3D audio using person specific HRTFs (head related transfer functions). Our research includes 2D to 3D conversion methods, scanning technology and 3D printing and computer aided machining. This allows for example to make data accessible to blind and visually impaired people, with a special focus on art in a museum context.

Our group will closely cooperate with the Visual Analytics group, the Semantic Modelling and Acquisition group and the Geospatial Visualization group. We will provide the visual analytics group with new and innovative interaction methods and output technologies. The Semantic Modelling and Acquisition group will support our development for acquisition methods for multiple senses. Together with the Geospatial Visualization group we will explore new environments for planetary sciences.

Competences

  • 3D interaction methods
  • Multi-sensory interfaces
  • Mixed reality & Augmented Reality
  • Virtual reality
  • Real-time sensors and associated data processing
  • Innovative output devices
  • Assisted living applications
  • 3D Printing and Computer Aided Machining

Team

Behind our smart solutions and software are smart and driven people.
Do you want to meet the team?

Publications

A. Reichinger, H. G. Carrizosa, J. Wood, S. Schröder, C. Löw, L. R. Luidolt, M. Schimkowitsch, A. Fuhrmann, S. Maierhofer, W. Purgathofer (2018): Pictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art. ACM Transactions on Accessible Computing.

C. Traxler, G. Hesina, A. Fuhrmann, K. Chmelina (2017): A Virtual Reality Monitoring System for Tunnel Boring Machines. Proceedings of the World Tunnel Congress 2017 – Surface challenges – Underground solutions. Bergen, Norway.

A. Fuhrmann, G. Hesina, S. Linsinger (2017): Reconstruction and Change Management for Cultural Heritage. Proceedings of the second international symposium on Virtual Reality & Visual Computing.

A. Reichinger, S. Schröder, C. Löw, S. Sportun, P. Reichl, W. Purgathofer (2016): Spaghetti, Sink and Sarcophagus: Design Explorations of Tactile Artworks for Visually Impaired People. The definitive version was published in Proc. NordiCHI`16.

References

Acoustic Research Institute, Akademie der Wissenschaften
AVL List GmbH
Kunsthistorisches Museum Wien
Berlinische Galerie
Galerie Belvedere
Technisches Museum Wien

Videos

Current Projects

Former Projects