Research projects

In the PanCam-3D project, VRVis and Joanneum Research continue their long-standing research cooperation regarding the development of interactive 3D visualizations using the planetary exploration tool PRo3D in the context of the ExoMars 2022 mission.

The ExoMars rover Rosalind Franklin was scheduled to land on Mars in June 2023, carrying a number of novel research instruments. Despite the postponement of the launch due to the current geopolitical situation, we continue our research efforts focused on providing support for the scientific evaluation of the rover's instruments. One of the instruments is the PanCam multi-camera system, which will transmit color and stereo panoramic images to Earth and serve as the primary source for scientific digital terrain mapping and geologic context provision of the Martian surface. A key element of PanCam's capabilities will be its cutting-edge 3D vision components, allowing unprecedented "real-world" impressions of the Martian surface, from multispectral imaging to optical depth measurements of dust. For the interactive exploration of the 3D reconstructions created by Joanneum Research from the PanCam panoramic images, the 3D visualization tool PRo3D will be further developed.

The 3D viewer PRo3D, which among other things, is also already part of NASA's Mars 2020 mission (Perseverance) and provided the world's first Mars fly-over video, was developed as part of the long-standing, successful collaboration between VRVis and Joanneum Research. For about a decade, the two research institutions - together with renowned international partners - have been developing solutions that use 3D visualization and computer vision technology to capture distant planets as digital twins for planetary research in as much detail and as many layers as possible.

PRo3D functionalities and features

The ExoMars rover's PanCam camera system offers a broad range of functionalities that, in addition to detailed mapping and rock analysis, also help trace evidence of former life on Mars. To make these vast amounts of diverse geological and spatial data understandable to the PanCam team on Earth, the 3D visualization tool PRo3D transforms all available information into immersive and interactive 3D renderings. Using PRo3D, planetary scientists can thus explore the virtually reconstructed Martian surface and perform geological analyses. On the one hand, this helps to better understand the planet's geography and geology from great distances down to the microscopic image range. On the other hand, cooperation between planetary scientists will also be systematically supported in the future, e.g., by employing storytelling methods. Furthermore, the specially developed interactive PRo3D View Planner will help identify optimal rover camera positions based on visibility analysis and simulated camera images from digital terrain models (DTM).

Austrian space research for distant - and near - worlds

In recent years, Austria has emerged as a recognized and highly visible partner in Europe and around the world in the field of space science, which is also reflected in the ambitious Space Strategy 2030+ of the Federal Ministry of Climate Action, Environment, Energy, Mobility, Innovation, and Technology. For already a decade, VRVis has been addressing how application-oriented visual computing technologies can support planetary exploration. With the visualization tool PRo3D, a software has been developed that enables researchers from various disciplines to explore virtual 3D planetary surfaces and work on them collaboratively with specially developed tools. The developed visualization and interaction methods are promising solutions for geological questions in general, also perfectly suited for use on earth, e.g., in tunneling and archaeology.