Solutions

Interactive 3D visualization for space exploration

The exploration of space and far-away planets such as Mars demands a wide range of different technological instruments through which information encoded in image and sensor data can be sent to Earth. In the context of the Mars rover missions Perseverance of NASA as well as ExoMars of the ESA, VRVis, jointly with Joanneum Research, who plays a leading role in the development of the rover's main cameras, has developed the innovative 3D viewer PRo3D, which makes it possible to reconstruct orbiter and Mars rover camera images down to the smallest detail and to visualize them in 3D. Immediately after the landing of NASA's Perseverance rover on Mars, the versatile 3D visualization tool was used to generate the first 3D overflight videos to share the NASA rover's first steps on the distant planet with the general public. PRo3D's high-resolution digital surface models, which can be rendered in just a few steps, also provide a fundamental basis for planetary geology to bring distant worlds, such as asteroid surfaces in the context of impact research, to Earth.

Analysis tools for planetary geology

Highly detailed 3D reconstructions from satellite and ground-based sensor data enable geologists to analyze the surface structures of distant planets such as Mars. Significant here is the possibility of targeted geological interpretations, which can provide answers to questions such as the past of planets, the probability of past water deposits, or possible locations for bio-signatures. For this purpose, PRo3D offers special tools that allow scientists from different Mars rover instrument teams to work synergistically to analyze, annotate, and comprehensively explore heterogeneous mission data in a single framework.

Simulation and generation of training data for deep learning

For Mars rover missions, identifying promising scientific targets is of utmost importance. Since mission planning from Earth is challenging, the ideal solution would be to develop Mars rovers further so that they can "autonomously" identify relevant targets for measurements and on-site sampling. For the training of a deep learning system developed by project partner SLR, VRVis also created a method to automatically render a wide variety of images from existing reconstructions of the Martian surface. The DL system was trained to detect shatter cones caused by asteroid impacts.

Extended reality for space weather exploration

Space weather and the effects that weather phenomena such as solar storms can have on Earth are receiving more and more attention as a research question. However, due to the high complexity, it is crucial to present the topic in a way understandable for scientists and the interested general public. Using innovative VR and AR solutions, extended reality offers an excellent opportunity to visualize complex weather data in a low-threshold way: for human-centered analysis, simulation, and communication.

Super Resolution Reconstruction for the optimization of satellite imagery

Satellite images contain valuable information about the Earth's surface and the surrounding atmosphere, which makes them major data sources in the fight against climate change. However, many satellite images, especially those freely available, lack the level of detail necessary for effective work and research. To address this, VRVis is developing AI-based solutions that refine the resolution of freely available satellite imagery using adapted Super Resolution Reconstruction methods. The current goal of the research work is to create AI-based monitoring of small-scale agricultural areas that supports sustainable agriculture in the sense of the European Green Deal.

PRo3D - interactive 3D visualization tool for planetary research

For a decade now, the Planetary Robotics 3D Viewer, short PRo3D, has been developed at VRVis together with renowned research partners such as Joanneum Research and Imperial College London. The interactive 3D visualization tool is integral to current NASA and ESA space missions, where PRo3D is used for geological analysis and interpretation. PRo3D's innovative visualization technology allows fluid navigation through high-resolution 3D visualizations of the Martian surface, reconstructed by Joanneum Research from orbiter and Mars rover camera images, while enabling planetary scientists to perform detailed remote geological analyses on these digital surface models. More about PRo3D.

Licensing

PRo3D is available for download at pro3d.space, including sample reconstructions of the Martian surface. Furthermore, PRo3D is also available as an open-source version on Github. For academic or commercial inquiries, please contact science(at)vrvis.at.

Videos about Mars and PRo3D

Our space research projects

Publications