Interactive 3D visualization for space exploration

Die Marsoberfläche mit geologischen Markierungen versehen.
Die Shaler Region des Mars mit geologischen Annotationen in PRo3D.

The exploration of space and far-away planets such as Mars demands a wide range of different technological instruments through which information encoded in image and sensor data can be sent to Earth. In the context of the Mars rover missions Perseverance of NASA as well as ExoMars of the ESA, VRVis, jointly with JOANNEUM Research, who plays a leading role in the development of the rover's main cameras, has developed the innovative 3D viewer PRo3D, which makes it possible to reconstruct orbiter and Mars rover camera images down to the smallest detail and to visualize them in 3D. Immediately after the landing of NASA's Perseverance rover on Mars, the versatile 3D visualization tool was used to generate the first 3D overflight videos to share the NASA rover's first steps on the distant planet with the general public. PRo3D's high-resolution digital surface models, which can be rendered in just a few steps, also provide a fundamental basis for planetary geology to bring distant worlds, such as asteroid surfaces in the context of impact research, to Earth.

Analysis tools for planetary geology

Oberfläche der PRo3D-Software, die einen Marsoberflächenausschnitt
3D-Modell der Marsoberfläche im PRo3D-Viewer mit geologischen Interpretationen.

Highly detailed 3D reconstructions from satellite and ground-based sensor data enable geologists to analyze the surface structures of distant planets such as Mars. Significant here is the possibility of targeted geological interpretations, which can provide answers to questions such as the past of planets, the probability of past water deposits, or possible locations for bio-signatures. For this purpose, PRo3D offers special tools that allow scientists from different Mars rover instrument teams to work synergistically to analyze, annotate, and comprehensively explore heterogeneous mission data in a single framework.

Simulation and generation of training data for deep learning

Visualisierung in PRo3D mit Positionierung eines Strahlenkegels
Maske für die Positionierung eines Strahlenkegels in der Shaler-Region des Mars.

For Mars rover missions, identifying promising scientific targets is of utmost importance. Since mission planning from Earth is challenging, the ideal solution would be to develop Mars rovers further so that they can "autonomously" identify relevant targets for measurements and on-site sampling. For the training of a deep learning system developed by project partner SLR, VRVis also created a method to automatically render a wide variety of images from existing reconstructions of the Martian surface. The DL system was trained to detect shatter cones caused by asteroid impacts.

Extended reality for space weather exploration

A small piece of the Sun, a star and the Earth can be seen.
Through new virtual reality solutions, VRVis and DLR are creating the possibility to better understand complex space weather phenomena scientifically and also to make them comprehensible to the general public.

Space weather and the effects that weather phenomena such as solar storms can have on Earth are receiving more and more attention as a research question. However, due to the high complexity, it is crucial to present the topic in a way understandable for scientists and the interested general public. Using innovative VR and AR solutions, extended reality offers an excellent opportunity to visualize complex weather data in a low-threshold way: for human-centered analysis, simulation, and communication.

Super Resolution Reconstruction for the optimization of satellite imagery

Two satellite images side by side, the original image on the left is pixelated, the image post-processed by VRVis (on the right) is much clearer.
VRVis' AI-assisted solution enhances the resolution and level of detail of Sentinel-2 satellite imagery (left) using specially applied Super Resolution Reconstruction technology (right).

Satellite images contain valuable information about the Earth's surface and the surrounding atmosphere, which makes them major data sources in the fight against climate change. However, many satellite images, especially those freely available, lack the level of detail necessary for effective work and research. To address this, VRVis is developing AI-based solutions that refine the resolution of freely available satellite imagery using adapted Super Resolution Reconstruction methods. The current goal of the research work is to create AI-based monitoring of small-scale agricultural areas that supports sustainable agriculture in the sense of the European Green Deal.

Videos about Mars and PRo3D

Our space research projects