NASA XR Operations Support System, XOSS , is a multi-user XR simulation software developed to help prepare for the next generation of human space exploration in hyper realistic environments.
XOSS Technology Demonstration
Developed in partnership with NASA
XOSS simulates the environment, conditions, and mission scenarios of an astronaut crew living on Mars and the Moon in real-time.
Key Technologies
400 sq.km of Lunar and Martian environments of Jezero and Shackleton Crater. Developed using high-fidelity satellite data from Lunar, Mars Reconnaissance Orbiter, and Earth analog photogrammetry and LiDAR.
Online multi-user communication system with built in delays and server persistence save system for session data collection. Tools for event and system and training administration.
Full-body motion capture XR in multiplayer with realistic astronaut tooling along with robotic and pressurized rover operations.
Artificial Intelligence Support System for operational awareness in EVA environments.
Operational habitation concepts produced by NASA Labs and Centennial 3D-printed Challenge designs.
Worldspace XR User Interface with geospatial data capabilities and mapping.
Lunar, Mars, Low Earth Orbit Digital Twins
400 sq.km of Lunar and Martian environments of Jezero and Shackleton Crater. Developed using high-fidelity satellite data from Lunar, Mars Reconnaissance Orbiter, and sub-millimeter Earth analog photogrammetry and LiDAR. Integration with Cesium Moon provides geographically accurate terrain models. This is powered with support for Multi-GPU Rendering, Regolith Physics simulation, in VR for Unreal Engine.
Environmental layers guide users with real-world gravity, physics, regolith behavior, and surface, radiation, temperatures. Co-developed with SpaceData and University of Central Florida.
AI Training Agent procedures for EVA/IVAs.
As part of the development for use in simulated training environments, XOSS features an embedded AI agent used for guidance and training. The multi-modal agent can provide feedback via synthetic vision analysis in real-time.
Can provide step-by-step visual guidance via HUD waypoints, information markers, and stored session data. Can provided real-time feedback during procedures.
Can be finetuned on specific tasking and robotics usage control via voice. Interaction with robotic equipment and other visual tasks can be linked to robotic support systems such as ROS2.
Collaborations
XOSS is built from the ground up consolidating the latest in NASA research to envision future endeavors. It opens the door to capture innovation from industry engaged in designing for the next generation of space exploration.
Download the open-source XOSS Editor and design your own vision for the future of space.
Leveraging the latest in real-time graphics, XOSS is powered by Epic Games’ Unreal Engine 5
Simulating a future mission
XOSS is used for simulating Mars human presence in NASA’s CHAPEA project, a one-year analog mission performed at NASA Johnson Space Center. Astronauts will live and perform simulated mission operations using the software while interacting in a mixed reality environment.
