Bachelor Thesis – MR for a collaborative yacht group training with the Apple Vision Pro

Immersive product training on the Apple Vision Pro – built for boat shows, showrooms, and interactive learning.

Overview

Understanding complex, invisible systems, such as a yacht’s power grid or communication networks, can be overwhelming for new buyers. For my Bachelor thesis in Expanded Realities at Darmstadt University of Applied Sciences, I developed a multiplayer Mixed Reality (MR) application for the Apple Vision Pro. Designed for boat shows like the “BOOT” in Düsseldorf, the experience enables groups of 2 to 5 participants to collaboratively explore a sail yacht’s technical features, guided by a moderator.

The Challenge

Yacht buyers often struggle to grasp how different energy systems, internet solutions, and device networks impact their boat’s performance and efficiency. Traditional brochures and static displays fail to effectively demonstrate these interconnected systems or simulate real-world scenarios. The challenge was to translate abstract data into an interactive, spatial experience that drives “aha” moments through collaborative learning.

The Solution & Key Features

Using principles of Multimedia Learning and the Socratic method, I built an interactive MR training that replaces technical manuals with high-fidelity spatial computing.

• Interactive Dioramas & Weather Simulation: Users can manipulate sliders for cloud coverage and wind speed. They instantly see the real-time impact on the yacht’s solar panels and wind turbines. This helps them learn how to balance green energy with combustion engines.
• Life-Size Scale & Sliced Views: To explain battery capacities and inverter limits, the virtual kitchen can be scaled to real-world size. Users interact with appliances to understand that not all devices can run simultaneously.
• Cross-Device Multiplayer: Powered by NSYNK’s Hyperslides framework, the session synchronizes virtual content precisely in the physical room for multiple Apple Vision Pro headsets. Passive viewers can join the session via an iPad AR app.
• Network Visualizations: Abstract concepts like NMEA 2000 data flows and satellite internet bandwidths are visualized through animated data packets and coverage dioramas.

The Results

The concept was validated through a comprehensive user test with 24 participants and industry experts. The feedback confirmed that the interactive 3D visualizations and the guided Socratic approach made complex topics highly understandable. The photorealistic rendering of the Apple Vision Pro significantly enhanced immersion and user engagement.

Tech Stack & Role

• Role: The project involved Concept, UI/UX Design, 3D Optimization, and Unity Development.
• Hardware: The primary hardware used was the Apple Vision Pro, alongside an iPad Pro and a MacBook Pro.
• Software & Frameworks: The development relied on Unity with PolySpatial, the NSYNK Hyperslides framework for multiplayer functionality, and tools like RapidCompact, Meshy.ai, Autodesk Maya, and Blender for 3D asset preparation.