Seeing the Real Me: Experiencing Real-Body Pass-Through Embodiment and Interaction

Abstract

Embodiment is fundamental to immersive VR, yet traditional avatars often suffer from perceptual mismatches. Pass-Through Embodiment (PTE) addresses this by integrating a stereoscopic live video feed of the user’s body into the virtual environment. By combining depth-based segmentation with video-see-through streams, PTE provides a high-fidelity, photon-captured representation. We present the first public PTE demonstration, allowing users to perceive themselves while interacting with diverse virtual scenes. Participants can evaluate how their body, different edge rendering, and environmental contexts affect visual coherence in real-time. This demonstrates how PTE facilitates a naturally anchored sense of embodiment , bridging physical and virtual worlds through natural interaction .

Publication
IEEE Conference on Virtual Reality and 3D User Interfaces (VR) 2026 - Demo
Kristoffer Waldow
Kristoffer Waldow
Doctoral Candidate

Kristoffer is a Doctoral candidate at the Technical University of Munich, Human-Centered Computing and Extended Reality Lab and a research associate at the TH Köln, Computer Graphics research group. His field of interest is Mixed Reality (MR) technologies, especially human-computer interaction in MR environments to improve interpersonal communication and accessibility with avatars.

Daniel Roth
Daniel Roth
Director

Assistant professor at TU Munich and Director of the HEX Lab