Extended Reality Teleconsultation for Medical Interventions: State of the Art and Perspectives

Extended Reality Teleconsultation for Medical Interventions: State of the Art and Perspectives

Abstract

Objective: Extended reality (XR) teleconsultation is used in surgery and medical emergencies, employing various technological approaches that differ in accuracy, timeliness, and user preference. Methods: We conducted a systematic literature review following PRISMA. We searched the databases IEEE Xplore, Springer Link, ACM and added an additional manual search. In total, we found 187 studies and included 14 in our review.
Conclusion: Our findings highlight the widespread use of video-based streaming and 3D reconstruction based on static RGB-D sensor. We found limitations in the reconstruction quality, where existing work would benefit from high-quality rendering. Interaction via annotations is common, addressing key usability needs for various surgeries and emergency situations. A standardized evaluation for interaction techniques would be beneficial for comparability. Our findings hold significant implications for improving teleconsultation and evaluation of XR telemedicine approaches.

Publication
IEEE Conference on Virtual Reality and 3D User Interfaces Extended Abstracts and Workshops (VRW) 2025

Hannah Schieber
Hannah Schieber
Doctoral Candidate

I am interested in computer vision and extended reality. I research 3D scene content creation using neural rendering and guidance of people in 3D.

Luisa Theelke
Luisa Theelke
Doctoral Candidate

Luisa is a Doctoral candidate at the Professorship for Machine Intelligence in Orthopedics / Human-Centered Computing and Extended Reality Lab of TU Munich.

Julian Kreimeier
Julian Kreimeier
Senior Researcher

I research human-computer interaction, accesibility and extended reality.

Daniel Roth
Daniel Roth
Director

Assistant professor at TU Munich and Director of the HEX Lab