ARTFM: Augmented Reality Visualization of Tool Functionality Manuals in Operating Rooms

Constantin Kleinbeck, Hannah Schieber, Sebastian Andress, Christian Krautz, Daniel Roth
December 2022
Cite DOI Poster
Overview of our approach.

Abstract

Error-free surgical procedures are crucial for a patient’s health. However, with the increasing complexity and variety of surgical instruments, it is difficult for clinical staff to acquire detailed assembly and usage knowledge leading to errors in process and preparation steps. Yet, the gold standard in retrieving necessary information when problems occur is to get the paperbased manual. Reading through the necessary instructions is time-consuming and decreases care quality. We propose ARTFM, a process integrated manual, highlighting the correct parts needed, their location, and step-by-step instructions to combine the instrument using an augmented reality head-mounted display.

Type
Poster-Conference
Publication
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) 2022
We gratefully acknowledge funding for this study by d.hip campus.
Poster Publication
Constantin Kleinbeck
Constantin Kleinbeck
Doctoral Candidate

My research interests include Virtual and Augmented Reality, 3D Rendering, Interactivity and AI.

Hannah Schieber
Hannah Schieber
Doctoral Candidate

I am interested in computer vision and extended reality. I research 3D scene content creation using neural rendering and guidance of people in 3D.

Daniel Roth
Daniel Roth
Director

Assistant professor at TU Munich and Director of the HEX Lab