Requirement Analysis for an AI-based AR Assistance System for Surgical Tools in the Operating Room: Stakeholder Requirements and Technical Perspectives

Abstract

We aim to investigate the integration of augmented reality (AR) within the context of increasingly complex surgical procedures and instrument handling toward the transition to smart operating rooms (OR). In contrast to cumbersome paper-based surgical instrument manuals still used in the OR, we wish to provide surgical staff with an AR head-mounted display that provides in-situ visualization and guidance throughout the assembly process of surgical instruments. Our requirement analysis supports the development and provides guidelines for its transfer into surgical practice.

Publication
Springer International Journal of Computer Assisted Radiology and Surgery

We gratefully acknowledge funding for this work by BMFTR (project KARVIMIO, grant number 16SV8973).
Julian Kreimeier
Julian Kreimeier
Senior Researcher

I research human-computer interaction, accesibility and extended reality.

Shiyu Li
Shiyu Li
Doctoral Candidate

My research interests include 3D vision, AR application.

Daniel Roth
Daniel Roth
Director

Assistant professor at TU Munich and Director of the HEX Lab