HEX @ MICCAI 2026

Sep 15, 2026 1 min read

HEX @ MICCAI 2026

We are excited to be part of MICCAI 2026, where Shiyu Li will present our work on a multi-camera AR guidance system for surgical instrument handling and assembly. The paper, “Multi-Camera AR Guidance System for Surgical Instrument Handling and Assembly: Investigating Workload and Efficiency,” presents a marker-free AR system that combines multi-camera 6D pose estimation with in-situ visualization on a head-mounted display. The system provides step-by-step assembly guidance and tooltip localization to support scrub nurses during surgical instrumentation. In a user study with 29 scrub nurses, the AR system reduced task completion time by 21.3% compared with a paper manual, while also lowering perceived workload. The benefits were particularly pronounced for participants with less experience with the instrument set. The work demonstrates the potential of marker-free multi-camera AR to improve efficiency and support clearer, less cognitively demanding workflows in surgical environments.

Authors: Shiyu Li, Julian Kreimeier, Hannah Schieber, Dirk Müller, Bernhard Kainz, Rüdiger von Eisenhart-Rothe, Daniel Roth

Daniel Roth
Daniel Roth
Director

Assistant professor at TU Munich and Director of the HEX Lab