A Mixed Reality Guidance System for Blind and Visually Impaired People

Overview of our approach.

Abstract

Persons affected by blindness or visual impairments are challenged by spatially understanding unfamiliar environments. To obtain such understanding, they have to sense their environment closely and carefully. Especially objects outside the sensing area of analog assistive devices, such as a white cane, are simply not perceived and can be the cause of collisions. This project proposes a mixed reality guidance system that aims at preventing such problems. We use object detection and the 3D sensing capabilities of a mixed reality head mounted device to inform users about their spatial surroundings.

Publication
IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR) 2022
We gratefully acknowledge funding for this study by d.hip campus.
Hannah Schieber
Hannah Schieber
Doctoral Candidate

I am interested in computer vision and extended reality. I research 3D scene content creation using neural rendering and guidance of people in 3D.

Constantin Kleinbeck
Constantin Kleinbeck
Doctoral Candidate

My research interests include Virtual and Augmented Reality, 3D Rendering, Interactivity and AI.

Luisa Theelke
Luisa Theelke
Doctoral Candidate

Luisa is a Doctoral candidate at the Professorship for Machine Intelligence in Orthopedics / Human-Centered Computing and Extended Reality Lab of TU Munich.

Daniel Roth
Daniel Roth
Director

Assistant professor at TU Munich and Director of the HEX Lab