In this paper, a personal assistant and navigator system for visually impaired people will be described. The showcase presented intends to demonstrate how partially sighted people could be aided by the technology in performing an ordinary activity, like going to a mall and moving inside it to nd a specic product. We propose an Android application that integrates Pedestrian Dead Reckoning and Computer Vision algorithms, using an o-the-shelf Smartphone connected to a Smartwatch. The detection, recognition and pose estimation of specic objects or features in the scene derive an estimate of user location with sub-meter accuracy when combined with a hardware-sensor pedometer. The proposed prototype interfaces with a user by means of Augmented Reality, exploring a variety of sensorial modalities other than just visual overlay, namely audio and haptic modalities, to create a seamless immersive user experience. The interface and interaction of the preliminary platform have been studied through specic evaluation methods. The feedback gathered will be taken into consideration to further improve the proposed system.

Personal Shopping Assistance and Navigator System for Visually Impaired People

Chippendale, Paul Ian;Modena, Carla Maria;Messelodi, Stefano;
2014

Abstract

In this paper, a personal assistant and navigator system for visually impaired people will be described. The showcase presented intends to demonstrate how partially sighted people could be aided by the technology in performing an ordinary activity, like going to a mall and moving inside it to nd a specic product. We propose an Android application that integrates Pedestrian Dead Reckoning and Computer Vision algorithms, using an o-the-shelf Smartphone connected to a Smartwatch. The detection, recognition and pose estimation of specic objects or features in the scene derive an estimate of user location with sub-meter accuracy when combined with a hardware-sensor pedometer. The proposed prototype interfaces with a user by means of Augmented Reality, exploring a variety of sensorial modalities other than just visual overlay, namely audio and haptic modalities, to create a seamless immersive user experience. The interface and interaction of the preliminary platform have been studied through specic evaluation methods. The feedback gathered will be taken into consideration to further improve the proposed system.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11582/249425
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact