Marker-based image recognition of dynamic content for the visually impaired

Abstract

The access to information displayed in public spaces is a challenge faced by visually impaired people for which image processing techniques have the potential to deliver satisfac tory solutions. However, object recognition algorithms must initially locate possible candidates in the images, which is a hard task in complex scenes. In this article, we introduce an image processing technique that relies on the incorporation of markers to panels and boards with fixed layouts display ing dynamic content. The markers allow: a) locating the objects to be recognized; b) correcting perspective in the input images; c) limiting the training set size for supervised learning; and d) guiding the visually impaired by indicating how they should position their devices for adequate pictures. The proposed technique can be used for automatic recogni tion of texts and images and is suitable for deployment on mobile devices, providing more independence to the citizens. Results of preliminary tests on vending machines show that this method is robust enough to be used in practice.

Co-design of Color Identification Applications Using Scenario-Based Personas for People with Impaired Color Vision

“…Techniques range from color detection based on image processing (e.g. Seeing AI [9]) to fiducial marker-based methods [10,11].…”