Perceptual dimensions for a dynamic tactile display

Abstract

We propose a new approach for converting graphical and pictorial information into tactile patterns that can be displayed in a static or dynamic tactile device. The key components of the proposed approach are (1) an algorithm that segments a scene into perceptually uniform segments; (2) a procedure for generating perceptually distinct tactile patterns; and (3) a mapping of the visual textures of the segments into tactile textures that convey similar concepts. We used existing digital halftoning and other techniques to generate a wide variety of tactile textures. We then conducted formal and informal subjective tests with sighted (but visually blocked) and visually-impaired subjects to determine the ability of human tactile perception to perceive differences among them. In addition to generating perceptually distinguishable tactile patterns, our goal is to identify significant dimensions of tactile texture perception, which will make it possible to map different visual attributes into independent tactile attributes. Our experimental results indicate that it is poosible to generate a number of perceptually distinguishable tactile patterns, and that different dimensions of tactile texture perception can indeed be identified.

Layout Transposition for Non-Visual Navigation of Web Pages by Tactile Feedback on Mobile Devices

“…This research has led to recommendations on texture composition parameters in terms of elementary shape, size, density, spacing, combination or orientation. From there, devices have been developed to facilitate access to diagrams by blind people [9][10][11][12][13][14]. However, they do not tackle the overall complexity of multi-modal web documents that may gather textual, visual, layout information, to name but a few.…”

The rough side of texture: texture analysis through the lens of HVEI

“…In order to transform an array of image intensities into a pattern of bumps to be displayed on a tactile device, we first segment the image into perceptually uniform segments, and then we map each segment into a distinct tactile pattern. 84 Each black dot in Fig. 8 (c) represents a bump, typically with a fixed radius and height.…”

Acoustic-tactile rendering of visual information

“…[10][11][12] Our ultimate goal is to present a map, diagram, or picture as a collection of segments with perceptually distinct acoustic-tactile textures, as shown in Figure 2. 13 In Ref. 7, our focus was on conveying object shape (e.g., circle, triangle, square) using a touch screen and acoustic feedback.…”

“…An important distinction is between approaches that directly translate visual information (image intensities) to an acoustic or tactile signal, 5,14,16,21,22 and those that utilize a semantic representation of the scene. 8,13,[23][24][25] The advantage of the former is that they bypass semantic analysis (e.g., scene segmentation, object identification, etc. ), which is a challenging and essentially open research problem.…”