Cross-Modal Associations between Color and Haptics

Slobodenyuk, Nadiya; Jraissati, Yasmina; Kanso, Ali; Ghanem, Lama; Elhajj, Imad H.

doi:10.3758/s13414-015-0837-1

Cited by 43 publications

(40 citation statements)

References 58 publications

(58 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the hypotheses, we suggested that luminance and pitch were likely to form CMCs with tactile viscosity because previous experiments (Eitan and Rothschild, 2010;Slobodenyuk et al, 2015;Walker et al, 2010;Ward et al, 2008) had indicated that there are links between the resistance a solid object puts up to movement and the dimensions of luminance and pitch. Viscosity can also be parsed as resistance to movement; hence, any CMC involving resistance to movement may have the same underlying mechanism -though this is unlikely given that only the thin liquid is linked with the high pitch and only the thick liquid is linked with low luminance in Experiment 2.…”

Section: Discussionmentioning

confidence: 96%

“…However, weight, elasticity and adhesion of solid objects may be thought of as similar to the viscosity of liquid objects, since they all directly relate to the resistance an object puts up to movement. Thus, based on the findings of Eitan and Rothschild (2010), Slobodenyuk et al (2015), Walker et al (2010) and Ward et al (2008), we can predict that high viscosity should be matched with low luminance and low pitch. Based on Slobodenyuk et al, the relationship between saturation and viscosity is likely to be non-linear -however, since we are using a two-alternative forced choice (2AFC) paradigm this relationship may not be apparent; rather, this CMC is likely to be weakly significant or nonsignificant (a non-significant result here may, of course, also indicate the lack of a CMC).…”

Section: Introductionmentioning

confidence: 91%

“…Are they linear, like the relationship between elasticity and luminance, or non-linear, like the relationship between elasticity and saturation (Slobodenyuk et al, 2015)? Again, we are assessing this in follow-up studies.…”

Section: Future Directionsmentioning

confidence: 99%

See 2 more Smart Citations

Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity

2016

View full text Add to dashboard Cite

Past research on crossmodal correspondences as they relate to tactile perception has largely been restricted to solid substances. We investigated the role of haptically explored liquid viscosity in crossmodal correspondences with visually presented luminance, saturation, roundedness, size, number and visual elevation, as well as pure-tone pitch and kiki-bouba-type letter strings. In Experiment 1, we presented two tactile and two visual or auditory stimuli simultaneously, and found significant interparticipant agreement (n = 32) when pairing viscosity with luminance, saturation, roundedness, size, pitch and letter string type. To assess whether these crossmodal correspondences were relative or absolute, another 32 participants were presented, in Experiment 2, with two tactile stimuli but only one visual/auditory stimulus per trial. In this second experiment, we found that high viscosity was paired with low luminance, roundness, low saturation, and the bouba-type letter string, while low viscosity was paired with high pitch. However, the inverse associations (e.g. low viscosity with high luminance, high viscosity with low pitch) were not significant. These findings indicate that viscosity can be added to the list of dimensions that invoke crossmodal correspondences, and that the majority of crossmodal correspondences involving viscosity are absolute rather than relative, since they appear without explicit comparisons along the visual/auditory dimensions we measured.

show abstract

Section: Discussionmentioning

confidence: 96%

Section: Introductionmentioning

confidence: 91%

See 1 more Smart Citation

Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity

2016

View full text Add to dashboard Cite

show abstract

“…The Penn Haptic Texture Toolkit (HaTT): In the toolkit [38] there are 100 different textures photographed and presented as RGB images. Each texture has associated normal force, acceleration, and position recordings gathered during unconstrained motions of an impedance-type haptic device SensAble Phantom Omni [39]. To save time needed for training, in our experiments we used data from 10 classes only, the names of which were presented in Table 1.…”

Section: Multi-modal Datasetsmentioning

confidence: 99%

On Robustness of Multi-Modal Fusion—Robotics Perspective

2020

View full text Add to dashboard Cite

The efficient multi-modal fusion of data streams from different sensors is a crucial ability that a robotic perception system should exhibit to ensure robustness against disturbances. However, as the volume and dimensionality of sensory-feedback increase it might be difficult to manually design a multimodal-data fusion system that can handle heterogeneous data. Nowadays, multi-modal machine learning is an emerging field with research focused mainly on analyzing vision and audio information. Although, from the robotics perspective, haptic sensations experienced from interaction with an environment are essential to successfully execute useful tasks. In our work, we compared four learning-based multi-modal fusion methods on three publicly available datasets containing haptic signals, images, and robots’ poses. During tests, we considered three tasks involving such data, namely grasp outcome classification, texture recognition, and—most challenging—multi-label classification of haptic adjectives based on haptic and visual data. Conducted experiments were focused not only on the verification of the performance of each method but mainly on their robustness against data degradation. We focused on this aspect of multi-modal fusion, as it was rarely considered in the research papers, and such degradation of sensory feedback might occur during robot interaction with its environment. Additionally, we verified the usefulness of data augmentation to increase the robustness of the aforementioned data fusion methods.

show abstract

“…Ward et al [160] demonstrated that low color luminance is closely associated with roughness and high pressure to the skin. In another study, Slobodenyuk et al [161] associated high color luminance with high smoothness, high softness, high elasticity, and low adhesion. Conducting research in a more applicable setting, Tu et al [142] evaluated consumer product expectations by examining food-product packaging using various materials, and found that organic glass was perceived as “bright”.…”

Section: Effects Of Hand-feel Touch Cues On Perceptions Of Other Smentioning

confidence: 99%

Hand-Feel Touch Cues and Their Influences on Consumer Perception and Behavior with Respect to Food Products: A Review

Pramudya

Seo

2019

Foods

View full text Add to dashboard Cite

There has been a great deal of research investigating intrinsic/extrinsic cues and their influences on consumer perception and purchasing decisions at points of sale, product usage, and consumption. Consumers create expectations toward a food product through sensory information extracted from its surface (intrinsic cues) or packaging (extrinsic cues) at retail stores. Packaging is one of the important extrinsic cues that can modulate consumer perception, liking, and decision making of a product. For example, handling a product packaging during consumption, even just touching the packaging while opening or holding it during consumption, may result in a consumer expectation of the package content. Although hand-feel touch cues are an integral part of the food consumption experience, as can be observed in such an instance, little has been known about their influences on consumer perception, acceptability, and purchase behavior of food products. This review therefore provided a better understanding about hand-feel touch cues and their influences in the context of food and beverage experience with a focus on (1) an overview of touch as a sensory modality, (2) factors influencing hand-feel perception, (3) influences of hand-feel touch cues on the perception of other sensory modalities, and (4) the effects of hand-feel touch cues on emotional responses and purchase behavior.

show abstract

Cross-Modal Associations between Color and Haptics

Cited by 43 publications

References 58 publications

Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity

Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity

On Robustness of Multi-Modal Fusion—Robotics Perspective

Hand-Feel Touch Cues and Their Influences on Consumer Perception and Behavior with Respect to Food Products: A Review

Contact Info

Product

Resources

About