Visual search in dynamic 3D visualisations of unstructured picture collections

Abstract

a b s t r a c tWe present two empirical studies of visual search in dynamic 3D visualisations of large, randomly ordered, photo collections. The aim is to assess the possible effects of geometrical distortions on visual search effectiveness, efficiency and comfort, by comparing the influence of two perspective representations of photo collections on participants' performance results and subjective judgments. Thumbnails of the 1000 or so photographs in each collection are plastered on the lateral surface of a vertical cylinder, either on the inside (inner view, IV) or on the outside (outer view, OV). IV and OV suggest two different interaction metaphors: locomotion in a virtual space (IV) versus manipulation of a virtual object (OV). They also implement different perspective distortions: enlargement and distortion of lateral columns (IV) versus enlargement of central columns and dwindling plus distortion of lateral columns (OV). Presentation of results focus on the second study, S2, which involved 20 participants and offered them strictly identical interaction facilities with the two views, unlike the initial pilot study, S1 (8 participants and slightly different interaction facilities between the two views).Participants in both studies were experienced computer users (average age: 25.15 years, SD: 3.13). They performed two types of basic visual tasks that are carried out repeatedly while navigating photo collections: (i) searching for a photo meeting specific, visual and thematic, criteria, the photo and its location in the collection being unknown to participants (ST1) and (ii) looking for a visually familiar photo, the location of the photo being familiar to participants (ST2).According to post-experiment questionnaires and debriefings, all participants in S2 save one judged both 3D views positively in reference to standard 2D visualisations. Half of them preferred IV over OV, four appreciated OV better, and six expressed no clear opinion. Preferences were mainly motivated by the effects of perspective distortions on thumbnail visibility. They were barely influenced by interaction metaphors (e.g., the feeling of immersion induced by IV).Despite large inter-individual differences in performance, a majority of participants carried out ST1 tasks more effectively and efficiently with IV than with OV, as regards error rates (statistically significant difference) and search times (tendency). Performance results for ST2 tasks were similar with the two views, due, probably, to the simplicity and brevity of ST2 tasks. Perspective distortions seem to have exerted less influence on participants' visual strategies than horizontal scrolling, a dynamic feature common to both views. Qualitative analyses of participants' behaviours suggest that IV has the potential to support spatial memory better than OV, presumably thanks to the locomotion metaphor.These results indicate that perspective views have the potential to facilitate and improve visual search in unstructured picture collections provided that distortions are adapted ...

An Evaluation of Color Sorting for Image Browsing

“…In our future work we aim to find out whether we can further improve search performance in a color-sorted storyboard by experimenting with more advanced image layouts by using 3D-technology and presenting the images in a cylindrical layout (e.g., [9], [13], [19]).…”

A Visual Search User Study on the Influences of Aspect Ratio Distortion of Preview Thumbnails

“…The main advantage of using distortion is that it eliminates the risk to lose vital visual information, which is likely to happen when an automatic cropping algorithm is used. Furthermore, not only conventional two-dimensional image browsing interfaces require thumbnails to be at a different aspect ratio than the original image, also more novel interfaces using 3D graphics, such as cylindrical displays [15], [16], as shown in Fig. 8, or spherical ones [17], rely on equal aspect ratios in order to arrange their thumbnails.…”

Three-Dimensional Information Retrieval (3DIR)

“…Similarly, early research by Robertson et al (1998) showed that users were able to retrieve electronic documents much more effectively when thumbnails were arranged visually than when documents attributes were listed textually. More recently, Christmann et al (2010) performed user tests with prototype interfaces for browsing photographs and found that interfaces were more effective when they used a 3D layout with perspective than a simple 2D visual layout.…”