Shape recovery: A visual method for evaluation of information retrieval experiments

Rorvig, Mark E.; Fitzpatrick, Steven J.

doi:10.1002/1097-4571(2000)9999:9999<::aid-asi1032>3.0.co;2-8

Cited by 6 publications

(6 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Next to it is the display of the metadata legend b As mentioned previously, graphical representation of search results are: point symbols on top of bull's eye metaphor and metadata mapping on top of the main map / thematic layers. The bull's eye metaphor has been used often in the field of information retrieval to signify the assessment of search results [30], [31]. In case of projecting search results into the bull's eye pane (Fig.…”

Section: Search Results Presentationmentioning

confidence: 99%

Aim4GDI: Facilitating the Synthesis of GDI Resources through Mapping and Superimpositions of Metadata Summaries

Aditya¹,

Kraak²

2007

Geoinformatica

View full text Add to dashboard Cite

In the world of geospatial data infrastructures, geoportals are developed to facilitate access and use of geospatial resources, including data. The design and implementation of effective and efficient geoportals are becoming crucial. Providing possibilities for users to organize and integrate available resources can arguably enhance the process of data discovery and spatial analysis required, and hence, is the focus of this paper. We argue that the synthesis of summaries of distributed datasets, map and feature services through the geoportal can present a coherent view to support data discovery. For this purpose, the atlas metaphor is used as an indexing server and integration interface of summaries. Thematic maps and a storyteller view are accessible through the atlas metaphor. They can be used to provide a supporting context for data discovery and access purposes.

show abstract

Section: Search Results Presentationmentioning

confidence: 99%

Aim4GDI: Facilitating the Synthesis of GDI Resources through Mapping and Superimpositions of Metadata Summaries

Aditya¹,

Kraak²

2007

Geoinformatica

View full text Add to dashboard Cite

show abstract

“…The Visualization Information Retrieval Interface conferences (VIRI) from ACM‐SIGIR (Asssociation of Computing Machinery‐Special Interest Group on Information Retrieval) generated interesting work on visual methods of evaluation (Havre, Hetzler, Perrine, Jurrus, & Miller, 2001; Korfhage, Lin, & Dubin, 1995; Rorvig, 1999a; Rorvig & Hemmje, 1996; Rorvig & Fitzpatrick, 1998; Rorvig et al, 1998; White & McCain, 1997; Zhang & Nguyen, 2005). Shape recovery (Rorvig & Fitzpatrick, 2000) is used to visually examine four treatments. For each treatment, the coefficients are used to rank terms and the top 200 are selected to construct document surrogates.…”

Section: Methodsmentioning

confidence: 99%

“…The first coefficient is based on the chi‐square statistic and the second on a discriminative function. The study uses a visualization technique, the shape recovery method (Ma, 2002; Rorvig & Fitzpatrick, 2000; Zhang & Nguyen, 2005), to discover variations among experimental treatments.…”

Section: Introductionmentioning

confidence: 99%

“…The angular distance, measured from the origin point of the document space, can also be used to derive similarity. A series of experiments with several metrics found that the cosine of the pairwise document angle consistently provided acceptable results for document clustering (Rorvig, 1999a; Rorvig & Fitzpatrick, 1998; Rorvig & Fitzpatrick, 2000).…”

Section: Introductionmentioning

confidence: 99%

“…Maintaining the rank of each data point, the procedure calculates all their coordinates. The methodology was called shape recovery , but some distortion is introduced by the scaling process (Rorvig & Fitzpatrick, 2000). In general, documents are expected to satisfy the hypothesis that relevant documents have greater cohesiveness and are closer to each other than to nonrelevant documents, which disperse into a periphery (Van Rijsbergen, 1989; Voorhees, 1985).…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Using the shape recovery method to evaluate indexing techniques

Oyarce

2008

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

Text representation, central to information processing, must be descriptive and discriminative. Although some of the many techniques to construct document representations may outperform others for certain tasks, no one is consistently better than others. Representations are still problematic. Evaluation techniques are needed to penetrate foundational questions about term behavior in representation. A study that applies the shape recovery analysis method is reported here as an evaluative tool to compare different indexing schemes. Three weight coefficients are used to rank indexing terms and are compared to the documents' full text. Two of the weight coefficients are novel and the third relies on the chi-squared distribution. Multidimensional scaling reduces the dimensional space of the document surrogates into a two-dimensional Cartesian space. Ten concentric circles evenly separated at 10% intervals of relevant data points starting at the centroid are used to construct a precision-recall curve. ANOVA is used for a straightforward computation of the 4 ؋ 11 matrix of test data to see whether the four treatments yield the same P-R result. A post hoc HSD Tukey multiple comparisons test among pairwise treatments is also used to discover homogeneous groups. The findings show the value of the methodology to study term weighting schemes, and their descriptiveness and discriminative power, as well as the potential strength of the novel coefficients introduced.

show abstract

A database selection expert system based on reference librarian's database selection strategy: A usability and empirical evaluation

Wei

2002

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

The proliferation of digital information resources and electronic databases challenges libraries and demands that libraries develop new mechanisms to facilitate and better inform user selection of electronic databases and search tools. We developed a prototype, Web-based database selection expert system based on reference librarian's database selection strategy. This system allows users to simultaneously search all databases available to identify databases most relevant to their quests using free-text keywords or phrases taken directly from their research topics. This article reports on (1) the initial usability test and evaluation of the Selector-the test design, methodology used, performance results; (2) summary of search query analyses; (3) user satisfaction measures; (4) the use of the findings for further modification of the Selector; and (5) the findings of using randomly selected subjects to perform a usability test with predefined searching scenarios. Future prospects of this research have also been discussed in the article.

show abstract

Shape recovery: A visual method for evaluation of information retrieval experiments

Cited by 6 publications

References 20 publications

Aim4GDI: Facilitating the Synthesis of GDI Resources through Mapping and Superimpositions of Metadata Summaries

Aim4GDI: Facilitating the Synthesis of GDI Resources through Mapping and Superimpositions of Metadata Summaries

Using the shape recovery method to evaluate indexing techniques

A database selection expert system based on reference librarian's database selection strategy: A usability and empirical evaluation

Contact Info

Product

Resources

About