Using the shape recovery method to evaluate indexing techniques

Abstract

Text representation, central to information processing, must be descriptive and discriminative. Although some of the many techniques to construct document representations may outperform others for certain tasks, no one is consistently better than others. Representations are still problematic. Evaluation techniques are needed to penetrate foundational questions about term behavior in representation. A study that applies the shape recovery analysis method is reported here as an evaluative tool to compare different indexing schemes. Three weight coefficients are used to rank indexing terms and are compared to the documents' full text. Two of the weight coefficients are novel and the third relies on the chi-squared distribution. Multidimensional scaling reduces the dimensional space of the document surrogates into a two-dimensional Cartesian space. Ten concentric circles evenly separated at 10% intervals of relevant data points starting at the centroid are used to construct a precision-recall curve. ANOVA is used for a straightforward computation of the 4 ؋ 11 matrix of test data to see whether the four treatments yield the same P-R result. A post hoc HSD Tukey multiple comparisons test among pairwise treatments is also used to discover homogeneous groups. The findings show the value of the methodology to study term weighting schemes, and their descriptiveness and discriminative power, as well as the potential strength of the novel coefficients introduced.

Issues of work–life balance among JASIST authors and editors

“…Besides appearing on the first page of each JASIST publication, the “publication history” of papers published since 2001 is also provided on their dedicated web pages. Histories are composed of the following metadata, with example values from Oyarce (): Manuscript received: 24 JUN 2007 Manuscript revised: 31 DEC 2007 Manuscript accepted: 1 JAN 2008 Article first published online: 14 MAY 2008 Issue published online: 9 JUN 2008 …”

“…Ladle, Malhado, and Todd (), for instance, using Google Scholar, found a 600% increase in the number of submissions received on Christmas Day in 2006 compared with the same day in 1996. The paper by Oyarce () provides yet another extreme example of a dedicated author and editor. According to our data, this revised JASIST paper was submitted on December 31, 2006, and accepted on January 1, 2007!…”

Organizing Acts and Objects: Metaphysical Foundations

“…One example from the LIS literature may assist here. Oyarce (2008) has established a model that can indicate relevant and non-relevant documents. See Figure 1.…”