Distribution Based Stemmer Refinement

Narayan, B. L.; Pal, Shantanu

doi:10.1007/11590316_108

Cited by 2 publications

(1 citation statement)

References 11 publications

(10 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This is not the case since there are many documents that are returned for a word, but they are not returned for the conflated forms. Many stemming papers [27] point out that stemming reduces the size of index files considerably. They propose to use one index file to hold pointers to all documents having any of the conflated forms of a word.…”

Section: Query: Croutons Eztk Fabbosmentioning

confidence: 99%

Google stemming mechanisms

Uyar

2009

Journal of Information Science

View full text Add to dashboard Cite

In this study we investigated the stemming mechanisms of Google. We used its web interface and submitted many queries via a program. Stemming is the process of correlating morphologically similar words with one another. Search engines use stemming to match documents having one form of a word with queries having another form of the same word. We investigated the stemming mechanism of Google for three classes of words: singulars/plurals, combined words, and verbs with many postfixes. Our results indicate that Google uses a document-based algorithm for stemming. It evaluates each document separately and makes a decision to index or not for the conflated forms of the words it has. It indexes documents only for word forms that are semantically strongly correlated. While it indexes documents for singulars and plurals frequently, it rarely indexes documents for word forms with the postfixes of -able or -tively.

show abstract

Section: Query: Croutons Eztk Fabbosmentioning

confidence: 99%