Information Retrieval using Cosine and Jaccard Similarity Measures in Vector Space Model

Jain, Abhishek; Jain, Aman; Chauhan, Nihal; Singh, Vikrant; Thakur, Narina

doi:10.5120/ijca2017913699

Cited by 16 publications

(13 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…First, we use Jaccard similarity as another measure of content similarity. Jaccard similarity is another basic and effective measure of the similarity between documents (Jain et al ., 2017). It measures the proportion of common words to unique words in two documents.…”

Section: Resultsmentioning

confidence: 99%

Corporate Innovation and Disclosure Strategy

Zhang¹,

Ying

et al. 2021

Abacus

View full text Add to dashboard Cite

This study investigates the impact of firm innovation on MD&A disclosure. Firms need to reduce information asymmetry to assist investors on the one hand and to prevent rivals from benefitting from disclosures on the other. Innovative firms can use an optimistic tone to convey good news but increase content similarity to reduce proprietary costs. Management chooses a certain content similarity and tone strategy for an innovation and as the number of innovations increases, the ratio of similar innovation disclosure and positive tone increases in the overall MD&A, resulting in greater content similarity and more news conveyed with a positive tone. We find that the firm's level of innovation is positively related to content similarity and tone optimism. We also find that this positive relation is more pronounced when product market competition is stronger and when regional intellectual property rights protection is weaker. Our further analyses on market responses provide evidence suggesting that management's disclosure strategy functions as intended.

show abstract

Section: Resultsmentioning

confidence: 99%

Corporate Innovation and Disclosure Strategy

Zhang¹,

Ying

et al. 2021

Abacus

View full text Add to dashboard Cite

show abstract

“…There were some limitations in this stage, such as the summarization made in Wikipedia's references, not-mentioning the full name of the journals and the one-word name of some journals. A similarity-finding approach was applied to determine the similarity between the references and journal titles aimed at overcoming these limitations.The Jaccard index was used to determine the similarity between the scientific references of the Persian Wikipedia and the titles of peer-reviewed journals because of its higher accuracy in this study and its frequent usage in text similarity-finding studies with similarity rates of 70% (Jain et al ., 2017; Niwattanakul et al ., 2013). Finally, the pages that used reputable PSPs in their references were identified.…”

Section: Methodsmentioning

confidence: 99%

Analyzing Persian Wikipedia's citations to discover the effectiveness of Persian scientific papers: applied web mining techniques

Rahimi

Danesh

2023

PMM

View full text Add to dashboard Cite

PurposeThe main objective of this study is to evaluate the impact of Persian Scientific Papers (PSPs) on Persian Wikipedia by studying Wikipedia's citations to these papers.Design/methodology/approachThe present study is applied research, which has been performed by the web-mining method, such as downloading web pages, extracting information (references), identifying papers, detecting peer-review journals and calculating the frequency rates. The statistical population included 10,000 Persian Wikipedia Pages (PWPs) that were analyzed in two rounds with a six-month interval.FindingsThe number of pages containing the Persian references section was 3,994 and 4,063 out of the 10,000 pages extracted in the first and second rounds. The ratio of pages that cited scientific sources (58 and 67 pages) to the pages extracted from the PWP was equal to 0.58 and 0.67%. The ratio of pages that cited scientific sources to pages with Persian references in each round was equal to 1.45 and 1.64%. The number of references extracted from the PWP in each round equaled 30,441 and 35,891. Eight titles from reputable Persian journals had received at least three citations from Wikipedia.Originality/valueThe present study has determined the extent of interaction between science and society (knowledge flow) in the form of citations from Wikipedia articles to articles in peer-reviewed journals. The study of this issue in Persian Wikipedia in more than 2000 Persian peer-reviewed journals shows the originality of the present paper. Studying citation reliability in a collaborative and openly editable platform is another originality of the work.

show abstract

“…The configuration used for the LSTM model included For similarity metrics between groups of terms, we con-414 sidered two different approaches: (i) Jaccard similarity as 415 a baseline [65], [66], and (ii) our own sophisticated metric 416 based on lexical and semantic proximity [67]. The cosine 417 distance was discarded provided that the terms in the de-418 scriptions had no logical ordering.…”

Section: A Experimental Data-setmentioning

confidence: 99%

Explainable Automatic Industrial Carbon Footprint Estimation From Bank Transaction Classification Using Natural Language Processing

et al. 2022

View full text Add to dashboard Cite

Concerns about the effect of greenhouse gases have motivated the development of certification protocols to quantify the industrial carbon footprint (CF). These protocols are manual, workintensive, and expensive. All of the above have led to a shift towards automatic data-driven approaches to estimate the CF, including Machine Learning (ML) solutions. Unfortunately, as in other sectors of interest, the decision-making processes involved in these solutions lack transparency from the end user's point of view, who must blindly trust their outcomes compared to intelligible traditional manual approaches. In this research, manual and automatic methodologies for CF estimation were reviewed, taking into account their transparency limitations. This analysis led to the proposal of a new explainable ML solution for automatic CF calculations through bank transaction classification. Consideration should be given to the fact that no previous research has considered the explainability of bank transaction classification for this purpose. For classification, different ML models have been employed based on their promising performance in similar problems in the literature, such as Support Vector Machine, Random Forest, and Recursive Neural Networks. The results obtained were in the 90 % range for accuracy, precision, and recall evaluation metrics. From their decision paths, the proposed solution estimates the CO 2 emissions associated with bank transactions. The explainability methodology is based on an agnostic evaluation of the influence of the input terms extracted from the descriptions of transactions using locally interpretable models. The explainability terms were automatically validated using a similarity metric over the descriptions of the target categories. Conclusively, the explanation performance is satisfactory in terms of the proximity of the explanations to the associated activity sector descriptions, endorsing the trustworthiness of the process for a human operator and end users.

show abstract

Information Retrieval using Cosine and Jaccard Similarity Measures in Vector Space Model

Cited by 16 publications

References 9 publications

Corporate Innovation and Disclosure Strategy

Corporate Innovation and Disclosure Strategy

Analyzing Persian Wikipedia's citations to discover the effectiveness of Persian scientific papers: applied web mining techniques

Explainable Automatic Industrial Carbon Footprint Estimation From Bank Transaction Classification Using Natural Language Processing

Contact Info

Product

Resources

About