Information content measures of semantic similarity between documents based on Hadoop system

Birjali, Marouane; Beni‐Hssane, Abderrahim; Erritali, Mohammed; Madani, Youness

doi:10.1109/wincom.2016.7777212

Cited by 4 publications

(5 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The algorithm is based on the search for the word stems (the part of a word that represents its unchangeable part, expressing its lexical meaning) that meet in the text (Bhaumik et al, 2014; Birjali et al, 2016). To implement the process of searching for a word stem in a given source word (word type), Porter’s stemming is used (Popovič & Willett, 1992).…”

Section: Resultsmentioning

confidence: 99%

“…El algoritmo se basa en la búsqueda de las raíces de las palabras (la parte de una palabra que representa su porción inalterable que expresa su significado léxico) que se encuentran en el texto (Bhaumik et al, 2014; Birjali et al, 2016). Para ejecutar el proceso de búsqueda de una raíz en una palabra fuente determinada (tipo de palabra), se hace uso de la técnica stemming de Porter (Popovič & Willett, 1992).…”

Section: Resultsunclassified

“…El programa Fast Duplicate File Finder (buscador de ficheros duplicados) es una herramienta eficaz para buscar y determinar el grado de coincidencia entre los textos de los documentos (MindGems, 2021). Uno de los métodos de una evaluación cuantitativa formal de la información contenida en un documento es el análisis de contenidos, que facilita la evaluación de la semejanza semántica entre los textos de distintos documentos (Birjali et al, 2016; Butakova et al, 2013; Simankov y Tolkachev, 2014; Yadav et al, 2016).…”

Section: Asistencia Para La Toma De Decisiones En La Evaluación De La...unclassified

“…The Fast Duplicate File Finder program is an effective tool for searching and determining the degree of coincidence of document texts (MindGems, 2021). One of the methods of a formal quantitative assessment of the information contained in the document is content analysis, which makes it possible to assess the semantic similarity of the texts of documents (Birjali et al, 2016; Butakova et al, 2013; Simankov & Tolkachev, 2014; Yadav et al, 2016).…”

mentioning

confidence: 99%

See 3 more Smart Citations

Support for decision-making in checking the level of quality of student research works based on automated text analysis ( Asistencia para la toma de decisiones en la evaluación de la calidad de las investigaciones de los estudiantes basada en el análisis automático de textos )

Tarkhova,

Tarkhov,

Akhmetyanov

et al. 2023

Culture and Education

View full text Add to dashboard Cite

The purpose of this study is to increase the efficiency of the analysis process and the objectivity of decision-making on the final assessment, showing the quality of student research works based on the use of an automated text analysis software product. The total number of evaluated research papers was more than 300 (average age of students: 21.6; SD = 34). During the experiment, the effectiveness of the software product Multifunctional Text Analyser (MTA) was tested on the specified sample. The text of the analysed research works can be assessed as qualitative if the complex indicator of the text fragments congruence of the work exceeds 70%. The current article can be used as a methodological and theoretical basis for implementing the principles of academic virtue in institutions of higher education.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsunclassified

Section: Asistencia Para La Toma De Decisiones En La Evaluación De La...unclassified

mentioning

confidence: 99%

See 2 more Smart Citations

Support for decision-making in checking the level of quality of student research works based on automated text analysis ( Asistencia para la toma de decisiones en la evaluación de la calidad de las investigaciones de los estudiantes basada en el análisis automático de textos )

Tarkhova,

Tarkhov,

Akhmetyanov

et al. 2023

Culture and Education

View full text Add to dashboard Cite

show abstract

“…Nagwani [21] introduced a Map/Reduce framework of multi-document for text summarization. Many types of research are concerned with implementing techniques, algorithms, and approaches in parallel environments like Hadoop and Cloudera [22]- [24]. Hadoop is an Apache-based framework used to analyze massive data sets on clusters containing many machines, using Map and Reduce approach.…”

Section: Introductionmentioning

confidence: 99%

AgroSupportAnalytics: big data recommender system for agricultural farmer complaints in Egypt

Rslan

Khafagy²,

Ali³

et al. 2023

IJECE

View full text Add to dashboard Cite

<span>The world’s agricultural needs are growing with the pace of increase in its population. Agricultural farmers play a vital role in our society by helping us in fulfilling our basic food needs. So, we need to support farmers to keep up their great work, even in difficult times such as the coronavirus disease (COVID-19) outbreak, which causes hard regulations like lockdowns, curfews, and social distancing procedures. In this article, we propose the development of a recommender system that assists in giving advice, support, and solutions for the farmers’ agricultural related complaints (or queries). The proposed system is based on the latent semantic analysis (LSA) approach to find the key semantic features of words used in agricultural complaints and their solutions. Further, it proposes to use the support vector machine (SVM) algorithm with Hadoop to classify the large agriculture dataset over Map/Reduce framework. The results show that a semantic-based classification system and ﬁltering methods can improve the recommender system. Our proposed system outperformed the existing interest recommendation models with an accuracy of 87%.</span>

show abstract

Speech Assessment Based on Entropy and Similarity Measures

Ventura¹

2019

Advanced Computational Methods for Knowledge Engineering

View full text Add to dashboard Cite

Information content measures of semantic similarity between documents based on Hadoop system

Cited by 4 publications

References 9 publications

Support for decision-making in checking the level of quality of student research works based on automated text analysis ( Asistencia para la toma de decisiones en la evaluación de la calidad de las investigaciones de los estudiantes basada en el análisis automático de textos )

Support for decision-making in checking the level of quality of student research works based on automated text analysis ( Asistencia para la toma de decisiones en la evaluación de la calidad de las investigaciones de los estudiantes basada en el análisis automático de textos )

AgroSupportAnalytics: big data recommender system for agricultural farmer complaints in Egypt

Speech Assessment Based on Entropy and Similarity Measures

Contact Info

Product

Resources

About