A framework for retrieving Arabic documents based on queries written in Arabic slang language

Shatnawi, Mohammed Q.; Yassein, Muneer Bani; Mahafza, Reem

doi:10.1177/0165551512442480

Cited by 9 publications

(11 citation statements)

References 8 publications

(10 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The precision was calculated for each search engine's first 20 returned results ( Figure 3. Performance comparison between our system and SARS [21]. Both system were meant to handle dialectal queries and retrieve both dialectal and MSA documents.…”

Section: Resultsmentioning

confidence: 99%

“…Note that our system's result are based on 44 extended query retrieval searching 1429 documents, while SARS results are based on 20 queries searching 566 documents. is similar to Table 13 [21], although it uses a different set of queries. The comparison was done with the results obtained by our system using extended query retrieval while searching our full corpus of 1429 documents.…”

Section: Resultsmentioning

confidence: 99%

“…failed to retrieve any related document; and this was due to both engines considering ‫)مولم(‬ caterer (colloquial) as a typing error for ‫)مؤلم(‬ painful (MSA). The authors in Shatnawi et al [21] also experienced some failed retrieval by either or both search engines. This definitely shows that existing search engines are meant to cater for MSA and have a long way to go before they can cater for dialectal Arabic.…”

Section: Resultsmentioning

confidence: 99%

See 2 more Smart Citations

Modern information retrieval in Arabic – catering to standard and colloquial Arabic users

Azmi

Aljafari

2015

Journal of Information Science

View full text Add to dashboard Cite

The widespread use of colloquial dialects among the younger generation of Arabs is depriving many of them the fruits of information freedom. Although most Arabs have no problem with reading text in formal Arabic, widely known as Modern Standard Arabic (MSA), the younger generation is more adept at colloquial Arabic, mainly owing to the widespread use of social media. The current search engines cater mostly to MSA. This means that materials written in colloquial are off-limits to those who use MSA, and similarly the MSA contents are off-limits for those who communicate in colloquial only. To achieve the full potential of an information-retrieval system, we need a successful scheme that interprets queries whether they are in MSA, colloquial Arabic or a combination of both. In this paper we design an information-retrieval system that addresses our concern against the backdrop of one of the local dialects in Saudi Arabia. Our system is based on modifying an MSA stemming technique and a set of colloquial ↔ MSA conversion rules that are lexicon based. We tested the system using 44 queries on a corpus of over 1400 documents (MSA, colloquial, mix). The average precision was 84.3%, while the average recall was 96.5%. In the second test we compared the precision of the retrieved documents by our system vs Google and Yahoo! search engines. The respective average precisions were 78.2, 51.9 and 56.2%.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

Section: Resultsmentioning

confidence: 99%

See 1 more Smart Citation

Modern information retrieval in Arabic – catering to standard and colloquial Arabic users

Azmi

Aljafari

2015

Journal of Information Science

View full text Add to dashboard Cite

show abstract

“…Other studies also were concerned with building a framework in order to enhance the retrieval accuracy of Arabic information that use slang query and gives the system a way of dealing with query. So, this algorithm is based on context free grammar "CFG" that neglected the root of past, present, and command verbs in three steps which are: ignoring nouns, making sure if the syntactic rules for sentences are correct or not, and stripping their affixes (Shatnawi and et al, 2012).…”

Section: Algorithm In Jordanian Slang Languagementioning

confidence: 99%

Enhanced Arabic Information Retrieval by Using Arabic Slang Language

Ababneh¹,

Kanaan²,

Al-Jarrah³

2019

MAS

View full text Add to dashboard Cite

Slang language has become the most used language in the most countries. It has almost become the first language in the social media, websites and daily conversations. Moreover, it has become used in many conferences to clarify information and to deliver the required purpose of them. Therefore, this great spread of slang language over the world. In Jordan indicates that it is important to know meanings of Jordanian slang vocabularies. Mainly, In research system, we created a system framework allows users to restore Arabic information depending on queries that are written in slang language and this framework was made basically by context-free grammar to convert from slang to classical and vice versa. In addition, to conclude with, we will apply it on the colloquial slang in North of Jordan specifically; Irbid, Ajloun, Jerash, Mafraq and AlRamtha city. As well as, we will make a special file for Non_Arabic words and the stop words too. After we made an evaluation for the system relying on the results of recall, precision and F-measure where the results of precision about 0.63 for both researches slang and classical query, and this indicates that the system supports searching in Jordanian slang language. The purpose of this research is to enhance Arabic information retrieval, and it will be a significant resource for researchers who are interested in slang languages. As well as, it helps tie communities together.

show abstract

“…The work in this paper is part of ongoing research that started almost a year ago [1]. It is a fact that our everyday spoken language is different from the written one.…”

Section: Introductionmentioning

confidence: 99%

Classical to slang conversion for retrieving Arabic documents using slang queries

Shatnawi

Abuein

Mahafza

2014

Journal of Information Science

Self Cite

View full text Add to dashboard Cite

In the Arabic world, people speak two languages fluently: classical Arabic and slang Arabic. Being able to use slang Arabic terms in Web search queries will be considered a huge leap in modern research on Arabic information retrieval. It would be more comfortable to Arab Web users to obtain the required information available on the Web using slang Arabic queries. This research paper completes the work that was started a year ago in which the ultimate goal of this ongoing project is to design and build a system that is fully capable of replacing Arabic slang-based queries with their equivalent classical terms. The work that has been done in this paper aims to simplify the task for Arab Web users via enabling them to use their slang Arabic to make Web queries. This work provides promising results and shows that people who do not know how to write classical queries can use their slang language directly.

show abstract

A framework for retrieving Arabic documents based on queries written in Arabic slang language

Cited by 9 publications

References 8 publications

Modern information retrieval in Arabic – catering to standard and colloquial Arabic users

Modern information retrieval in Arabic – catering to standard and colloquial Arabic users

Enhanced Arabic Information Retrieval by Using Arabic Slang Language

Classical to slang conversion for retrieving Arabic documents using slang queries

Contact Info

Product

Resources

About