Develop corpora and methods for cross-lingual text reuse detection for English Urdu language pair at lexical, syntactical, and phrasal levels

Cross-lingual Text Reuse Detection at Document Level for English-Urdu Language Pair

“…Recently, in another study, three large gold-standard cross-lingual text reuse detection corpora have been developed for the task of CLTRD along with cross-lingual methods for the English-Urdu language pair by Muneer et al [33]. The proposed cross-lingual corpora include CLEU-Lex, CLEU-Syn, and CLEU-Phr at the lexical, syntactical, and phrasal levels for the English-Urdu Language Pair.…”

“…The third gold standard bench-mark corpus named 'CLEU-Phr' contains 60,106 cross-lingual pairs with the source text in English and reused text in Urdu based on simulated cases at the phrasal level. The CLTR pairs were again manually labeled into three classes (Wholly Derived = 23,862, Partially Derived = 15,878, Non Derived = 20,366) [33]. Three diferent methods including baseline (Bi-lingual Dictionary), and proposed (Cross-lingual Semantic Tagger, CL-WE, and CL-ST).…”

“…Three diferent methods including baseline (Bi-lingual Dictionary), and proposed (Cross-lingual Semantic Tagger, CL-WE, and CL-ST). The best results were obtained with 1 score of (0.78, 0.94) for CLEU-Phr [33] for the ternary and binary classiication tasks respectively.…”

“…Table 1 shows the summarized literature as well as research gaps and highlights the speciic contributions of the proposed work. It can be seen from the table, diferent benchmark corpora including lexical, syntactical, phrasal [33], sentence [32], and sentence/passage [34] have been developed for the task of CLTRD for English-Urdu language pair. The existing corpora contain artiicial, simulated, and real cases of CLTR and CLP at the lexical, syntactical, phrasal, sentence, and passage levels.…”