State-of-art approach for Indian Language based on NER: Comprehensive Review

Abstract

Named Entity Recognition (NER) is a fundamental task of natural language processing (NLP) that focuses on the identification and classification of named entities such as name of individual persons, location, organization and dates within the text. NER plays a pivotal role in various NLP applications, including information extraction, question answering, text summarization and sentiment analysis. Natural language processing's (NLPs) fundamental issue is named entity recognition (NER). While extensive research has been conducted on NER for English and Hindi, the complexities of Indian languages present unique challenges that require customized solutions. Working with NER for Indian languages is a difficult endeavor with limited resources available. This article provides a comprehensive review of NER approaches tailored for Indian languages. Indian languages pose unique challenges to NER due to their rich morphological and syntactic variations, script diversity and limited annotated data availability. This paper reviews the various techniques and methodologies employed in NER for Indian languages, including rule-based, machine learning and deep learning approaches. It analyzes the strengths and limitations of each approach. Additionally, this article examines the recent advancements in transfer learning and multilingual models, showcasing their potential in improving NER performance across Indian languages. This paper aims to guide researchers and practitioners in the development of NER systems for Indian languages and foster further advancements in this field. This article also provides a comprehensive review of the diverse approaches employed for NER in Indian languages, highlighting the strength and limitations as well.