An analytical study of information extraction from unstructured and multidimensional big data

Abstract

IntroductionInformation extraction (IE) process extracts useful structured information from the unstructured data in the form of entities, relations, objects, events and many other types. The extracted information from unstructured data is used to prepare data for analysis. Therefore, the efficient and accurate transformation of unstructured data in the IE process improves the data analysis. Numerous techniques have been introduced for different data types i.e. text, image, audio, and video.The advancement in technology promoted the rapid growth of data volume in recent years. The volume, variety (structured, unstructured, and semi-structured data) and velocity of big data have also changed the paradigm of computational capabilities of the systems. IBM estimated that more than 2.5 quintillion bytes of data are generated every Abstract Process of information extraction (IE) is used to extract useful information from unstructured or semi-structured data. Big data arise new challenges for IE techniques with the rapid growth of multifaceted also called as multidimensional unstructured data. Traditional IE systems are inefficient to deal with this huge deluge of unstructured big data. The volume and variety of big data demand to improve the computational capabilities of these IE systems. It is necessary to understand the competency and limitations of the existing IE techniques related to data pre-processing, data extraction and transformation, and representations for huge volumes of multidimensional unstructured data. Numerous studies have been conducted on IE, addressing the challenges and issues for different data types such as text, image, audio and video. Very limited consolidated research work have been conducted to investigate the task-dependent and task-independent limitations of IE covering all data types in a single study. This research work address this limitation and present a systematic literature review of state-of-the-art techniques for a variety of big data, consolidating all data types. Recent challenges of IE are also identified and summarized. Potential solutions are proposed giving future research directions in big data IE. The research is significant in terms of recent trends and challenges related to big data analytics. The outcome of the research and recommendations will help to improve the big data analytics by making it more productive. which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. Adnan and Akbar J Big Data (2019) 6:91 Malaysia Adnan and Akbar J Big Data (2019) 6:91 RESEARCHday. Among these statistics, it was also predicted that unstructured data from diverse sources will grow up to 90% in few years. IDC estimated that unstructured data will be 95% of the global data in 2020 with estimated 65% annual growth rate [1]. The common characteristics of unstructured data are, (i) it comes in multiple formats...

Artificial Intelligence–Aided Precision Medicine for COVID-19: Strategic Areas of Research and Development

“…Recent developments in NLP techniques have helped the automation of this process through machine learning and, in particular, deep learning algorithms [ 82 , 83 ]. Symptoms, patient demographics, clinical data, algorithms, performance, and limitations are identifiable in the texts by properly trained models, which can obtain comparable accuracy to humans at a much faster rate, making it finally possible to monitor the enormous volume of the literature produced [ 84 ]. The resulting structured data can be exploited to enrich knowledge graphs (KGs) [ 85 - 87 ], which provide a means to represent and formalize information [ 85 , 88 ], analytical, relational, and inferential investigations and fill the knowledge gaps in the community.…”

Big data monetization throughout Big Data Value Chain: a comprehensive review

“…The actual source of that data could be internal or external. Besides, these data can be created passively or actively by humans, systems or sensors, and, can follow heterogeneous formats such as structured, semi-structured or unstructured [34,35]. Once data generated, it will eventually power other systems through acquisition processes.…”

Challenges and Solutions for Processing Real-Time Big Data Stream: A Systematic Literature Review

“…Moreover, information extraction (IE) techniques required with the rapid growth of multifaceted also called as multidimensional unstructured data which are explored in a survey by [51]. Task-dependent and task-independent are the limitations of IE covering all data types.…”