A View on Fuzzy Systems for Big Data: Progress and Opportunities

Abstract

Currently, we are witnessing a growing trend in the study and application of problems in the framework of Big Data. This is mainly due to the great advantages which come from the knowledge extraction from a high volume of information. For this reason, we observe a migration of the standard Data Mining systems towards a new functional paradigm that allows at working with Big Data. By means of the MapReduce model and its different extensions, scalability can be successfully addressed, while maintaining a good fault tolerance during the execution of the algorithms. Among the different approaches used in Data Mining, those models based on fuzzy systems stand out for many applications. Among their advantages, we must stress the use of a representation close to the natural language. Additionally, they use an inference model that allows a good adaptation to different scenarios, especially those with a given degree of uncertainty. Despite the success of this type of systems, their migration to the Big Data environment in the different learning areas is at a preliminary stage yet. In this paper, we will carry out an overview of the main existing proposals on the topic, analyzing the design of these models. Additionally, we will discuss those problems related to the data distribution and parallelization of the current algorithms, and also its relationship with the fuzzy representation of the information. Finally, we will provide our view on the expectations for the future in this framework according to the design of those methods based on fuzzy sets, as well as the open challenges on the topic.

CFM-BD: A Distributed Rule Induction Algorithm for Building Compact Fuzzy Models in Big Data Classification Problems

“…Given the success of fuzzy classifiers in a wide range of fields [2]- [8], designing scalable solutions seems worth the effort. In [39], the authors provide an overview of the progress and opportunities of fuzzy logic in Big Data environments.…”

A Novel Data Mining Approach for Big Data Based on Rough Sets and Fuzzy Logic

“…Fernandez et al provided a brief view on fuzzy systems for big data and the challenges and the opportunities facing this new framework. They introduced a fuzzy rule selection algorithm and emphasized the necessity of migrating programming towards Spark and Flink as newest frameworks of big data analysis [26][27][28][29]. In [30] Rochd and Hafidi presented a new approach for mining frequent itemsts in big data based on Hadoop by using N-List and they suggested HPrePostPlus Algorithm for mining frequent itemsts.…”

An overview of emerging pattern mining in supervised descriptive rule discovery: taxonomy, empirical study, trends, and prospects

“…There is an unexplored field of research which seems to be promising for obtaining descriptive EPs. Nowadays we generate high volumes of data, with great variety, at high speed in noisy environments, and it is necessary to maintain their veracity. This defines the 4V's model of Big Data, which is a hot topic in the fields of enterprise and academia . In this review, it has been shown that EPM is complex when the amount of data is huge, namely the number of variables.…”