Distributed Fuzzy Cognitive Maps for Feature Selection in Big Data Classification
Date
2022Language
en
Keyword
Abstract
The features of a dataset play an important role in the construction of a machine learning model. Because big datasets often have a large number of features, they may contain features that are less relevant to the machine learning task, which makes the process more time-consuming and complex. In order to facilitate learning, it is always recommended to remove the less significant features. The process of eliminating the irrelevant features and finding an optimal feature set involves comprehensively searching the dataset and considering every subset in the data. In this research, we present a distributed fuzzy cognitive map based learning-based wrapper method for feature selection that is able to extract those features from a dataset that play the most significant role in decision making. Fuzzy cognitive maps (FCMs) represent a hybrid computing technique combining elements of both fuzzy logic and cognitive maps. Using Spark’s resilient distributed datasets (RDDs), the proposed model can work effectively in a distributed manner for quick, in-memory processing along with effective iterative computations. According to the experimental results, when the proposed model is applied to a classification task, the features selected by the model help to expedite the classification process. The selection of relevant features using the proposed algorithm is on par with existing feature selection algorithms. In conjunction with a random forest classifier, the proposed model produced an average accuracy above 90%, as opposed to 85.6% accuracy when no feature selection strategy was adopted. © 2022 by the authors.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Development and Evaluation of a Fuzzy Inference System and a Neuro-Fuzzy Inference System for Grading Apple Quality
Papageorgiou E.I., Aggelopoulou K., Gemtos T.A., Nanos G.D. (2018)In this research work, a fuzzy inference system (FIS) and an adaptive neuro-fuzzy inference system (ANFIS) were developed to classify apple total quality based on some fruit quality properties, i.e., fruit mass, flesh ... -
Constructive Fuzzy Cognitive Map for Depression Severity Estimation
Sovatzidi G., Vasilakakis M., Iakovidis D.K. (2022)Depression is a common and serious medical disorder that negatively affects the mood and the emotions of people, especially adolescents. In this paper, a novel framework for automatically creating Fuzzy Cognitive Maps ... -
Introducing Fuzzy Cognitive Maps for decision making in precision agriculture
Markinos, Ath; Papageorgiou, El; Stylios, Chr; Gemtos, Th (2007)A Fuzzy Cognitive Maps (FCMs) is a modelling methodology based on exploiting knowledge and experience. It comprises the main advantages of fuzzy logic and neural networks, representing a graphical model that consists of ...