Identification of most important features based on a fuzzy ensemble technique: Evaluation on joint space narrowing progression in knee osteoarthritis patients
Datum
2021Language
en
Schlagwort
Zusammenfassung
Objective: Feature selection (FS) is a crucial and at the same time challenging processing step that aims to reduce the dimensionality of complex classification or regression problems. Various techniques have been proposed in the literature to address this challenge with emphasis to medical applications. However, each one of the existing FS algorithms come with its own advantages and disadvantages introducing a certain level of bias. Materials and Methods: To avoid bias and alleviate the defectiveness of single feature selection results, an ensemble FS methodology is proposed in this paper that aggregates the results of several FS algorithms (filter, wrapper and embedded ones). Fuzzy logic is employed to combine multiple feature importance scores thus leading to a more robust selection of informative features. The proposed fuzzy ensemble FS methodology was applied on the problem of knee osteoarthritis (KOA) prediction with special emphasis on the progression of joint space narrowing (JSN). The proposed FS methodology was integrated into an end-to-end machine learning pipeline and a thorough experimental evaluation was conducted using data from the Osteoarthritis Initiative (OAI) database. Several classifiers were investigated for their suitability in the task of JSN prediction and the best performing model was then post-hoc analyzed by using the SHAP method. Results: The results showed that the proposed method presented a better and more stable performance in contrast to other competitive feature selection methods, leading to an average accuracy of 78.14% using XG Boost at 31 selected features. The post-hoc explainability highlighted the important features that contribute to the classification of patients with JSN progression. Conclusions: The proposed fuzzy feature selection approach improves the performance of the predictive models by selecting a small optimal subset of features compared to popular feature selection methods. © 2021 Elsevier B.V.
Collections
Verwandte Dokumente
Anzeige der Dokumente mit ähnlichem Titel, Autor, Urheber und Thema.
-
Explainable machine learning for knee osteoarthritis diagnosis based on a novel fuzzy feature selection methodology
Kokkotis C., Ntakolia C., Moustakidis S., Giakas G., Tsaopoulos D. (2022)Knee Osteoarthritis (ΚΟΑ) is a degenerative joint disease of the knee that results from the progressive loss of cartilage. Due to KOA’s multifactorial nature and the poor understanding of its pathophysiology, there is a ... -
Distributed Fuzzy Cognitive Maps for Feature Selection in Big Data Classification
Haritha K., Judy M.V., Papageorgiou K., Georgiannis V.C., Papageorgiou E. (2022)The features of a dataset play an important role in the construction of a machine learning model. Because big datasets often have a large number of features, they may contain features that are less relevant to the machine ... -
Towards the Interpretation of Convolutional Neural Networks for Image Classification Using Fuzzy Sets
Vasilakakis M., Sovatzidi G., Dimas G., Iakovidis D.K. (2022)Convolutional Neural Networks (CNNs) have demonstrated an outstanding performance on a range of image classification problems in various domains. However, their major drawback is that they are 'black box' and opaque ...