IF3: An Interpretable Feature Fusion Framework for Lesion Risk Assessment Based on Auto-constructed Fuzzy Cognitive Maps

Abstract

The detection of abnormalities in the gastrointestinal (GI) tract, including precancerous lesions, is substantially subject to expert knowledge and experience. To address the challenge of automated lesion risk assessment, based on Wireless Capsule Endoscopy (WCE) images, this paper introduces a novel Artificial Intelligence (AI) framework based on Fuzzy Cognitive Maps (FCMs). Specifically, FCMs are fuzzy graph structures used to model knowledge spaces using cause-and-effect relationships, enabling uncertainty-aware reasoning and inference. The novel proposed Interpretable FCM-based Feature Fusion (IF3) framework, includes the following contributions: a) it automatically constructs an FCM based on similarities discovered in training data; b) it enables the fusion of different features extracted using different methods. The proposed framework is generic, domain-independent and it can be integrated into any classifier. To demonstrate its performance, experiments were conducted using real datasets, which include a variety of GI abnormalities, and different feature extractors. The results show that the automatically constructed FCM outperforms state-of-the-art methods, while providing interpretable results, in an easily understandable way. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.