The Analysis and Development of an eXplainable Artificial Intelligent Process (Revise for Camera Ready) n3.pdf (2.94 MB)

The Analysis and Development of an XAI Process on Feature Contribution Explanation

Download (2.94 MB)
posted on 2022-12-12, 15:44 authored by Jun HuangJun Huang, Zerui Wang, Ding LiDing Li, Yan Liu

Explainable Artificial Intelligence (XAI) research focuses on effective explanation techniques to understand and build AI models with trust, reliability, safety, and fairness. Feature importance explanation summarizes feature contributions for end-users to make model decisions. However, XAI methods may produce varied summaries that lead to further analysis to evaluate the consistency across multiple XAI methods on the same model and data set. This paper defines metrics to measure the consistency of feature contribution explanation summaries under feature importance order and saliency map. Driven by these consistency metrics, we develop an XAI process oriented on the XAI criterion of feature importance, which performs a systematical selection of XAI techniques and evaluation of explanation consistency. We demonstrate the process development involving twelve XAI methods on three topics, including a search ranking system, code vulnerability detection and image classification. Our contribution is a practical and systematic process with defined consistency metrics to produce rigorous feature contribution explanations.


Email Address of Submitting Author

ORCID of Submitting Author


Submitting Author's Institution

Concordia University

Submitting Author's Country

  • Canada

Usage metrics