Title: An augmented interpretive framework based on aspect sentiment words aggregation

Authors: Chao Li; Bo Shen; Yingsi Zhao; Qing-An Zeng

Addresses: School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing, 100044, China ' Key Laboratory of Communication and Information Systems, Beijing Jiaotong University, Beijing, 100044, China ' School of Economics and Management, Beijing Jiaotong University, Beijing, 100044, China ' Department of Computer Systems Technology, North Carolina A&T State University, North Carolina, 27695, USA

Abstract: Given the mounting anxieties surrounding the interpretability of neural models, appraising interpretability remains an unsolved puzzle owing to the ineffectual performance of existing interpretation techniques and evaluation metrics. The architecture of neural network models varies depending on the task at hand, making it challenging to devise a universal method of explanation that can produce coherent justifications for each model. This paper proposes a framework to enhance the interpretability of text sentiment classification models using aspect sentiment words (ASW) aggregation, which can be applied to web services to improve transparency, accountability, and user trust. The proposed method extracts ASW from sentences and consolidates the token importance scores to provide more credible justifications. The paper also introduces new evaluation metrics for faithfulness, which assess whether interpretations accurately reflect the model's decision-making process. The proposed metrics are effective in evaluating the fidelity of rationales to models at the snippet-level.

Keywords: deep learning; text sentiment classification; interpretability; aspect sentiment words aggregation.

DOI: 10.1504/IJWGS.2024.137551

International Journal of Web and Grid Services, 2024 Vol.20 No.1, pp.54 - 73

Received: 25 Jul 2023
Accepted: 23 Sep 2023
Published online: 25 Mar 2024 *