Fusion deep capsule-network based facial expression recognition
by Yilihamu YaErmaimaiti; Guohang Zhuang; Tusongjiang Kari
International Journal of Information and Communication Technology (IJICT), Vol. 24, No. 2, 2024

Abstract: Facial expression recognition plays a crucial role in many automated system applications such as human-computer interaction, multi-modal emotion analysis, and medical assistance. Recognising facial expressions accurately is challenging. The existing facial expression recognition methods are limited in exploring the correlation between features, and most of them ignore the significance of feature relationship to FER. In this article, we propose a neural network FDC for facial expression identification. The main purpose is to design a deep capsule neural network that is a fusion of multi-layer convolutional neural network and capsule neural network. In the light-layer network, we have added an attention mechanism based on LPB, and the loss function of the FDC network is constructed. The main purpose is: 1) consider the influence of feature relationship on facial expression recognition; 2) use a designed attention mechanism to capture the important local information in facial features; 3) balance overall loss. Our method can achieve 97.93%, 92.86% and 98.57% recognition accuracy for RaFD, KDEF and CK+, respectively, which is more accurate than most state-of-the-art techniques while maintaining real-time performance, which is a great improvement compared to current public facial expression recognition methods.

Online publication date: Tue, 05-Mar-2024

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Information and Communication Technology (IJICT):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com