Title: Recent trends and challenges in human computer interaction using automatic emotion recognition: a review

Authors: Sukhpreet Kaur; Nilima Kulkarni

Addresses: Department of Computer Science and Engineering, MIT Art, Design and Technology University, Pune, India ' Department of Computer Science and Engineering, MIT Art, Design and Technology University, Pune, India

Abstract: Automatic emotion recognition (AER) using facial expressions and electroencephalogram (EEG) signals is an interesting and booming area of research in the field of human computer interaction This paper aims to identify the key state-of-the-art methodologies, understand the standard workflow pipeline and know the existing findings. Different machine learning and deep learning approaches used recently for information pre-processing, feature extraction, feature classification and fusion schemes have also been explored. Furthermore, the purpose of this review work is to discuss the aspects motivating researchers to move from unimodal to multimodal AER systems. Also, this surveyed information is summarised in tabular forms to investigate the recent methods used and the results obtained. This comprehensive literature survey identifies the key points for inclusion of facial expressions and EEG signals over other channels, also the benefits of automated features, which are being leveraged over hand crafted features for building improved real time emotion recognition systems. This review work provides new research directions, open challenges and existing state-of-the-art methods in the field of AER using facial expressions and EEG signals which can be used as benchmark studies for researchers.

Keywords: emotion recognition; human computer interaction; affective computing; facial expressions; EEG signals; multimodal system.

DOI: 10.1504/IJBM.2024.135160

International Journal of Biometrics, 2024 Vol.16 No.1, pp.16 - 43

Received: 24 Aug 2022
Accepted: 23 Dec 2022
Published online: 01 Dec 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article