Title: FER to FFR: a deep-learning-based approach for robust fatigue detection

Authors: Rachana Yogesh Patil; Yogesh H. Patil; Sheetal U. Bhandari

Addresses: Department of Computer Engineering, Pimpri Chinchwad College of Engineering, Pune, Maharashtra, India ' D.Y. Patil Institute of Technology, Pune, Maharashtra, India ' Department of Electronics and Telecommunication Engineering, Pimpri Chinchwad College of Engineering, Pune, Maharashtra, India

Abstract: Automatic detection of fatigue from the face provides non-intrusive passive identification of fatigue. The traditional approach of fatigue detection has focused on detecting yawning and eyelid closure. However, fatigue is manifested in the face through various minute facial features. In this paper, we propose a fatigue detection model, which can learn facial expression features through a deep learning-based facial expression recognition model and provide the same to the fatigue recognition model. Experiments indicate that the proposed approach achieves a qualitative improvement of facial features used for fatigue detection and improves the accuracy quantitatively on the custom Indian fatigue data set. The approach also allows mitigation of limitations of fatigue data sets of significantly fewer subjects and allows for training fatigue models suitable for unconstrained real-world settings.

Keywords: deep learning; fatigue detection; vision transformation; fatigue data set.

DOI: 10.1504/IJCAT.2023.133292

International Journal of Computer Applications in Technology, 2023 Vol.72 No.3, pp.203 - 211

Received: 05 Jul 2022
Received in revised form: 18 Nov 2022
Accepted: 19 Nov 2022
Published online: 11 Sep 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article