Title: Deep learning with spectrogram image of eye movement for biometrics

Authors: Antonio Ricardo Alexandre Brasil; Patrick Marques Ciarelli; Izabella Martins da Costa Rodrigues; Jefferson Oliveira Andrade; Karin Satie Komati

Addresses: Program in Electrical Engineering (PPGEE), Federal University of Espírito Santo (UFES), Av. Fernando Ferrari, 514 – Goiabeiras, Vitória – ES, 29075-910, Brazil ' Program in Electrical Engineering (PPGEE), Federal University of Espírito Santo (UFES), Av. Fernando Ferrari, 514 – Goiabeiras, Vitória – ES, 29075-910, Brazil ' Program in Applied Computing (PPComp), Federal Institute of Espírito Santo (IFES), Avenida dos Sabiás, 330 – Morada de Laranjeiras, Serra – ES, 29166-630, Brazil ' Program in Applied Computing (PPComp), Federal Institute of Espírito Santo (IFES), Avenida dos Sabiás, 330 – Morada de Laranjeiras, Serra – ES, 29166-630, Brazil ' Program in Applied Computing (PPComp), Federal Institute of Espírito Santo (IFES), Avenida dos Sabiás, 330 – Morada de Laranjeiras, Serra – ES, 29166-630, Brazil

Abstract: Biometric studies are being used worldwide for a large variety of purposes, here we used eye movements (EM) from observers of natural images. Since some EM are involuntary, these prevent spoofing attacks. While prior research requires feature extraction manually from EM data to identify a person, we use a deep convolutional architecture that processes it as an image. The eye movements were treated as a signal, then transformed as a spectrogram of frequencies, and its image is the input for a convolutional architecture. We investigated two types of signals: Cartesian coordinates, and gaze angle over time. The proposal consists of a convolutional network architecture applied to the DOVES dataset, where stimuli are natural images. We obtained the accuracy for the eye angle spectrogram, on DOVES, about 73%, and for the eye coordinates spectrogram, 65%. These results indicated that EM can be treated as spectrogram images for biometric identification.

Keywords: DOVES dataset; eye angle; natural image stimuli.

DOI: 10.1504/IJBM.2023.133962

International Journal of Biometrics, 2023 Vol.15 No.6, pp.726 - 744

Received: 18 Apr 2022
Accepted: 30 Sep 2022
Published online: 06 Oct 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article