Title: Bidirectional aggregated features fusion from CNN for palmprint recognition
Authors: Jianxin Zhang; Aoqi Yang; Mingli Zhang; Qiang Zhang
Addresses: Key Lab of Advanced Design and Intelligent Computing (Ministry of Education), Dalian University, No. 10, Xuefu Street, Jinzhou New District, Dalian, China ' Key Lab of Advanced Design and Intelligent Computing (Ministry of Education), Dalian University, No. 10, Xuefu Street, Jinzhou New District, Dalian, China ' Department of Software Engineering and IT, Ecole de technologie superieure (ETS), 1100, Rue Notre-Dame Ouest, Montreal, Canada ' School of Computer Science and Technology, Dalian University of Technology, No. 2, Lingong Road, Ganjinzi District, Dalian, China; Key Lab of Advanced Design and Intelligent Computing (Ministry of Education), Dalian University, No. 10, Xuefu Street, Jinzhou New District, Dalian, China
Abstract: In this paper, we present a novel bidirectional aggregated features representation from convolutional neural networks (CNNs) with score-level fusion for palmprint recognition. Our method adopts the vector of locally aggregated descriptors (VLAD) to encode the convolutional features from two directions, i.e., vertical and horizontal directions, to mine both the local and global descriptions of palmprint image. Then, three score-level fusion rules are respectively employed to integrate the matching scores of the bidirectional features. We extensively evaluate the performance of convolutional features, vertical and horizontal encoding together with the score-level fusion rules through recent deep network VGG-F on the PolyU palmprint and multispectral palmprint databases. Experiments demonstrate that horizontal encoding significantly outperforms vertical encoding on red, green, blue and near-infrared (NIR) palmprint image subsets while it is slightly worse on PolyU palmprint database, moreover, the effective performance improvement can be achieved after the fusions.
Keywords: convolutional neural network; CNN; VLAD; bidirectional features; score-level fusion; palmprint recognition.
International Journal of Biometrics, 2018 Vol.10 No.4, pp.334 - 351
Received: 11 Nov 2017
Accepted: 01 Jun 2018
Published online: 02 Oct 2018 *