Article: Human locomotion activity recognition using spectral analysis and convolutional neural networks Journal: International Journal of Manufacturing Research (IJMR) 2021 Vol.16 No.4 pp.350 - 364 Abstract: Despite the rapid deployment of automation solutions in manufacturing, humans remain the key players in the manufacturing environments, especially for hazardous or unfavourable environments. To enable a collaborative robot or exoskeleton robot to better support humans more safely and efficiently, understanding human behaviours is an essential enabling technology for the machines to make decisions on optimal control strategies. This work introduces an algorithm for classification of human locomotion activities using inertial data captured with inertial measurement unit (IMU) to support the control of robots, exoskeletons and many other applications. The proposed approach, to recognise human locomotion activities and gait events, includes two main steps: 1) applying spectral analysis on the inertial signals to transform the data into time-frequency representation; 2) classify the time-frequency data of an image to be recognised using convolutional neural networks (CNNs). Three methods are proposed to combine spectrum representations of multiple sensor channels for the CNN and evaluated. There are six activities considered in the work. The highest accuracy in classification with a sub-set of three classes is 99.6%, demonstrating the promising result in being applicable for real applications. [Submitted 27 September 2019; Accepted 4 January 2020] Inderscience Publishers - linking academia, business and industry through research

Title: Human locomotion activity recognition using spectral analysis and convolutional neural networks

Authors: Ahmad Amer; Ze Ji

Addresses: School of Engineering, Cardiff University, Cardiff, CF24 3AA, UK ' School of Engineering, Cardiff University, Cardiff, CF24 3AA, UK

Abstract: Despite the rapid deployment of automation solutions in manufacturing, humans remain the key players in the manufacturing environments, especially for hazardous or unfavourable environments. To enable a collaborative robot or exoskeleton robot to better support humans more safely and efficiently, understanding human behaviours is an essential enabling technology for the machines to make decisions on optimal control strategies. This work introduces an algorithm for classification of human locomotion activities using inertial data captured with inertial measurement unit (IMU) to support the control of robots, exoskeletons and many other applications. The proposed approach, to recognise human locomotion activities and gait events, includes two main steps: 1) applying spectral analysis on the inertial signals to transform the data into time-frequency representation; 2) classify the time-frequency data of an image to be recognised using convolutional neural networks (CNNs). Three methods are proposed to combine spectrum representations of multiple sensor channels for the CNN and evaluated. There are six activities considered in the work. The highest accuracy in classification with a sub-set of three classes is 99.6%, demonstrating the promising result in being applicable for real applications. [Submitted 27 September 2019; Accepted 4 January 2020]

Keywords: locomotion activity recognition; inertial measurement unit; IMU; spectrogram; convolutional neural networks; CNNs.

DOI: 10.1504/IJMR.2021.119633

International Journal of Manufacturing Research, 2021 Vol.16 No.4, pp.350 - 364

Received: 27 Sep 2019
Accepted: 04 Jan 2020
Published online: 13 Dec 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: Human locomotion activity recognition using spectral analysis and convolutional neural networks

Keep up-to-date