Title: HARDeep: design and evaluation of a deep ensemble model for human activity recognition

Authors: R. Raja` Subramanian; V. Vasudevan

Addresses: Department of Computer Science and Engineering, Kalasalingam Academy of Research and Education, India ' Department of Computer Science and Engineering, Kalasalingam Academy of Research and Education, India

Abstract: With the emergence of smartness in various fields including medical science, forensics and security, remote monitoring of human activities has gained more interests in research. The ambulatory health monitoring services includes monitoring the activities of mentally challenged and elderly people. In this research paper, we propose a novel framework for activity recognition from video sequences captured from static cameras and those captured from UAVs. The proposed framework, named HARDeep, consists of three models: an optional scene stabilisation model for UAV captured video sequences, a human detection model leveraging YOLOv3, and, to extract the set of video frames containing humans, an activity recognition model leveraging the ensemble of three deep learning models: GoogleNet, ResNet-50, and ResNet-101. HARDeep is evaluated against three datasets including Hollywood2, KTH and the UCF-ARG dataset, consisting of video sequences captured from UAVs. The recognition accuracies are compared with the various inference models leveraging wide learning paradigms.

Keywords: activity recognition; deep ensemble model; unmanned aerial vehicles; UAV; scene stabilisation; pretrained models; HARDeep; human detection; YOLO; fog computing.

DOI: 10.1504/IJICA.2023.131356

International Journal of Innovative Computing and Applications, 2023 Vol.14 No.3, pp.155 - 166

Received: 20 Oct 2021
Received in revised form: 02 Mar 2022
Accepted: 30 May 2022
Published online: 07 Jun 2023 *