Recognition of 'yoga-asana' using bidirectional LSTM with CNN features
by Nitin Paharia; Rajesh Gupta; R.S. Jadon; S.K. Gupta
International Journal of Arts and Technology (IJART), Vol. 13, No. 3, 2021

Abstract: Recognising human activity in video is a highly challenging and complex task because a video contains lots of information along with complex variations. Yoga-asana recognition is one of the instances of human activity recognition that gained attention in last decade across the globe. In this paper, we developed an appearance-based recognition system for yoga-asana in video. The system has been implemented using end-to-end deep learning pipeline that includes convolutional neural network (CNN) and bidirectional long short-term memory (LSTM) network. Firstly, each video is down-sampled to 20 frames. Thereafter, spatial features are extracted from each frame and then in turn passed on to bidirectional LSTM for learning sequential information. Finally, Softmax classifier is applied on spatio-temporal representation of video for assigning one of the seven yoga-asana labels to it. For this study, we also created a customised dataset of seven yoga-asana (Bhujangasana, CatCow, Trikonasana, Vrikshasana, Padmasana, Shavasana, and Tadasana). The system achieved average test accuracy of 96.67% on customised dataset in 20-fold cross validation which is comparative to related work.

Online publication date: Mon, 07-Feb-2022

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Arts and Technology (IJART):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com