Title: Protagonist and deuteragonist-based video indexing and retrieval system for movie and video song sequences

Authors: Tushar Ratanpara; Narendra M. Patel

Addresses: Faculty of Technology and Engineering, C.U. Shah University, Wadhwan, Gujarat, India ' Department of Computer Engineering, Birla Vishwakarma Vidhyalaya, V.V. Nagar, India

Abstract: Protagonist and deuteragonist are two main characters that plays leading role in Indian Hindi movie (IHM). Currently such information is attached using textual caption which is highly unreliable. The research presented in this paper is to automatically index and retrieve the content based on protagonist and deuteragonist from the large IHM and video song sequences (VSS). Video song sequence indexes are extracted using audio-based approach from IHM in module 1. These indexes are used as an input in module 2. Faces are identified from every VSS. Colour histogram and spatiogram descriptor are extracted from faces. Similarity between two faces is computed using Bhattacharyya coefficient. Similarity-based clustering technique is performed to obtain clusters of faces. Recognition of protagonist and deuteragonist is done using surf feature points. The experimental results are carried out using Indian Hindi movies of different genres.

Keywords: video indexing; video retrieval; song sequences; clustering; similarity; colour histogram; spatiogram.

DOI: 10.1504/IJAIP.2019.103407

International Journal of Advanced Intelligence Paradigms, 2019 Vol.14 No.3/4, pp.175 - 196

Received: 17 Mar 2016
Accepted: 06 Jul 2016
Published online: 06 Nov 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article