Article: SVM-based Relevance Feedback for semantic video retrieval Journal: International Journal of Signal and Imaging Systems Engineering (IJSISE) 2009 Vol.2 No.3 pp.99 - 108 Abstract: This paper presents a novel method for efficient key frame extraction from video shot representation and employs a Support-Vector-Machine-based Relevance Feedback (SVM-RF) to bridging semantic gap between low-level feature and high-level concepts of shots. We introduce a new approach for key frame extraction using a hierarchical approach based on clustering. Using this key frame representation, the most representative key frame is then selected for each shot. Furthermore, our system incorporates user to judge about the result of retrieval and labelled retrieved shot in two groups, relevant and irrelevant. Then, by mean feature of relevant and irrelevant shots train an SVM classifier. In the next step, video database is classified in two groups, relevant and irrelevant shots. Suitable Graphic User Interface (GUI) is shown for capturing RF of user. This process continued until user satisfied with results. The proposed system is checked over collected shots from Trecvid2001 database and home videos include 800 shots of different concepts (10 semantic groups). Experimental results demonstrate the effectiveness of the proposed method. Inderscience Publishers - linking academia, business and industry through research

Title: SVM-based Relevance Feedback for semantic video retrieval

Authors: Hadi Sadoghi Yazdi, Malihe Javidi, Hamid Reza Pourreza

Addresses: Department of Computer Engineering, Ferdowsi University of Mashhad, P.O. Box 91775-1111, Mashhad, Iran. ' Department of Computer Engineering, Ferdowsi University of Mashhad, P.O. Box 91775-1111, Mashhad, Iran. ' Department of Computer Engineering, Ferdowsi University of Mashhad, P.O. Box 91775-1111, Mashhad, Iran

Abstract: This paper presents a novel method for efficient key frame extraction from video shot representation and employs a Support-Vector-Machine-based Relevance Feedback (SVM-RF) to bridging semantic gap between low-level feature and high-level concepts of shots. We introduce a new approach for key frame extraction using a hierarchical approach based on clustering. Using this key frame representation, the most representative key frame is then selected for each shot. Furthermore, our system incorporates user to judge about the result of retrieval and labelled retrieved shot in two groups, relevant and irrelevant. Then, by mean feature of relevant and irrelevant shots train an SVM classifier. In the next step, video database is classified in two groups, relevant and irrelevant shots. Suitable Graphic User Interface (GUI) is shown for capturing RF of user. This process continued until user satisfied with results. The proposed system is checked over collected shots from Trecvid2001 database and home videos include 800 shots of different concepts (10 semantic groups). Experimental results demonstrate the effectiveness of the proposed method.

Keywords: relevance feedback; semantic gap; support vector machines; SVM; video retrieval; key frame extraction; semantic gap; clustering; semantics.

DOI: 10.1504/IJSISE.2009.033722

International Journal of Signal and Imaging Systems Engineering, 2009 Vol.2 No.3, pp.99 - 108

Received: 28 Nov 2008
Accepted: 07 Sep 2009
Published online: 29 Jun 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: SVM-based Relevance Feedback for semantic video retrieval

Keep up-to-date