Title: Combining location and feature information for multimedia retrieval

Authors: Hong Pan, Yi Yang

Addresses: School of Information Engineering, Hangzhou Normal University, Hangzhou 310026, China. ' College of Computer Science, Zhejiang University, Hangzhou 310027, China

Abstract: In this paper, we propose a cross-media retrieval method for heterogeneous multimedia data by which the query examples and the returned results can be of different modalities, e.g., to query images by an example of audio clip. Taking multimedia location and content information into consideration, an affinity propagation based clustering approach is proposed to analyse and fuse the information carried by the co-existing multimedia objects so as to learn the semantic correlations among the heterogeneous multimedia data and perform cross-media retrieval. We also propose active learning methods of Relevance Feedback to make the search model more accurate.

Keywords: heterogeneous multimedia data; relevance feedback; active learning; cross-media retrieval; multimedia content; multimedia location; clustering; semantic correlation; information retrieval; information search.

DOI: 10.1504/IJCAT.2010.034136

International Journal of Computer Applications in Technology, 2010 Vol.38 No.1/2/3, pp.27 - 33

Received: 31 Jul 2008
Accepted: 14 Oct 2008
Published online: 16 Jul 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article