Title: Hand gesture recognition supported by fuzzy rules and Kalman filters

Authors: Michał Lech; Bożena Kostek

Addresses: Multimedia Systems Department, Gdansk University of Technology, Narutowicza 11/12, 80-233, Gdansk, Poland. ' Multimedia Systems Department, Gdansk University of Technology, Narutowicza 11/12, 80-233, Gdansk, Poland

Abstract: The paper presents a system based on camera and multimedia projector enabling a user to control computer applications by dynamic hand gestures. Gesture recognition methodology based on representing hand movement trajectory by motion vectors analysed using fuzzy rule-based inference is first given. For effective hand position tracking Kalman filters are employed. The system engineered is developed using J2SE and C++/OpenCV technology. In addition, OpenCV is used for image processing and J2SE with jFuzzyLogic package is employed for gesture interpretation. Results of fuzzy rule-based and fixed threshold-based gesture recognition effectiveness are provided. Additionally, for fuzzy rule-based gesture recognition the system efficacy after utilising Kalman filters is examined. The so-called interactive whiteboard application is given as an example of the system usage.

Keywords: fuzzy rules; fuzzy logic; Kalman filters; hand gestures; gesture recognition; cameras; multimedia projectors; hand movement trajectory; motion vectors; interactive whiteboard.

DOI: 10.1504/IJIIDS.2012.049304

International Journal of Intelligent Information and Database Systems, 2012 Vol.6 No.5, pp.407 - 420

Received: 12 Feb 2011
Accepted: 05 Jul 2011
Published online: 16 Aug 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article