Title: Gesture-based mouse control system based on MPU6050 and Kalman filter technique

Authors: Narayanan Prasanth; Kaustubh Shrivastava; Abhishek Sharma; Aritri Basu; Ritwik A. Sinha; S.P. Raja

Addresses: School of Computer Science and Engineering, Vellore Institute of Technology, Vellore-632 014, Tamil Nadu, India ' School of Computer Science and Engineering, Vellore Institute of Technology, Vellore-632 014, Tamil Nadu, India ' School of Computer Science and Engineering, Vellore Institute of Technology, Vellore-632 014, Tamil Nadu, India ' School of Computer Science and Engineering, Vellore Institute of Technology, Vellore-632 014, Tamil Nadu, India ' School of Computer Science and Engineering, Vellore Institute of Technology, Vellore-632 014, Tamil Nadu, India ' School of Computer Science and Engineering, Vellore Institute of Technology, Vellore-632 014, Tamil Nadu, India

Abstract: The recognition of gestures with accuracy is still a widespread challenge which leads to prevention in the usage of wearable gesture recognition systems. In this paper, we proposed a gesture-based mouse, a smart glove based system for gesture recognition and remote control. To reduce the dependency of the gesture recognition system on external conditions like light and network connection, we eliminate the need of a camera and use a glove fitted with the MPU6050 sensor to detect motion accurately with minimal latency. The elimination of the camera component also reduced the overall component cost significantly. In this paper, we discuss the algorithm followed to map hand motion to cursor movement on the screen via the pseudocode and flowchart. Using this methodology, basic functionalities of the mouse and its operations were implemented with less expense and to more effectiveness.

Keywords: Kalman filter; gesture based mouse; NodeMCU; MPU6050; PyAutoGUI.

DOI: 10.1504/IJISTA.2023.130556

International Journal of Intelligent Systems Technologies and Applications, 2023 Vol.21 No.1, pp.56 - 71

Received: 15 Dec 2021
Received in revised form: 09 Dec 2022
Accepted: 03 Jan 2023
Published online: 27 Apr 2023 *