Open Access Open Access  Restricted Access Subscription or Fee Access

Real Time Hand Gesture Recognition

A. A. Randive, H.B. Mali, S.D. Lokhande

Abstract


The automatic recognition of gestures enriches Human – Computer Interaction by offering a natural intuitive method of data input. Compared with the traditional interaction approaches, such as keyboard, mouse, pen etc. Vision based hand interaction is more natural and efficient. As this methodology is aided with cameras and computer vision techniques. And besides normal use for handling objects and manipulating tools, the hand of human being can be used as the mean of communication here. This paper presents a new method or technique for a real time static hand gesture recognition on plain uniform background, for the HCI, based on pattern recognition using K-nearest Neighbor (KNN). Major consideration here is the stable lighting condition. Here work is done to recognize 10 gestures from ASL. Concept of connected components or objects is used here for hand segmentation, canny edge detector is used for pattern creation and classification is done by using K-nearest Neighbor algorithm. This algorithm gives 84% accuracy with recognition time of 0.3s. Accuracy decreases as distance of hand from camera increases above 1.5feets. The gestures recognized here can be used further to develop an application of controlling the devices which will be very much helpful to the physically disabled and older persons who can’t move easily from one place to another.

Keywords


American Sign Language (ASL), Gesture Recognition, Human Computer Interaction (HCI), K-Nearest Neighbor (KNN).

Full Text:

PDF

References


Etsuko Ueda, Yoshio Matsumoto Masakazu Imai, Tsukasa Ogasawara, ― Hand Pose Estimation for Vision-based Human Interface,‖ IEEE International Workshop on Robot and Human Interactive Communication,2001,pp 473-478.

B. Lekhashri, A. Arun Pratap, ― Use of Motion-Print in Sign Language Recognition,‖ Proceedings of the National Conference on Innovations in Emerging Technology, India.17 & 18 February, 2011,pp 99-102.

Jun-ho An, Kwang Seok Hong, ― Finger Gesture- Based Mobile User Interface Using a Rare-Facing Camera,‖ IEEE International Conference on Consumer Electronics (ICCE),2011,pp 303-304.

Jason Brand and John S, Mason ― A Comparative Assessment of Three Approaches to Pixel-level Human Skin-Detection,‖ Pattern Recognition 2000 Proceedings,15th International Conference on September 2000,Vol.1,pp 1056-1059.

Tarek M Mahmoud, ― A New Fast Skin Color Detection Technique,‖ World Academy of Science, Engineering and Technology 43, 2008,pp 501-505.

A.T. Nghiem, F. Bremond, M. Thonnat, ― Controlling Background Subtraction Algorithms for Robust Object Detection, ‖ Project PULSAR, INRIA Sophia Antipolis France.

David L.Quam, ― Gesture Recognition with a DataGlove, ‖ Aerospace and Electronics Conference, 1990,Vol.2,pp 755-760.

M.Ali Qureshi, Abdul Aziz, Muhammad Ammar Saeed, Muhammad Hayat, Jam Shahid Rasool, ― Implementation of an Efficient Algorithm for Human Hand Gesture Identification, ‖Electronics Communications and Photonics Conference (SIECPC), Saudi International, 2011, pp 1-5.

Asanterabi Malima, Erol Ozgur and Mujdat Cetin, ― A Fast Algorithm for Vision-Based Hand Gesture Recognition for Robot Control ,‖ IEEE Conference on Signal Processing and Communications Applications, 2006,pp 1-4.

XIOTANG WEN and YANYU NIU, ― A Method for Hand Recognition Based on Morphology and Fingertip-Angle, ‖ Computer and Automation Engineering (ICCAE), 2ndInternational Conference 2010, Vol.1,pp688-691.

Means Xingyan Li, ― Gesture Recognition Based on Fuzzy C- Clustering Algorithm, ‖ Technical Report,2005.

Jochen Triesch, Christoph von der Malsburg, ― Classification of hand posture against complex backgrounds using elastic graph matching, ‖ Image and Vision Computing 20(2002),pp.937-943.

Xinghua Li, Jun-ho An, jin-hong Min and Kwang-Seok Hong, ― Hand Gesture Recognition by Stereo Camera using the Thinning Method, ‖ pp 3077-3080.

Mohamed Alsheakhali, Ahmed Skaik, Mohammed Aldahdouh, Mahmoud Alhelou, ― Hand Gesture Recognition System, ‖ Palestine,2011.

Rajeshree Rokade, Dharmpal Doye,Manesh Kokare, ― Hand Gesture Recognition by Thinning Method, ‖ International Conference on Digital Image Processing,2009,pp 284-287.

Bao Hong and Zhao Xinggui, ― Study on Hand Gesture Segmentation ‖, Multimedia Technology(ICMT),2010 International conference, pp 1-4.

Yi Wang, ― Foreground-Background Segmentation of Video Sequences ‖.

Ahmet Birdal,Reza Hassanpour, ― Region Based Hand Gesture Recognition .‖

Pragati Garg, Naveen Aggarwal and Sanjeev Sofat, ― Vision Based Hand Gesture Recognition .‖

Pravin R Futane, Dr. Rajiv V. Dharaskar, ― HASTA MUDRA:An Interpretation of Indian Sign Hand Gestures ‖.

Sushmita Mitra, and Tinku Acharya, ― Gesture Recognition: A Survey,‖ IEEE transactions on systems, man, and cybernetics—part c: applications and reviews, Vol. 37, no. 3, May 2007,pp 311-324.

N. Otsu, " A threshold selection method from gray-level histograms, ‖ IEEE Transactions on Systems, Man, and Cybernetics, Vol. SMC-9, pp. 62-66, 1979.

Prateem Chakraborty, Prashant Sarawgi, Ankit Mehrotra, Gaurav Agarwal, Ratika Pradhan, ― Hand Gesture Recognition: A Comparative Study ‖, Proceedings of the International MultiConference of Engineers and Computer Scientists 2008 Vol I I MECS 2008, 19- 21 March , 2008, Hong Kong.

IIan Steinberg, Tomer M.London, Dotan Di Castro, ―Hand Gesture Recognition in Images and Video‖.

Xiaoming Yin and Ming Xie, ―Hand Posture Segmentation, Recognition and Application for Human Robot Interaction‖.

J. Rekha, J. Bhattacharya, S. Majumder, ―Shape, Texture and Local Movement Hand Gesture Features for Indian Sign Language Recognition‖ ,pp 30-35.

T. Shanableh ,K. Assaleh, ― Arabic Sign Language Recognition in User Independent Mode ‖, International Conference on Intelligent and Advanced Systems 2007, pp. 597-600.

Zhiyong Yan, Congfu Xu, ―Combining KNN Algorithm and Other Classifiers‖, Proc.9th IEEE Int. Conf. on Cognitive Informatics [ICCI’10], pp.800-805.

R. Gonzalez, R. Woods and S. Eddins, ― Digital Image Processing using Matlab ‖, Prentice Hall, First Edition, 2002.

― A thesis on Hand Detection and Tracking in an Active Vision System ‖ by Yuliang Zhu, June, 2003

DIP: Final project report on ―Image segmentation based on the normalized cut framework‖ by Yu-Ning Liu Chung-Han Huang Wei-Lun Chao.

Website www.wikipedia.com

Website www.google.com


Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.