Vision Based Hand Gesture Recognition

With the development of ubiquitous computing, current user interaction approaches with keyboard, mouse and pen are not sufficient. Due to the limitation of these devices the useable command set is also limited. Direct use of hands as an input device is an attractive method for providing natural Huma...

Full description

Bibliographic Details
Main Authors: Pragati Garg, Aggarwal, Naveen, Sofat, Sanjeev
Format: Text
Language:English
Published: Zenodo 2009
Subjects:
Online Access:https://dx.doi.org/10.5281/zenodo.1074854
https://zenodo.org/record/1074854
Description
Summary:With the development of ubiquitous computing, current user interaction approaches with keyboard, mouse and pen are not sufficient. Due to the limitation of these devices the useable command set is also limited. Direct use of hands as an input device is an attractive method for providing natural Human Computer Interaction which has evolved from text-based interfaces through 2D graphical-based interfaces, multimedia-supported interfaces, to fully fledged multi-participant Virtual Environment (VE) systems. Imagine the human-computer interaction of the future: A 3Dapplication where you can move and rotate objects simply by moving and rotating your hand - all without touching any input device. In this paper a review of vision based hand gesture recognition is presented. The existing approaches are categorized into 3D model based approaches and appearance based approaches, highlighting their advantages and shortcomings and identifying the open issues. : {"references": ["A. Mulder, \"Hand gestures for HCI\", Technical Report 96-1, vol. Simon\nFraster University, 1996", "F. Quek, \"Towards a Vision Based Hand Gesture Interface\", pp. 17-31,\nin Proceedings of Virtual Reality Software and Technology, Singapore,\n1994.", "Ying Wu, Thomas S Huang, \" Vision based Gesture Recognition : A\nReview\", Lecture Notes In Computer Science; Vol. 1739 ,\nProceedings of the International Gesture Workshop on Gesture-Based\nCommunication in Human-Computer Interaction, 1999", "K G Derpains, \"A review of Vision-based Hand Gestures\", Internal\nReport, Department of Computer Science. York University, February\n2004", "Richard Watson, \"A Survey of Gesture Recognition Techniques\",\nTechnical Report TCD-CS-93-11, Department of Computer Science,\nTrinity College Dublin, 1993.", "Y. Wu and T.S. Huang, \"Hand modeling analysis and recognition for\nvision-based human computer interaction\", IEEE Signal Processing\nMag. - Special issue on Immersive Interactive Technology, vol.18, no.3,\npp. 51-60, May 2001", "H. Zhou, T.S. Huang, \"Tracking articulated hand motion with Eigen\ndynamics analysis\", In Proc. Of International Conference on Computer\nVision, Vol 2, pp. 1102-1109, 2003 .", "JM Rehg, T Kanade, \"Visual tracking of high DOF articulated\nstructures: An application to human hand tracking\" ,In Proc. European\nConference on Computer Vision, 1994", "A. J. Heap and D. C. Hogg, \"Towards 3-D hand tracking using a\ndeformable model\", In 2nd International Face and Gesture Recognition\nConference, pages 140-145, Killington, USA,Oct. 1996.\n[10] Y. Wu, L. J. Y., and T. S. Huang. \"Capturing natural hand Articulation\".\nIn Proc. 8th Int. Conf. on Computer Vision, volume II, pages 426-432,\nVancouver, Canada, July 2001.\n[11] B. Stenger P. R. S. Mendonc\u252c\u00a9a R. Cipolla, \"Model-Based 3D Tracking\nof an Articulated Hand\" , In proc. British Machine Vision Conference,\nvolume I, Pages 63-72, Manchester, UK, September 2001\n[12] [Online] Available from: \n[11.09.2008]\n[13] B. Stenger, A. Thayananthan, P.H.S. Torr, R. Cipolla , \"Model-based\nhand tracking using a hierarchical Bayesian filter\" , IEEE transactions\non pattern analysis and machine intelligence, September 2006\n[14] Elena S\u251c\u00ednchez-Nielsen, Luis Ant\u251c\u2502n-Canal\u251c\u00a1s, Mario Hern\u251c\u00edndez-Tejera,\n\"Hand Getsure recognition for Human Machine Intercation\", In Proc.\n12th International Conference on Computer Graphics, Visualization and\nComputer Vision : WSCG, 2004\n[15] B. Stenger, \"Template based Hand Pose recognition using multiple\ncues\", In Proc. 7th Asian Conference on Computer Vision : ACCV 2006\n[16] Lars Bretzner, Ivan Laptev and Tony Lindeberg, \"Hand gesture\nrecognition using multiscale color features, hieracrchichal models and\nparticle filtering\", in Proceedings of Int. Conf. on Automatic face and\nGesture recognition, Washington D.C., May 2002\n[17] M. Black, & Jepson, \" Eigen tracking: Robust matching and tracking of\narticulated objects using a view-based representation\", In European\nConference on Computer Vision, 1996.\n[18] C C Wang, K C Wang, \"Hand Posture recognition using Adaboost with\nSIFT for human robot interaction\", Springer Berlin, ISSN 0170-8643,\nVolume 370/2008\n[19] R. Lienhart and J. Maydt, \"An extended set of Haar-like features for\nrapid object detection,\" in Proc. IEEE Int. Conf. Image Process., 2002,\nvol. 1, pp. 900-903.\n[20] Andre L. C. Barczak, Farhad Dadgostar, \"Real-time hand tracking using\na set of co-operative classifiers based on Haar-like features\", Res. Lett.\nInf. Math. Sci., 2005, Vol. 7, pp 29-42\n[21] Qing Chen , N.D. Georganas, E.M Petriu, \"Real-time Vision based\nHand Gesture Recognition Using Haar-like features\", IEEE\nTransactions on Instrumentation and Measurement -2007\n[22] P. Viola and M. Jones, \"Robust real-time object detection,\" Cambridge\nRes. Lab., Cambridge, MA, pp. 1-24, Tech. Rep. CRL2001/01, 2001.\n[23] Ju, S., Black, M., Minneman, S., Kimber, D, \"Analysis of Gesture and\nAction in Technical Talks for Video Indexing\", IEEE Conf. on\nComputer Vision and Pattern Recognition, CVPR 97 ,1997\n[24] Berry,G.: Small-wall, \"A Multimodal Human Computer Intelligent\nInteraction Test Bed with Applications\", Dept. of ECE, University of\nIllinois at Urbana-Champaign, MS thesis (1998)\n[25] Zeller, M., et al, \" A Visual Computing Environment for Very Large\nScale Biomolecular Modeling\", Proc. IEEE Int. Conf. on Applicationspecific\nSystems, Architectures and Processors (ASAP), Zurich, pp. 3-\n12, 1997\n[26] Thad Starner and Alex Pentland, \"Real time American Sign Language\nRecognition from Video using Hidden Markov Models\", Technical\nReport 375, MIT Media Lab,1995\n[27] A Malima, E Ozgur, M Cetin, \"A fast algorithm for Vision based hand\ngesture recognition for robot control\", 14th IEEE conference on Signal\nProcessing and Communications Applications, April 2006\n[28] Hongmo Je Jiman Kim Daijin , \"Hand Gesture Recognition to\nUnderstand Musical Conducting Action\" 16th IEEE International\nSymposium on Robot and Human interactive Communication, 2007, ROMAN,\n2007, pg 163-168\n[29] Dong Guo Yonghua, \" Vision-Based Hand Gesture Recognition for\nHuman-Vehicle Interaction\", International Conference on Control,\nAutomation and Computer Vision, 1998\n[30] Pickering, Carl A. Burnham, Keith J. Richardson, Michael J. Jaguar ,\n\"A research Study of Hand Gesture Recognition Technologies and\nApplications for Human Vehicle Interaction\", 3rd Conference on\nAutomotive Electronics, 2007\n[31] Juan P. Wachs , Helman I. Stern, Yael Edan, Michael Gillam, Jon\nHandler, Craig Feied, Mark Smith, \"A Gesture-based Tool for Sterile\nBrowsing of Radiology Images\", Journal of the American Medical\nInformatics Association (2008; 15:321-323, DOI 10.1197/jamia.M24)\n[32] [Online] Available from:\n\n[11.09.2008]"]}