3D Hand Motion Evaluation Using HMM

Safaei, A.; Jahed, M.

doi:10.22061/jecei.2013.16

Document Type : Original Research Paper

Authors

A. Safaei ¹
M. Jahed ²

¹ School of Science Engineering, Sharif University of Technology, International Campus, Kish Island, Iran

² School of Electrical Engineering, Sharif University of Technology, Tehran, Iran

https://doi.org/10.22061/jecei.2013.16

Abstract

Gesture and motion recognition are needed for a variety of applications. The use of human hand motions as a natural interface tool has motivated researchers to conduct research in the modeling, analysis and recognition of various hand movements. In particular, human-computer intelligent interaction has been a focus of research in vision-based gesture recognition. In this work, we introduce a 3-D hand model recognition method that offers flexible and elaborate representation of hand motion. We used landmark points on the tips and joints of the fingers and calculated the 3-D coordinates of these points through a stereo vision system followed by a Hidden Markov Model (HMM) to recognize hand motions. Experimentally, in an effort to evaluate the formation of hand gestures similar to those used in rehabilitation sessions, we studied three evolving motions. Given the natural hand features and uncontrolled environment, we were able to classify and differentiate unnatural slowness or rapidness in the performance of such motions, ranging from 45% to 93%.

Keywords

20.1001.1.23223952.2013.1.1.2.2

References

[1] Mehrdad Sangi, Mehran Jahed, “A Fast 3D Hand Model Reconstruction by Stereo Vision System,” IEEE 2010.

[2] X. Zabulis, H. Baltzakis, A. Argyros, “Vision-based Hand Gesture Recognition for Human-Computer Interaction,” Institute of Computer Science Foundation for Research and Technology - Hellas (FORTH) Heraklion, Crete, Greece.

[3] Pragati Garg, Naveen Aggarwal and Sanjeev Sofat, “Vision Based Hand Gesture Recognition,” World Academy of Science, Engineering and Technology 49 2009.

[4] Ying Wu and Thomas S. Huang, ”Hand Modeling, Analysis, and Recognition,” IEEE Signal Processing Magazine,2001.

[5] Ali Erol, George Bebis, Mircea Nicolescu, “A Review on VisionBased Full DOF Hand Motion Estimation,” IEEEHuman Motion Proceedings, 2000.

[6] Nilanjan Sarkar , “Human-Robot Interaction,” Itech Education and Publishing, Vienna, Austria, 2007.

[7] Nilanjan Sarkar , “Human-Robot Interaction,” Itech Education and Publishing, Vienna, Austria, 2007.

[8] Available in: http://en.wikipedia.org/wiki/Kmeans_clustering.

[9] Dana Elena Ilea and Paul F. Whelan, “Color Image Segmentation Using a Spatial K-Means Clustering Algorithm,” IMVIP 2006 - 10th International Machine Vision and Image Processing Conference, 30 August - 1 September 2006, Dublin, Ireland.

[10] Tse-Wei Chen,Yi-Ling Chen, Shao-Yi Chien, “Fast image segmentation based on K-Means clustering with histograms in HSV color space,” Multimedia Signal Processing, 2008 IEEE 10th Workshop on, 8-10 Oct. 2008.

[11] “Definition of CIELab Color Space,” available in: http://www.optelvision.com/documents/optel-vision-sexplanation-on-cielab-color-space.pdf

[12] Nathaniel J. Short, “ 3-D Point Cloud Generation from Rigid and Flexible Stereo Vision Systems,” Thesis submitted to the faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE in Computer Engineering 2009.

[13] Gary Bradski and Adrian Kaehler, “Learning OpenCV,” O’REILLY,2008.

[14] Ricardo A. Arango S, “Learning Action Primitives From 3D Stereo Vision Measurements,” A thesis submitted to the University of Aalborg for the degree of Master of Engineering in Computer Vision and Graphics 2010.

[15] J. Lou, Q. Liu, T. Tan, and W. Hu, “Semantic interpretation of object activities in a surveillance system,” In Proc. International Conference on Pattern Recognition, pages III: 777–780, 2002.

[16] N.M. Oliver, B. Rosario, and A.P. Pentland, “A Bayesian computer vision system for modeling human interactions,” IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):831–843, August 2000.

[17] Available in: http://en.wikipedia.org/wiki/Epipolar_geometry.

[18] Roger Y. TSAI , “A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off the-shelf TV Cameras and Lenses,” IEEE Journal of Robotics and Automation, VOL. RA-3, NO. 4, AUGUST 1987.

[19] Ying Wu, John Y.Lin, Thomas S.Huang, “ Capturing Natural Hand Articulation,” IEEE International Conference on Computer Vision, Canada, 2001.

[20] Makoto Kato, Yen-Wei Chen and Gang Xu, “Articulated Hand Tracking by PCA-ICA Approach,” International Conference on Automatic Face and Gesture Recognition, IEEE 2006.

[21] Brent Martin, “INSTANCE-BASED LEARNING: Nearest Neighbor with Generalization,” Department of Computer Science University of Waikato Hamilton, New Zealand, March 1995.

[22] Gernot A. Fink, “Markov Models for Pattern Recognition From Theory to Applications,” Springer-Verlag Berlin Heidelberg 2008.

[23] Mahmoud Elmezain, Ayoub Al-Hamadi, J¨org Appenrodt, Bernd Michaelis, “A Hidden Markov Model-Based Continuous Gesture Recognition System for Hand Motion Trajectory,” IEEE 2008.

[24] Lawrence R. Rabiner, “A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition,” Proceedings of the IEEE, Vol. 77, No. 2, pp. 257-286, February, 1989.

LETTERS TO EDITOR

Journal of Electrical and Computer Engineering Innovations (JECEI) welcomes letters to the editor for the post-publication discussions and corrections which allows debate post publication on its site, through the Letters to Editor. Letters pertaining to manuscript published in JECEI should be sent to the editorial office of JECEI within three months of either online publication or before printed publication, except for critiques of original research. Following points are to be considering before sending the letters (comments) to the editor.

[1] Letters that include statements of statistics, facts, research, or theories should include appropriate references, although more than three are discouraged.

[2] Letters that are personal attacks on an author rather than thoughtful criticism of the author’s ideas will not be considered for publication.

[3] Letters can be no more than 300 words in length.

[4] Letter writers should include a statement at the beginning of the letter stating that it is being submitted either for publication or not.

[5] Anonymous letters will not be considered.

[6] Letter writers must include their city and state of residence or work.

[7] Letters will be edited for clarity and length.

Name *

Email Address *

Affiliation *

Comments *

Security Code *

Journal of Electrical and Computer Engineering Innovations (JECEI)

3D Hand Motion Evaluation Using HMM

References

References

Send comment about this article

Volume 1, Issue 1 - Serial Number 1
January 2013
Pages 11-18

3D Hand Motion Evaluation Using HMM

References

References

Send comment about this article

Volume 1, Issue 1 - Serial Number 1January 2013Pages 11-18

Volume 1, Issue 1 - Serial Number 1
January 2013
Pages 11-18