Logo PTI
Polish Information Processing Society
Logo FedCSIS

Annals of Computer Science and Information Systems, Volume 8

Proceedings of the 2016 Federated Conference on Computer Science and Information Systems

HD: Efficient Hand Detection and Tracking

, ,

DOI: http://dx.doi.org/10.15439/2016F445

Citation: Proceedings of the 2016 Federated Conference on Computer Science and Information Systems, M. Ganzha, L. Maciaszek, M. Paprzycki (eds). ACSIS, Vol. 8, pages 291–297 ()

Full text

Abstract. Automated hand detection is useful for applications requiring reliable hand posture and hand gesture processing. Such applications include human-computer interfaces for rehabilitation, serious games, or non-invasive medical diagnosis. Hence, in this paper, we focus on the design and development of a robust and fast hand detection and tracking (HD) system. The design of our HD system involved the study of the human skin color and of the foreground properties of people, in order to merge efficiently these information for an efficient hand detection and tracking. Experiments have been carried out in real-world environment and have demonstrated the excellent performance of our HD system.

References

  1. V. I. Pavlovic, R. Sharma, and T. S. Huang, “Visual interpretation of hand gestures for human-computer interaction: a review,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 677–695, 1997.
  2. R. Suriya and V. Vijayachamundeeswari, “A survey on hand gesture recognition for simple mouse control,” in Proceedings of the IEEE International Conference on Information Communication and Embedded Systems, 2014, pp. 1–5.
  3. A. Aristidou and J. Lasenby, “Motion capture with constrained inverse kinematics for real-time hand tracking,” in Proceedings of the IEEE International Symposium on Communications, Control and Signal Processing, 2010, pp. 1–5.
  4. N. J. Kim, S. Suh, and C. Choi, “Robust finger contact detection with majority quadrant search for interactive tabletop displays,” in Proceedings of the IEEE International Conference on Consumer Electronics, 2014, pp. 518–519.
  5. M. Refice, M. Savino, M. Adduci, and M. Caccia, “Automatic classification of gestures: A context-dependent approach,” in Proceedings of the IEEE Federated Conference on Computer Science and Information Systems (FedCSIS), 2011, pp. 743–750.
  6. A. T. S. Chan, H. V. Leong, and S. H. Kong, “Real-time tracking of hand gestures for interactive game design,” in Proceedings of the IEEE International Symposium on Industrial Electronics, 2009, pp. 98–103.
  7. A. H. J. Moreira, S. Queiros, J. Fonseca, P. L. Rodrigues, N. F. Rodrigues, and J. L. Vilaca, “Real-time hand tracking for rehabilitation and character animation,” in Proceedings of the IEEE International Conference on Serious Games and Applications for Health, 2014, pp. 1–8.
  8. S. Ben Jemaa, M. Hammami, and H. Ben-Abdallah, “Contactless hand detection in complex image based on data-mining process,” in Proceedings of the IEEE Conference on Computer Systems and Applications, 2013, pp. 1–4.
  9. A. N. Kataria, D. M. Adhyaru, A. K. Sharma, and T. H. Zaveri, “A survey of automated biometric authentication techniques,” in Proceedings of the IEEE Nirma University International Conference on Engineering, 2013, pp. 1–6.
  10. W. Kong, A. Hussain, M. H. M. Saad, and N. M. Tahir, “Hand detection from silhouette for video surveillance application,” in Proceedings of the IEEE International Colloquium on Signal Processing and its Applications, 2012, pp. 514–518.
  11. E. Dente, J. Ng, A. Vrij, S. Mann, A. Bull, and A. Bharath, “Tracking small hand movements in interview situations,” in Proceedings of the IEEE International Symposium on Imaging for Crime Detection and Prevention, 2005, pp. 55–60.
  12. S. S. Rautaray and A. Agrawal, “Design of gesture recognition system for dynamic user interface,” in Proceedings of the IEEE International Conference on Technology Enhanced Education, 2012, pp. 1–6.
  13. V. Viitaniemi, M. Karppa, and J. Laaksonen, “Experiments on recognising the handshape in blobs extracted from sign language videos,” in Proceedings of the IEEE International Conference on Pattern Recognition (ICPR’14), 2014, pp. 2584–2589.
  14. C. D. Lim, C.-M. Wang, C.-Y. Cheng, Y. Chao, S.-H. Tseng, and L.-C. Fu, “Sensory cues guided rehabilitation robotic walker realized by depth image-based gait analysis,” IEEE Transactions on Automation Science and Engineering, vol. 13, no. 1, pp. 171–180, January 2016.
  15. N. Nordin, M. R. Arshad, U. Soori, and N. M. Yin, “Virtual input using skin color model for robotic platform control,” in Proceedings of the IEEE International Conference on Signal and Image Processing Applications, 2009, pp. 305–311.
  16. G. P. Rosati Papini, M. Fontana, and M. Bergamasco, “Desktop haptic interface for simulation of hand-tremor,” IEEE Transactions on Haptics, vol. 9, no. 1, pp. 33–42, 2016.
  17. L. Shires, S. Battersby, J. Lewis, D. Brown, N. Sherkat, and P. Standen, “Enhancing the tracking capabilities of the Microsoft Kinect for stroke rehabilitation,” in Proceedings of the IEEE International Conference on Serious Games and Applications for Health, 2013, pp. 1–8.
  18. G. V. Kondraske and R. M. Stewart, “Web-based evaluation of Parkinson’s disease subjects: Objective performance capacity measurements and subjective characterization profiles,” in Proceedings of the IEEE Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2008, pp. 799–802.
  19. R. LeMoyne, C. Coroian, and T. Mastroianni, “Quantification of Parkinson’s disease characteristics using wireless accelerometers,” in Proceedings of the IEEE International Conference on Complex Medical Engineering, 2009, pp. 1–5.
  20. J. Ide, T. Sugi, N. Murakami, F. Shima, H. Shibasaki, and M. Nakamura, “Quantitative evaluation of hand movement on visual target tracking for patients with Parkinson’s disease,” in Proceedings of the IEEE International Conference on Complex Medical Engineering, 2007, pp. 1896–1900.
  21. S. Das, L. Trutoiu, A. Murai, D. Alcindor, M. Oh, F. De la Torre, and J. Hodgins, “Quantitative measurement of motor symptoms in Parkinson’s disease: A study with full-body motion capture data,” in Proceedings of the IEEE International Conference on the Engineering in Medicine and Biology Society, 2011, pp. 6789–6792.
  22. J. Chiang, Z. J. Wang, and M. J. McKeown, “A generalized multivariate autoregressive (gmar)-based approach for eeg source connectivity analysis,” IEEE Transactions on Signal Processing, vol. 60, no. 1, pp. 453–465, 2012.
  23. R. Z. Khan and N. A. Ibraheem, “Survey on gesture recognition for hand image postures,” Computer and Information Science, vol. 5, no. 3, pp. 110, 2012.
  24. A. El-Sawah, C. Joslin, N. D. Georganas, and E. M. Petriu, “A framework for 3D hand tracking and gesture recognition using elements of genetic programming,” in Proceedings of the IEEE Canadian Conference on Computer and Robot Vision, 2007, pp. 495–502.
  25. S. Lu, G. Tsechpenakis, D. N. Metaxas, M. L. Jensen, and J. Kruse, “Blob analysis of the head and hands: A method for deception detection,” in Proceedings of the IEEE Annual Hawaii International Conference on System Sciences, 2005, pp. 20c–20c.
  26. A. Thangali and S. Sclaroff, “An alignment based similarity measure for hand detection in cluttered sign language video,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2009, pp. 89–96.
  27. E.-J. Ong and R. Bowden, “A boosted classifier tree for hand shape detection,” in Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition, 2004, pp. 889–894.
  28. R. Wood and J. I. Olszewska, “Lighting-variable AdaBoost based-on system for robust face detection,” in Proceedings of the International Conference on Bio-Inspired Systems and Signal Processing, 2012, pp. 494–497.
  29. S. Berman and H. Stern, “Sensors for gesture recognition systems,” IEEE Transactions on Systems, Man, and Cybernetics - Part C: Applications and Reviews, vol. 42, no. 3, pp. 277–290, 2012.
  30. J. Kumar, Q. Li, S. Kyal, E. A. Bernal, and R. Bala, “On-the-fly hand detection training with application in egocentric action recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW’ 15), 2015, pp. 18–27.
  31. D. D. Nguyen, T. C. Pham, X. D. Pham, S. H. Jin, and J. W. Jeon, “Finger extraction from scene with grayscale morphology and BLOB analysis,” in Proceedings of the IEEE International Conference on Robotics and Biomimetics, 2009, pp. 324–329.
  32. J. Suarez and R. R. Murphy, “Hand gesture recognition with depth images: A review,” in Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication, 2012, pp. 441–417.
  33. S. Rungruangbaiyok, R. Duangsoithong, and K. Chetpattananondh, “Ensemble threshold segmentation for hand detection,” in Proceedings of the IEEE International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, 2015, pp. 1–5.
  34. E. Marilly, A. Gonguet, O. Martinot, and F. Pain, “Gesture interactions with video: From algorithms to user evaluation,” Bell Labs Technical Journal, vol. 17, no. 4, pp. 103–118, 2013.
  35. Y. R. Wang, J. L. Syu, H. T. Li, and L. Yang, “Fast hand detection and gesture recognition,” in Proceedings of the IEEE International Conference on Machine Learning and Cybernetics, 2015, vol. 1, pp. 408–413.
  36. Z. Musa, K. Jumari, and N. Zainal, “A method of human skin detection base on background subtraction and color enhancement,” in Proceedings of the IEEE Symposium on Business, Engineering and Industrial Applications, 2011, pp. 498–502.
  37. D. Xu, Y. L. Chen, X. Wu, Y. Ou, and Y. Xu, “Integrated approach of skin-color detection and depth information for hand and face localization,” in Proceedings of the IEEE International Conference on Robotics and Biomimetics, 2011, pp. 952–956.
  38. S. Rautaray, S. Siddharth, and A. Agrawal, “Vision based hand gesture recognition for human computer interaction: a survey,” Artificial Intelligence Review, vol. 43, no. 1, pp. 1–54, 2015.
  39. V. Vezhnevets, V. Sazonov, and A. Andreeva, “A survey on pixel-based skin color detection techniques,” in Proceedings of the IEEE Graphicon, 2003, vol. 3, pp. 85–92.
  40. S. Bilal, R. Akmeliawati, M. J. E. Salami, A. A. Shafie, and E. M. Bouhabba, “A hybrid method using haar-like and skin-color algorithm for hand posture detection, recognition and tracking,” in Proceedings of the IEEE International Conference on Mechatronics and Automation, 2010, pp. 934–939.
  41. S. Xie and J. Pan, “Hand detection using robust color correction and Gaussian mixture model,” in Proceedings of the IEEE International Conference on Image and Graphics, 2011, pp. 553–557.
  42. B. Junxia, Y. Jianqin, W. Jun, and Z. Ling, “Hand detection based on depth information and color information of the kinect,” in Proceedings of the IEEE Chinese Control and Decision Conference, 2015, pp. 4205–4210.
  43. J. Rajan, “Pantech Solution,,” 2013, Available online at: https://www.pantechsolutions.net/blog/matlab-code-for-background-subtraction/.
  44. J. I. Olszewska, “Multi-camera video object recognition using active contours,” in Proceedings of the International Conference on Bio-Inspired Systems and Signal Processing, 2015, pp. 379–384.
  45. C. R. Wren, A. Azarbayejani, T. Darrell, and A. P. Pentland, “Real-time tracking of the human body,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 780–785, 1997.
  46. J. Sonkusare, N.B. Chopade, R. sor, and S. L. Tade, “A review on hand gesture recognition system,” in Proceedings of the IEEE International Conference on Computing, Communication, Control, and Automation, 2015, pp. 790–794.
  47. P. Viola and M. J. Jones, “Robust real-time face detection,” International Journal of Computer Vision, vol. 57, no. 2, pp. 137–154, January 2004.
  48. N. Soontranon, S. Aramvith, and T. H. Chalidabhongse, “Face and hands localization and tracking for sign language recognition,” in Proceedings of the IEEE International Symposium on Communications and Information Technology, 2004, vol. 2, pp. 1246–1251 vol.2.
  49. S. Kang, J. Oh, and H. Hong, “Human gesture detection based on 3d blobs and skeleton model,” in Proceedings of the IEEE International Conference on Information Science and Applications, 2013, pp. 1–4.
  50. H. S. Park and K. H. Jo, “Real-time hand gesture recognition for augmented screen using average background and camshift,” in Proceedings of the IEEE Korea-Japan Joint Workshop on Frontiers of Computer Vision, 2013, pp. 18–21.
  51. X. Meng, J. Lin, and Y. Ding, “An extended hog model: Schog for human hand detection,” in Proceedings of the IEEE International Conference on Systems and Informatics, 2012, pp. 2593–2596.
  52. H. Cheng, L. Yang, and Z. Liu, “A survey on 3d hand gesture recognition,” IEEE Transactions on Circuits and Systems for Video Technology, vol. PP, no. 99, 2015.
  53. L. Evett, A. Burton, S. Battersby, D. Brown, N. Sherkat, G. Ford, H. Liu, and P. Standen, “Dual camera motion capture for serious games in stroke rehabilitation,” in Proceedings of the IEEE International Conference on Serious Games and Applications for Health, 2011, pp. 1–4.
  54. W.-H. Chen, Y.-H. Lin, and S.-J. Yang, “A generic framework for the design of visual-based gesture control interface,” in Proceedings of the IEEE Conference on Industrial Electronics and Applications, 2010, pp. 1522–1525.
  55. H. V. Verma, E. Aggarwal, and S. Chandra, “Gesture recognition using kinect for sign language translation,” in Proceedings of the IEEE International Conference on Image Information Processing, 2013, pp. 96–100.