Interactive manipulation of 3D objects using Kinect for visualization tools in education

Jaehong Lee, Heon Gu, Hyungchan Kim, Jungmin Kim, Hyoungrae Kim, Hakil Kim

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

16 Scopus citations

Abstract

This study develops and implements a Kinect-based 3D gesture recognition system for interactive manipulation of 3D objects in educational visualization softwares. The developed system detects and tracks human hands from the RGBD images captured by a Kinect sensor and recognizes human gestures by counting the number of open fingers of each fist and tracking 3D motion of both hands. The status of fists and gestures of hands are recognized as control commands of manipulating 3D structures visualized in 2D monitor by Molecule Viewer. The developed system is implemented on a Windows 7 laptop PC using C# and Emgu CV 2.3.0 library, and tested in ordinary classroom environment. Its performance demonstrates the overall average accuracy of around 90% in recognizing status of hands and gesture commands under various ambient lighting conditions.

Original languageEnglish
Title of host publicationICCAS 2013 - 2013 13th International Conference on Control, Automation and Systems
Pages1220-1222
Number of pages3
DOIs
StatePublished - 2013
Event2013 13th International Conference on Control, Automation and Systems, ICCAS 2013 - Gwangju, Korea, Republic of
Duration: 20 Oct 201323 Oct 2013

Publication series

NameInternational Conference on Control, Automation and Systems
ISSN (Print)1598-7833

Conference

Conference2013 13th International Conference on Control, Automation and Systems, ICCAS 2013
Country/TerritoryKorea, Republic of
CityGwangju
Period20/10/1323/10/13

Keywords

  • Computer-based learning
  • HCI
  • Kinect sensor
  • gesture recognition
  • hand detection

Fingerprint

Dive into the research topics of 'Interactive manipulation of 3D objects using Kinect for visualization tools in education'. Together they form a unique fingerprint.

Cite this