Hand Gestures Controlled In Augmented Reality By Using Oculus Rift And Leap Motion

Tan, Hung Chang (2016) Hand Gestures Controlled In Augmented Reality By Using Oculus Rift And Leap Motion. Project Report. UTeM, Melaka, Malaysia. (Submitted)

Text (24 Pages) Hand Gestures Controlled In Augmented Reality By Using Oculus Rift And Leap Motion.pdf - Submitted Version Download (956kB)

Abstract

Oculus Rift is a newly introduced technology in this market. It has the features which allow user or player to see virtual reality in it when wearing it. The virtual object or environment build in Oculus Rift can be interacted only if the user or player bought the Leap Motion or specially made controller for it. Leap Motion is a tracking sensor which tracks down both hand in the range of 120°. As long as the virtual object build inside the Oculus Rift is integrated to the Leap Motion function then user or player can interact with the object without a controller. After all, Oculus Rift has not been utilized to the fullest potential for instance, it should be able not only usable in virtual reality but as well as Augmented Reality which brings this technology alive. In this project, I plan to bring in Augmented Reality into Oculus Rift as current Oculus Rift does not support this feature. It can only be played around with virtual reality which has limited the versatility of this technology. Furthermore, interacting a virtual object with controller is not truly experiencing Augmented Reality. Thus, it should be integrated to Leap Motion in Augmented Reality. I propose to use two budget webcams as for the purpose to render stereoscopic image into the Oculus Rift and thus user or player can experience a 3D image inside Oculus Rift. In order to build a virtual object for interaction purpose, Unity 3D will be used to create the graphical interface. Beside creating graphical interface, Unity 3D can also render the output image from both webcams. Stereoscopic image will help human to differentiate or identify the object clearly as well as the distance itself. Due to low budget, the webcam which comes with low specification does affect the result.The major affected results are the colour resolution, sharpness and frame per second. To enhance user experience, Leap Motion feature will be integrated into this project as well. Seeing a virtual object in real life and user is capable on interacting it can bring lots of benefits toward human activities. The most significant field which will be benefit from this technology is education. During the lesson, students understanding towards the knowledge or message which teacher is trying to deliver will be increased as they can see the virtual object itself and interaction makes the virtual object alive. Beside this, medical field will be benefit with this technology to reduce the risk of an operation and a good practice for fresh doctors.

Actions (login required)

View Item