Haptic-based personalized system interface using hand gesture signal for mobile robot movement

Tan, Chen Lung (2024) Haptic-based personalized system interface using hand gesture signal for mobile robot movement. Project Report. Universiti Teknikal Malaysia Melaka, Melaka, Malaysia. (Submitted)

Text (Full text) Haptic-based personalized system interface using hand gesture signal for mobile robot movement.pdf - Submitted Version Download (3MB)

Abstract

This project introduces a development in human-robot interaction through the creation of a haptic-based hand glove. The current lack of intuitive and natural interfaces for human-robot interaction, such as buttons or joysticks, is a significant challenge. The glove translates hand gesture signals into diverse mobile robot movement instructions, providing an intuitive and personalized control interface. The hand glove unit is constructed with flex sensors, transceiver, and vibration motor connected to Arduino Nano, while the mobile robot unit is constructed with transceiver, accelerometer, and L298N motor driver connected to Arduino UNO. Demonstrations across various environments validate the accuracy and versatility of the translated instructions. A haptic- based hand glove that can translate hand gesture signal into mobile robot movement is developed and the accuracy of the translated instruction is obtained by demonstrating mobile robot movement in different environments. The result of this project is obtained from the flex sensors of haptic-based hand glove and accelerometer reading from mobile robot unit. As part of future work, transitioning from half-duplex to full-duplex transceivers is suggested to enhance bidirectional communication, promising a more seamless and responsive interaction between users and mobile robots. This advancement marks a significant step towards a user-friendly and adaptable era in robotics.

Actions (login required)

View Item