Integration of the Human Gesture Instructions and Autonomous Systems

A study conducted by Hideki Deguchi et al, was selected for the presentation at the 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

Object goal navigation, a robotic task, where a robot uses the name of the target provided by a user to explore, has garnered significant interest in recent years. However, the robot may not find the intended target if multiple objects share the same name. To overcome this issue, we consider providing target direction to robots via user pointing gestures as additional information. Because these user gestures might contain some noise, our method estimates the reliability of user instructions and then dynamically alternates between the gesture-based navigation and an exploration system. This study is expected to considerably contribute to the development of robotic systems capable of harmonious coexistence with humans.

Title: Enhanced Robot Navigation with Human Geometric Instruction
Authors: Deguchi, H., Taguchi, S., Shibata, K., Koide, S.
Journal Name: IEEE/RSJ International Conference on Intelligent Robots and Systems
Published: October 4, 2023
https://doi.org/10.1109/IROS55552.2023.10342107