New research from Carnegie Mellon University’s Robotics Institute (RI) aims to empower individuals with motor impairments by introducing a head-worn device that helps them control a mobile manipulator. This innovative device, developed by robotics Ph.D. student Akhil Padmanabha, utilizes a hands-free microphone and head-worn sensor to enable users to control a mobile robot using head motion and speech recognition.
Currently, over five million people in the United States live with paralysis or motor impairments, which can make everyday tasks like pouring a glass of water or dressing difficult. Existing technologies like hand-operated joysticks or web interfaces require fine motor skills, making them inaccessible to many individuals. However, the introduction of the Head-Worn Assistive Teleoperation (HAT) device offers a new solution.
The HAT device provides an alternative interface that requires fewer fine motor skills, making it more accessible for users facing constraints with current technologies. This device allows individuals to control a mobile robot simply by moving their head and issuing voice commands.
To test the effectiveness of the HAT device, a human study was conducted involving participants with and without motor impairments. The study involved completing various household and self-care tasks using the device. The results were promising, with participants achieving low error rates, minimal effort, and perceiving the device as easy to use.
The research team, comprised of Akhil Padmanabha and his colleagues Qin Wang, Daphne Han, Jashkumar Diyora, Kriti Kacker, Hamza Khalid, Liang-Jung Chen, Carmel Majidi, and Zackory Erickson, will present their findings, titled “HAT: Head-Worn Assistive Teleoperation of Mobile Manipulators,” at the upcoming IEEE’s International Conference on Robotics and Automation in London.
This groundbreaking research from Carnegie Mellon University’s Robotics Institute offers new hope for individuals with motor impairments, providing them with increased autonomy in completing daily tasks. The HAT device’s hands-free control through head motion and speech recognition makes it a game-changer in assistive technology, offering a more accessible and user-friendly solution for those in need.