Virtual Interface With Kinect 3D Sensor for Interaction With Bedridden People: First Insights

• Main Author: Carvalho, Vitor
• Publication Date: 2021
• Other Authors: Eusébio, José
• Format: Article
• Language: eng
• Source: Repositórios Científicos de Acesso Aberto de Portugal (RCAAP)
• Download full: http://hdl.handle.net/11110/2424
• topic: Bedridden People; Kinect; Natural User Interface; Shape Matching

The human-machine interaction has evolved significantly in the last years, allowing a new range of opportunities for developing solutions for people with physical limitations. Natural user interfaces (NUI) allow bedridden and/or physically disabled people to perform a set of actions through gestures thus increasing their quality of life and autonomy. This paper presents a solution based on image processing and computer vision using the Kinect 3D sensor for development of applications that recognize gestures made by the human hand. The gestures are then identified by a software application that triggers a set of actions of upmost importance for the bedridden person, for example, trigger the emergency, switch on/off the TV, or control the bed slope. A shape matching technique for six gestures recognition, being the final actions activated by the Arduino platform, was used. The results show a success rate of 96%. This system can improve the quality of life and autonomy of bedridden people, being able to be adapted for the specific necessities of an individual subject.