The Design of an Intelligent Robotic Wheelchair Supporting People with Special Needs, Including for Their Visual System

Abstract

The paper aims to study the applicability and limitations of the solution resulting from a design process for an intelligent system supporting people with special needs who are not physically able to control a wheelchair using classical systems. The intelligent system uses information from smart sensors and offers a control system that replaces the use of a joystick. The necessary movements of the chair in the environment can be determined by an intelligent vision system analyzing the direction of the patient’s gaze and point of view, as well as the actions of the head. In this approach, an important task is to detect the destination target in the 3D workspace. This solution has been evaluated, outdoor and indoor, under different lighting conditions. In order to design the intelligent wheelchair, and because sometimes people with special needs also have specific problems with their optical system (e.g., strabismus, Nystagmus) the system was tested on different subjects, some of them wearing eyeglasses. During the design process of the intelligent system, all the tests involving human subjects were performed in accordance with specific rules of medical security and ethics. In this sense, the process was supervised by a company specialized in health activities that involve people with special needs. The main results and findings are as follows: validation of the proposed solution for all indoor lightning conditions; methodology to create personal profiles, used to improve the HMI efficiency and to adapt it to each subject needs; a primary evaluation and validation for the use of personal profiles in real life, indoor conditions. The conclusion is that the proposed solution can be used for persons who are not physically able to control a wheelchair using classical systems, having with minor vision deficiencies or major vision impairment affecting one of the eyes.

A human-in-the-loop approach for enhancing mobile robot navigation in presence of obstacles not detected by the sensory set

“…The feedback is provided by both a keyboard and a brain–computer interface, and for this purpose, the work includes also a protocol design phase to elicit ERP potentials. Moreover, the proposed approach can be suitable for any mobile robot that navigates indoor or in ambient assisted living (AAL) scenarios, trying to overcome all the issues related to the erroneous sensor reading in an indoor environment ( Silva et al, 2018 ; Cojocaru et al, 2021 ).…”

Building Surface Defect Detection Using Machine Learning and 3D Scanning Techniques in the Construction Domain

“…Other sensory systems used by the research team in previous work were Microsoft Kinect, which is like the ZED camera system (Figure 1) and the DJI Guidance system, which was made specifically for drone guidance [16]. The most advanced sensor used was the Velodyne VLP-16 Puck LiDAR, with a 360-degree scan range.…”

Optimization of Wheelchair Control via Multi-Modal Integration: Combining Webcam and EEG

“…The pattern differs in the speed of closing and opening, the degree of pressure on the eye, and the duration of blinking. The eye blink lasts approximately 100 to 400 ms [29].…”

“…To do this, we must first localize the human face in the overall image. Face detection is a technique that identifies a human face in an image and returns the value of the bounding box or rectangle associated with the face in x, y, w, and h coordinates [29].…”