The objective of this project is the development of the first rehabilitation system that combines the benefits of virtual reality and its interaction with real objects. The system will allow training movements that involve all the joints of arms and hands (shoulders, elbows, wrist and fingers), and also the manipulation of daily objects (cutlery, crockery, toilet utensils, coins, etc.). In addition, the system will monitor body segments and objects, without carry any kind of technology, only based on the information recorded by RGB and depth cameras.
The system will provide rehabilitation exercises through multisensory stimulation that will be projected on the area of manipulation and interaction. For this, the system will be placed on any conventional table and will project visual stimuli on its surface, transforming any table into an interactive rehabilitation environment, which will also avoid the effect of gravity, facilitating its use by patients who do not have enough strength.
The virtual environments will promote the mechanisms of motor learning and will allow to grade the difficulty of the exercises, specifying the intervention to the particular needs of each patient at each moment. In addition, the system will not only provide rehabilitation exercises, but it will also provide kinematic assessment tools that will allow not only the progression of patients to be assessed, but also their status compared to a normalized sample of healthy individuals.