I am Michele Stocco and I had the fantastic opportunity to develop my thesis in a context of collaboration between the University of Trento and the Nara Institute of Science and Technology.
The project took place over six months of which: three at the University of Trento under the guidance of Prof. Mariolino De Cecco and three as internship at the Japanese Institute under the guidance of Prof. Hirokazu Kato.
This thesis aims to be a first step in the introduction of augmented reality in a rehabilitative clinical setting with the purpose to support the therapist’s observations by providing real-time augmentations using Microsoft HoloLens. There has been developed a technology framework and an application for Microsoft HoloLens that, in real time, locate the patient in the environment (with three Microsoft KinectV2s) and display information regarding body data and interactions with the environment.
Since it is the first time that AR is applied in this way, a research path has been undertaken to identify and develop the most appropriate features to be visualized to improve the clinical eye.
A Head-Mounted display like the HoloLens is not always simple and intuitive to use, because of their particular input methods, so I developed a WebApp to be used on smartphones that controls the various features in a more everyday way.
The developed system was tested in the Japan laboratory by a rehabilitation professional, from the University of Kyoto, with very positive feedback and the thoughts that such a system could lead to improvements in the therapist evaluations.
My internship in Japan was certainly one of the best experiences of my life. I learned a lot, saw beautiful places, ate delicious food and met fantastic people. It has only been three months, but they will stay with me forever.
Arigatou gozaimashita! 🙂