An Adaptive Mixed Reality System for Stroke Rehabilitation - Rehabilitation Institute of Chicago

Skip to Content

Fri, Nov 5

Speaker: Thanassis Rikakis, Yinpeng Chen, Margaret Duff (Arizona State University)

Title: An Adaptive Mixed Reality System for Stroke Rehabilitation

This talk will present an adaptive mixed reality rehabilitation (AMRR) system used to enhance upper extremity therapy following stroke. The AMRR system integrates traditional rehabilitation practices with state of the art computational, media arts and motion capture technologies to create an engaging environment to train reaching movements. The system provides real-time, intuitive and integrated audio and visual feedback (based on detailed kinematic data extracted from motion capture) that is representative of goal accomplishment, activity performance, and body function during a reaching task. The system also provides a quantitative kinematic evaluation that measures impairment levels based on the deviation of the stroke survivor’s movement from an idealized, unimpaired movement. The therapist can adapt the feedback and the complexity and difficulty of the task trained by the AMRR system throughout the therapy to address each participant’s individual impairments and progress. The system facilitates self-assessment by the stroke survivor and the AMRR approach can be utilized both for short periods of treatment at a hospital and to motivate continuous long-term interactive therapy at home. The design principles of the system, as well as clinical implementation examples and preliminary results from an ongoing study comparing AMRR therapy to traditional rehabilitation, will be presented.

Thanassis Rikakis is Professor and founding Director of the School of Arts, Media and Engineering (AME) at Arizona State University. Dr. Rikakis’ research is in the areas of experiential media, mixed reality rehabilitation, interdisciplinary education, and music composition and sound perception. He is Principal Investigator of a current NSF IGERT grant for interdisciplinary research and education in experiential media and Director of the Digital Culture Curriculum at ASU. Yinpeng Chen is currently an assistant research professor at Arizona State University. He received his Ph.D. from the Department of Electrical Engineering at Arizona State University in 2009. His research interests include adaptation modeling in mixed reality rehabilitation, dynamic decision-making and experiential media system.

Margaret Duff is pursuing her Ph.D in Bioengineering with a specialization in Arts, Media and Engineering at Arizona State University.  She is currently working on analyzing clinical scale and kinematic data from stroke survivors who have completed adaptive mixed reality rehabilitation (AMRR) therapy, as well as creating interactive tangible objects to train different upper-extremity tasks within the AMRR system.