Thesis Defense: Presented by Mahya Saeednejad

Title: Real-time Movement Classification and Analysis from RGB – D Video Data

Speaker: Mahya Saeednejad

Advisor: Dr. Metsis

When: Friday, April 9th @2:00 p.m.

Where: Zoom Meeting I.D.   961 3936 6316



Physical therapy is a form of rehabilitative treatment that includes specially designed and prescribed exercises to help patients recover from diseases that disturb their movements of daily life or enhance their physical abilities. In physical therapy, tracking the movements of different body parts and classifying the movements during the exercises has great importance. The goal of this thesis is to create an interactive system able to recognize physical therapy exercises from patients’ movements and count the repetitions of them in real-time.

To achieve this objective, we used a combination of a Long Short-Term Memory (LSTM) model and Dynamic Time Warping (DTW) algorithm for the classification and counting the repetitions of exercises using 3D skeleton tracking data captured by Microsoft Kinect. First, we developed methods for preprocessing and normalization of a multi-dimensional skeleton sequence. Second, we explored ways of increasing the precision of offline human movement classification methods; finally, we created a real-time system for exercise recording and classification. In addition, we proposed a 3D DTW algorithm for 3D skeleton sequence pattern matching and counting the repetition of movements, and we designed and implemented an interactive application that tracks the actions of an individual, transfers information for processing, and displays the results.

Deadline: April 10, 2021, midnight