THESIS DEFENSE PRESENTATION

THESIS DEFENSE PRESENTION

 

Title: Fall Detection Using Federated Learning for Model Personalization and Anomaly Detection

 

Presenter: Nader Maray

 

Advisor: Dr. Anne Hee Hiong Ngu

 

Date/Time: Tuesday, April 11th @1:30 p.m.

 

Location:  Comal 212 or Zoom:

https://txstate.zoom.us/j/97943905678?pwd=MTM4UkxVNStzZXFXT1AxdkxBOEhQUT09

Meeting ID: 979 4390 5678
Passcode: 870067

 

Abstract:

Falls in the elderly are associated with significant morbidity and mortality. While numerous fall detection devices incorporating AI and machine learning algorithms have been developed, no known smartwatch-based system has been used successfully in real-time to detect falls for elderly persons. We have developed and deployed a SmartFall system on a commodity-based smartwatch which has been trialled by nine elderly participants. The system, while being usable and welcomed by the participants in our trials, has two serious limitations. The first limitation is the inability to collect a large amount of personalized data for training. When the fall detection model, which is trained with insufficient data, is used in the real world, it generates a large amount of false positives. The second limitation is the model drift problem. This means an accurate model trained using data collected with a specific device performs sub-par when used in another device. Therefore, building one model for each type of device/watch is not a scalable approach for developing smartwatch-based fall detection system. To tackle those issues, we will focus on two datasets including accelerometer data for fall detection problem from different devices: the Microsoft watch (MSBAND), and the Meta Sensor device. We have previously achieved good success in solving the limitations through the use of transfer learning, however, false positives still remained as a problem, as well as real-time model testing. To solve the remaining issues, we will try to apply two main methods, the first method is building a federated learning framework of multiple edge devices for multiple people, where each edge device would have its own personalized fall detection model, as well as its own synthetically generated data and real life data, while the second method would treat the problem as an anomaly detection problem, where the standard action would be an ADL (Activities of Daily Life) and the anomaly would be a fall, and vice versa. Federated learning experiments without the use of synthetic data showed promising results, achieving an average F1-score of 0.93, while the synthetic data experiment, along with the anomaly detection experiment did not achieve results better than the previous model.

 

 

Deadline: April 12, 2023, midnight