Dissertation Presentation

 
Presenter: Xiaomin Li
 
Advisor: Vangelis Metsis
 
Date & Time: May 24th 2022, 11 am - 12:30 pm Central Time
 
 
Title: Self-Supervised Transfer Learning and Generative Adversarial Networks for Biomedical Signal Augmentation
 
Abstract
Deep Learning has become the dominant solution for many applications in a variety of data fields. Despite their powerful ability to recognize patterns in data, deep learning models require large amounts of data to be trained successfully. However, in health-related and medical applications, such data are often expensive to collect and require laborious work by experts to annotate. Therefore, a shortage of labeled data is a common phenomenon. Besides, public datasets made available by different sources are collected with different settings and configurations which further hinders data reusability among different applications.
 
This dissertation explores several ways to relieve the data shortage problem and improve the performance of deep learning models on signal data recorded in the form of time series. First, we develop a transfer learning methodology to transfer the general features learned from bigger time-series datasets to new domain smaller datasets. We have explored supervised, unsupervised, and self-supervised methods to train such feature extractors. Our approach also solves the problem of configuration incompatibilities between datasets. Second, we leverage generative adversarial networks (GANs) to generate synthetic signal data so as to expand the size of original datasets. We have introduced two transformer-based GAN models, TTS-GAN, and TTS-CGAN, which can generate multi-dimensional and arbitrary-length time-series data. We use several qualitative and quantitative evaluation metrics to demonstrate the fidelity of our GAN model-generated data, and compare their performance with many other state-of-the-art time-series GANs.
 
To conclude the work of this dissertation, we will continue to explore GAN solutions to improve the performance of deep learning applications in this field. We will adopt the idea of Style Transfer GAN, which is booming in the image processing field, to solve the data imbalance issue that commonly exists in health-related signal datasets. Furthermore, we will tackle the problem of information loss during the process of signal noise filtering. We will develop super-resolution GAN models to artificially increase the sampling rate of a signal, and generate a high-resolution signal, from low-resolution input samples, that maintains the properties of the original signals.

Deadline: June 15, 2022, midnight