Taught by: Valmiki Kothare, MIT (November 16, 2023)
Video: Building and Training Deep Learning Models in PyTorch
Description: In this tutorial, we will use deep learning on EEG and EMG mice data to predict sleep stages (Wakefulness, REM, Non-REM). We will walk through an example Jupyter Notebook in which we load a dataset, preprocess it, build a “residual-attention” network, train our model, and validate our performance on withheld data. In the process of going through the notebook, we will discuss briefly how to run this on OpenMind and how to parallelize training across multiple GPUs, as well as the reasoning behind the network architecture choice and the basic theory of the attention/transformer layer.
Additional Resources: Google Colab notebook
