Accelerated Computing for Deep Learning

3 Credits

Graphics Processing Unit (GPU) versus Computer Processing Unit (CPU), hardware architecture of parallel computers, memory allocation and data parallelism, multidimensional kernel configuration, kernel-based parallel programming, principles and patterns of parallel algorithms, application of parallel computing to deep learning neural networks. Deep Learning (DL) algorithms, such as Convolutional Neural Networks (CNN), Stochastic Gradient Descent, and back propagation algorithms. Students may not obtain credit for more than one of ECE 303 , ECE 403 , and DSCI 421 .