Computing at Scale

Harvard FAS

This course focuses on efficient AI computations aimed at reducing the cost of AI model training and inference. Students will learn systematic methods for implementing parallel and distributed computations for computer vision and language models such as CNNs and Transformers across multiple computing cores or nodes. They will also learn techniques for co-designing machine learning models, data curation methods, computing algorithms, and system architectures.Techniques to be studied include…