Data Science at Scale

4.0 credits

Data intensive applications (DIA) are an important part of many valuable services that we rely on in our day to day lives. These applications in most cases are built by performing data engineering and data science at scale. Scale in this case implies data volume and compute capacity far outside of what is available on a single machine and its narrow connection to the internet. This course will focus on how to develop data intensive applications at scale in the Cloud. The course will be structured with lecture content and programming labs using Python and SQL on Databricks Unified Analytics Platform. Grading will be based on programming homework and a final project that demonstrates clear understanding of how to orchestrate the complete DIA pipeline to deliver business value in a commercial transportation application.