Applied Data Engineering
Storing, managing, and processing data are core to data science. This course introduces essential data engineering concepts needed to work effectively with data systems. Students learn how data pipelines are designed, built, and maintained, including data flows, storage, and processing. The course connects technical foundations to real-world business use cases, showing how organizations create value from data. Through hands-on interaction with data at different pipeline stages, students explore key tools, platforms, and architectures used to support scalable data science applications.
Topics
- Articulate and justify the role of data engineering in the machine learning lifecycle and how it supports downstream analytics, modeling, and deployment. Design and implement data ingestion workflows to collect data from multiple sources (APIs, files, databases, streaming systems). Model and develop datasets appropriately based on data type and scale, including structured, semi-structured, and unstructured data. Build reproducible data pipelines that transform raw data utilizing standardized techniques such as normalization into analysis-ready datasets. Integrate and validate multiple data sources into a unified dataset while resolving schema differences, joins, and data quality issues. Design scalable storage formats suitable for analytical and machine learning workloads. Evaluate and select appropriate data infrastructure and tools based on use case, scale, cost, and performance constraints. Prepare datasets for downstream machine learning systems to ensure data reliability and usability.
Official catalogue course objectives and student learning outcomes
Prerequisites & course information
{'concurrentPrerequisit': False, 'QW0jb': '<ul><li><p>A class prerequisite can be applied in any specific class section and must be set by enrollment managers in every term. </p></li><li><p>The Office of the Registrar will create the prerequisite so it may be applied. </p><ul><li><p>Allow 1-2 weeks for configuration in Campus Solutions. To guarantee prerequisites are processed within this timeframe, please submit your request <strong>at least 4 weeks</strong> before enrollment begins.</p></li></ul></li></ul>', 'GrBqR': '<ul><li><p>A course prerequisite will be enforced in ALL subsequent class sections and cannot be edited.</p></li><li><p>The Office of the Registrar will create and apply the prerequisite to this course.</p><ul><li><p>Allow 1-2 weeks for configuration in Campus Solutions. To guarantee prerequisites are processed within this timeframe, please submit your request <strong>at least 4 weeks</strong> before enrollment begins.</p></li></ul></li></ul>', 'HrzGt': True, 'minGrade': 'C-, Passed (P) or higher', 'SVbmN': False, 'preRequisiteCourse': '1542332'}
Sources
- Course catalogue ↗2026-2027