AI Evaluation and Quality Assurance

1.5 credits · College of Connected Computing - Professional

Post-deployment evaluation and sustainable quality assurance for AI systems. Production monitoring and ongoing quality assessment; A/B testing AI solutions in operational contexts; measuring real-world impact beyond metrics; diagnosing failures and data drift after deployment; distribution shift and evaluation gaming; communicating evaluation results to different audiences. Students develop evaluation frameworks for real deployments. Synchronous online with asynchronous components. [1.5]