Introduction to Markov Processes

3 credits · College of Engineering catalogue

Advisory Prerequisite: None. Enforced Prerequisite: IOE 265 and (MATH 214 or MATH 216 or MATH 256 or MATH 286 or MATH 316 or ROB 101); No OP/F. Minimum grade requirement of “C-” for enforced prerequisite. (3 credits) Introduction to discrete Markov Chains and continuous Markov processes, including transient and limiting behavior. Introduction to Markov Decision Processes. The Poisson/Exponential process. Applications to reliability, maintenance, inventory, production, queues and other engineering problems.