Stochastic Processes

3 credits · Graduate

This course is an introduction to the fundamentals of stochastic processes at a graduate level. Emphasis is placed on the analysis of the probability structure of stochastic models. Topics discussed include renewal processes, counting processes, Markov chains, Markov decision processes, birth and death processes. Stationary processes and their spectral analysis may also be discussed. Applications of stochastic processes in operations research, quality and reliability engineering are presented.