Sequential decision-making via dynamic programming. Optimal control of stochastic dynamic systems. Applications in linear-quadratic control, inventory control, resource allocation, scheduling, and control of queues. Rollout and other suboptimal methods. Value and policy iteration. Pre: 342 or MATH 371 or MATH 471, or consent.