### Probability and Statistical Methods (EK500)

Course Objective

1. Develop a solid foundation in probability theory and random processes.
2. Learn fundamental modeling and analysis techniques for stochastic systems so you can use them in applications found in various Engineering disciplines, Operations Research, and Computer Science.

Course Outline

FOUNDATIONS OF PROBABILITY THEORY

1. Basic concepts (sample space, event space, probability space)
2. Probability measures and probability functions
3. Discrete and continuous probability spaces
4. Dependent and independent events, conditional probability

RANDOM VARIABLES.

1. Definitions
2. Probability distribution and density functions
3. Functions of random variables
4. Expectation, moments, characteristic functions
5. Sequences of random variables, convergence, laws of large numbers and central limit theorem

RANDOM PROCESSES

1. Definitions
2. Random process properties (stationarity, ergodicity, correlation)
3. Spectral analysis, random process transformations
4. Special random processes used in modeling: Gaussian, Poisson, Markov; applications
5. Introduction to Estimation

### Discrete Event and Hybrid Systems (SE/EC/ME733)

Course Objectives

1. Learn about Discrete Event Systems (DES) and their applications, as well as recently emerging Hybrid Systems (HS) that combine both continuous (time-driven) and discrete (event-driven) dynamics.
2. Develop the ability to conceptualize cutting-edge issues in the DES and HS domain, and formulate problems for potential research purposes.

Course Outline

REVIEW OF SYSTEM THEORY FUNDAMENTALS

1. Basic concepts
2. Time-driven vs. event-driven systems
3. Examples of Discrete Event Systems (DES): computer systems;  communication networks; automated manufacturing;  traffic systems
4. The queueing system model.

UNTIMED MODELS OF DISCRETE-EVENT SYSTEMS.

1. State Automata
2. Petri Nets

TIMED MODELS OF DISCRETE-EVENT SYSTEMS.

1. Timed State Automata
2. Timed Petri Nets
3. Review of probability theory and stochastic processes
4. Stochastic Timed State Automata
5. The Poisson counting process and Markov chain models

INTRODUCTION TO DISCRETE EVENT (MONTE-CARLO) SIMULATION

1. Basic concepts in discrete event simulation
2. Model construction and applications
3. Introduction to estimation theory

MARKOV DECISION PROCESSES

1. Dynamic Programming
2. Solving resource contention problems: admission control,routing,  scheduling

Coming soon.