Checking date: 30/04/2025 09:31:52


Course: 2025/2026

Stochastic Processes
(20552)
Bachelor in Data Science and Engineering (Plan: 566 - Estudio: 350)


Coordinating teacher: UCAR MARQUES, IÑAKI

Department assigned to the subject: Statistics Department

Type: Electives
ECTS Credits: 6.0 ECTS

Course:
Semester:




Requirements (Subjects that are assumed to be known)
Probability and data analysis (Year 1 - Semester 1)
Objectives
- Understand the theoretical foundations and basic properties of Stochastic Processes. - Learn the basic simulation techniques for the studied models. - Solve problems based on the studied models.
Description of contents: programme
1. Introduction to Stochastic Processes. 1.1. Basic Definitions and Notations. 1.2. Examples: branching processes and queues. 1.3. Review of Conditional Expectation. 1.4. Review of Characteristic Functions and applications. 2. Discrete time Markov Chains. 2.1. Basic Definitions and Notations. 2.2 Chapman-Kolmogorov Equations and classification of states. 2.3. Asymptotic results. 2.4. First Step Analysis. 2.5. Random Walks and Success Runs. 2.6 The Geo/Geo/1 queue. 3. Renewal Theory and Poisson process. 3.1 Definition and basic notions. 3.2 The Elementary Renewal Theorem.¿ 3.3 The Key Renewal Theorem. 3.4 The Delayed Renewal Theorem. 3.5 Compound Poisson Process. 4. Continuous time Markov Chains. 4.1 Definition and basic notions¿ 4.2 Chapman-Kolmogorov Equations and Limit Theorems 4.3 Birth and Death Processes (M/M/m queues). 5. Continuous time Markov Processes: Brownian Motion. 5.1 Brownian Motion and Gaussian Processes. 5.2 Variations and Extensions. 5.3 Hitting times.¿ 5.4 Relation with Martingales.
Learning activities and methodology
- Clases magistrales: Presentación de conceptos, desarrollo de la teoría y ejemplos, 2.2 ECTS - Clases de resolución de problemas: 2.2 ECTS - Prácticas de ordenador: 0.6 ECTS - Sesiones de evaluación (exámenes de evaluación continua y examen final): 1 ECTS
Assessment System
  • % end-of-term-examination/test 40
  • % of continuous assessment (assigments, laboratory, practicals...) 60

Calendar of Continuous assessment


Extraordinary call: regulations
Basic Bibliography
  • Robert P. Dobrow. Introduction to Stochastic Processes with R. Wiley. 2016
  • Sheldon M. Ross. Introduction to Probability Models. Academic Press. 2007
Additional Bibliography
  • Moshe Haviv. A Course in Queueing Theory. Springer. 2013
  • Richard Durrett. Essentials of Stochastic Processes. Springer. 2016

The course syllabus may change due academic events or other reasons.