Checking date: 09/07/2020

Course: 2020/2021

Stochastic Processes
(15452)
Study: Master in Mathematical Engineering (70)
EPI

Coordinating teacher: D AURIA , BERNARDO

Department assigned to the subject: Department of Statistics

Type: Electives
ECTS Credits: 6.0 ECTS

Course:
Semester:

Students are expected to have completed
An elementary course of Probability and Statistics
Competences and skills that will be acquired and learning results.
To acquire basic rudiments of the theory of stochastic processes. Modeling real problems through Markov processes and Martingales. To solve problems using the appropriate stochastic methodologies and techniques.
Description of contents: programme
Introduction and basic notions. - Measurable spaces, sigma-algebras, Probability spaces, Semi-algebras, Extension Theorem. - Continuity of probabilities - Random variables - Independence Discrete time Stochastic Processes. - Existence of the coin tossing probability space - Elementary existence theorem Discrete-time Markov chains. - Definitions and basic properties - Class structure - Hitting times and absorption probabilities - Strong Markov property - Recurrence and transience - Invariant distributions - Convergence to equilibrium Continuous-time Markov chains. - Q-matrices and their exponentials - Continuous-time random processes - Some properties of the exponential distribution - Poisson processes - Jump chain and holding times - Stopping times and strong Markov property - Explosion - Forward and backward differential equations - Class structure - Hitting times and absorption probabilities - Recurrence and transience - Invariant distributions - Convergence to equilibrium Discrete-time Martingales. - Definition and properties - Basic inequalities - Martingale convergence theorem - Uniform integrability - Optional Stopping Theorem Brownian Motion. - Definition and basic properties - Markov properties - Construction
Learning activities and methodology
Class hours (1.4 ECTS) will be devoted to the following training activities target: - "Lecture / exhibition: They will target specific cognitive skills matter. They present the knowledge that students should acquire. To facilitate their development students will receive class notes and key reference texts will allow them to complete and further on those issues which they are most interested in. - "Practical Classes: These classes are problem solving. These classes help to develop specific skills. Additionally, 1.4 ECTS will be devoted to training activities tutored. These oversight activities consist of teaching-learning both theoretical and practical training content, although it can develop independently, require the supervision and monitoring, more or less specific, by a teacher. These activities may include, among others, the following: scheduled tutorials, review of follow-up work and tutorials. The remaining credits, 3.2 ECTS are devoted to the study of students independently or in groups without teacher supervision. During this time the student performs exercises and readings proposed by the teacher. It also performs additional readings obtained through literature search between the material recommended by the teacher.
Assessment System
• % end-of-term-examination 40
• % of continuous assessment (assigments, laboratory, practicals...) 60
Basic Bibliography
• Norris, J.R.. Markov Chains. Cambridge University Press. 1997
• Bass, R.F.. Stochastic Processes. Cambridge University Press. 2001
• Rosenthal, J.S.. A First Look at Rigorous Probability Theory. World Scientific Publishing Co.. 2006