Physics, Systems and Circuits and Linear Systems

- To understand the differences and peculiarities of virtual reality, augmented reality and mixed reality systems. - To know the sound reproduction devices employed in virtual reality at present. - To know the particularities of the human auditory system on which virtual reality systems are based. - To understand the basic fundamentals of sound propagation and acoustics. - To understand the differences among audio system based on channels, objects and scenes. - To understand the different parts of a 3D binaural rendering system for virtual reality. - To know the features of the acoustic sources that allow their simulation and representation in a 3D binaural rendering system for virtual reality. - To know acoustic propagation theories that allow modeling this propagation in a binaural 3D rendering system for virtual reality. - To know the characteristics of the receiver (human being), by modeling the HRTF responses, and to understand the differences between the different estimation methods of these responses. - To use acoustic simulation software to perform an auralization, considering the particularities of the source, the acoustic propagation and the receiver. - To know the different formats used in binaural audio for virtual reality, and the reproduction systems for 3D audio, emphasizing their particularities when they are implemented in applications focused on videogames, music production and cinema, among many others.

1.- Introduction. 1.1 Definition of Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). 1.2 Playback devices. 1.3 Fundamentals of human auditory system. 1.4 Immersive spatial audio. 2.- Binaural 3D audio for virtual reality. 2.1 Binaural Rendering: - Introduction. Auralization concept. - Sound source modelling: I - Sound power and directivity. - Receiver modelling: I - HRTF (head-related transfer function). II - Individualized Binaural Rendering. III - Movement tracking. - Acoustic propagation modelling. I- Reverberation time and room impulse response. II - Acoustic theories for indoor acoustic propagation: a) Statistical theory. Acoustic absorption. b) Geometric theory. Echogram. c) Undulatory theory. Room modes. III -Acoustic Environment Rendering Techniques . IV - Simulation software. 2.2 3D audio reproduction formats. - Channel-based audio. - Object-based audio. - Scene-based audio. Ambisonics. 2.3. 3D Audio reproduction systems: examples of systems and their equalization.

Three teaching activities are proposed: theoretical classes, guided projects and lab exercises. THEORETICAL CLASSES The theoretical class will be given in the blackboard, with slides or by any other means to illustrate the concepts of the lectures. In these classes the explanation will be completed with realistic examples of virtual audio. In these sessions the student will acquire the basic concepts of the course. The students will have to work on the explained concepts, working out and solving the proposed assignments in order to consolidate the concepts of the course. GUIDED PROJECT The students will carry out a guided projects. To this end, the students will be given a detailed guide and some specific tutoring. LABORATORY EXERCISES The lab exercises will help the students familiarize themselves with important concepts in virtual audio technologies. They include the measurement of binaural room impulse responses., and the use of software for acoustic design and auralizations development.