Physics, Systems and Circuits and Linear Systems

- To understand the differences and peculiarities of virtual reality, augmented reality and mixed reality systems. - To know the sound reproduction devices employed in virtual reality at present. - To know the particularities of the human auditory system on which virtual reality systems are based. - To understand the basic fundamentals of sound propagation and acoustics. - To understand the differences among audio system based on channels, objects and scenes. - To understand the different parts of a 3D binaural rendering system for virtual reality. - To know the features of the acoustic sources that allow their simulation and representation in a 3D binaural rendering system for virtual reality. - To know acoustic propagation theories that allow modeling this propagation in a binaural 3D rendering system for virtual reality. - To know the characteristics of the receiver (human being), by modeling the HRTF responses, and to understand the differences between the different estimation methods of these responses. - To use acoustic simulation software to perform an auralization, considering the particularities of the source, the acoustic propagation and the receiver. - To know the different formats used in binaural audio for virtual reality, and the reproduction systems for 3D audio, emphasizing their particularities when they are implemented in applications focused on videogames, music production and cinema, among many others.

CB1: Students have demonstrated possession and understanding of knowledge in an area of study that builds on the foundation of general secondary education, and is usually at a level that, while relying on advanced textbooks, also includes some aspects that involve knowledge from the cutting edge of their field of study. CB2: Students are able to apply their knowledge to their work or vocation in a professional manner and possess the competences usually demonstrated through the development and defence of arguments and problem solving within their field of study. CG3: Knowledge of basic and technological subject areas which enable acquisition of new methods and technologies, as well as endowing the technical engineer with the versatility necessary to adapt to any new situation. RA1: To acquire the knowledge and understanding of the general basic fundamentals of engineering, as well as, in particular, of multimedia communications networks and services, audio and video signal processing, room acoustic control, distributed multimedia systems and interactive multimedia applications specific to Sound and Image Engineering within the telecommunications family. RA5: Be competent to apply the knowledge acquired to solve problems and design audiovisual networks and services, to configure their devices, as well as to deploy adaptive, personal audiovisual applications and services on them, bringing network intelligence to the value for the user, maximising the potential of multimedia networks and services in the different social and economic spheres, knowing the environmental, commercial and industrial implications of the practice of engineering in accordance with professional ethics.

1.- Introduction. 1.1 Definition of Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). 1.2 Playback devices. 1.3 Fundamentals of human auditory system. 1.4 Immersive spatial audio. 2.- Binaural 3D audio for virtual reality. 2.1 Binaural Rendering: - Introduction. Auralization concept. - Sound source modelling: I - Sound power and directivity. - Receiver modelling: I - HRTF (head-related transfer function). II - Individualized Binaural Rendering. III - Movement tracking. - Acoustic propagation modelling. I- Reverberation time and room impulse response. II - Acoustic theories for indoor acoustic propagation: a) Statistical theory. Acoustic absorption. b) Geometric theory. Echogram. c) Undulatory theory. Room modes. III -Acoustic Environment Rendering Techniques . IV - Simulation software. 2.2 3D audio reproduction formats. - Channel-based audio. - Object-based audio. - Scene-based audio. Ambisonics. 2.3. 3D Audio reproduction systems: examples of systems and their equalization.

Three teaching activities are proposed: theoretical classes, guided projects and lab exercises. THEORETICAL CLASSES The theoretical class will be given in the blackboard, with slides or by any other means to illustrate the concepts of the lectures. In these classes the explanation will be completed with realistic examples of virtual audio. In these sessions the student will acquire the basic concepts of the course. The students will have to work on the explained concepts, working out and solving the proposed assignments in order to consolidate the concepts of the course. GUIDED PROJECT The students will carry out a guided projects. To this end, the students will be given a detailed guide and some specific tutoring. LABORATORY EXERCISES The lab exercises will help the students familiarize themselves with important concepts in virtual audio technologies. They include the measurement of binaural room impulse responses., and the use of software for acoustic design and auralizations development.