Checking date: 17/05/2019


Course: 2019/2020

Audio technologies for virtual reality
(18459)
Study: Bachelor in Telematics Engineering (215)


Coordinating teacher: AZPICUETA RUIZ, LUIS ANTONIO

Department assigned to the subject: Department of Signal and Communications Theory

Type: Electives
ECTS Credits: 3.0 ECTS

Course:
Semester:




Students are expected to have completed
Physics, Systems and Circuits and Linear Systems
Competences and skills that will be acquired and learning results. Further information on this link
- To understand the differences and peculiarities of virtual reality, augmented reality and mixed reality systems. - To know the sound reproduction devices employed in virtual reality at present. - To know the particularities of the human auditory system on which virtual reality systems are based. - To understand the different parts of a 3D binaural rendering system for virtual reality. - To know the features of the acoustic sources that allow their simulation and representation in a 3D binaural rendering system for virtual reality. - To know acoustic propagation theories that allow modeling this propagation in a binaural 3D rendering system for virtual reality. - To know the characteristics of the receiver (human being), by modeling the HRTF responses, and to understand the differences between the different estimation methods of these responses. - To use acoustic simulation software to perform an auralization, considering the particularities of the source, the acoustic propagation and the receiver. - To know the different formats used in binaural for virtual reality. - To understand the particularities of the different 3D audio reproduction systems, emphasizing their equalization.
Description of contents: programme
1.- Introduction. 1.1 Definition of Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). 1.2 Playback devices. 1.3 Fundamentals of human auditory system. 1.4 Immersive spatial audio. 2.- Binaural 3D audio for virtual reality. 2.1 3D audio reproduction formats. - Channel-based audio. - Object-based audio. - Scene-based audio. Ambisonics. 2.2 Binaural Rendering: - Introduction. Auralization concept. - Sound source modelling: I - Sound power and directivity. - Acoustic propagation modelling. I- Reverberation time and room impulse response. II - Acoustic theories for indoor acoustic propagation: a) Statistical theory. Acoustic absorption. b) Geometric theory. Echogram. c) Undulatory theory. Room modes. III -Acoustic Environment Rendering Techniques . IV - Simulation software. - Receiver modelling: I - HRTF (head-related transfer function). II - Individualized Binaural Rendering. III - Movement tracking. 2.3. 3D Audio reproduction systems: examples of systems and their equalization.
Learning activities and methodology
Three teaching activities are proposed: theoretical classes, guided projects and lab exercises. THEORETICAL CLASSES The theoretical class will be given in the blackboard, with slides or by any other means to illustrate the concepts of the lectures. In these classes the explanation will be completed with realistic examples of virtual audio. In these sessions the student will acquire the basic concepts of the course. The students will have to work on the explained concepts, working out and solving the proposed assignments in order to consolidate the concepts of the course. GUIDED PROJECTS The students, working in small groups, will carry out several simple guided projects addressing different topics. To this end, the students will be given a detailed guide and some specific tutoring. LABORATORY EXERCISES The lab exercises will help the students familiarize themselves with important concepts in virtual audio technologies. They include the measurement of binaural room impulse responses., and the use of software for acoustic design and auralizations development.
Assessment System
  • % end-of-term-examination 30
  • % of continuous assessment (assigments, laboratory, practicals...) 70
Basic Bibliography
  • Higini Arau. ABC de la Acústica Arquitectónica. Grupo CEAC. 1999
  • Kuttruff, H.. Room Acoustics. Elsevier Applied Science. 1991
  • Nicol, Rozenn . Binaural Technology. AES Monograph, Audio Engineering Society. 2010
  • Vorländer, M. Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality. Springer. 2008
  • Zotter, Franz, Frank, Matthias. Ambisonics. A Practical 3D Audio Theory for Recording, Studio Production, Sound Reinforcement, and Virtual Reality. Springer. Topics in Signal Processing.. 2019
Additional Bibliography
  • Manuel Recuero López. Acústica arquitectónica aplicada. Thomson-Paraninfo. 1999
  • Blauert, J. . Spatial Hearing - Revised Edition: The Psychophysics of Human Sound Localization. The MIT Press. 1996
  • Rafaely, Boaz. Fundamentals of Spherical Array Processing. Springer. Topics in Signal Processing.. 2015
  • Zwicker, E. and Fastl, H. . Psychoacoustics - Facts and Models. Springer. 1998

The course syllabus and the academic weekly planning may change due academic events or other reasons.