Space3D: A General model for three dimensional spatial processing of sounds

Space3D: A General model for three dimensional spatial processing of sounds

Description

Space3D is a real-time spatialization and acoustic modeling algorithm designed to deliver perceptually realistic spatial impressions for live concert presentations and extended reality (XR) applications. The algorithm can produce simultaneous synchronized impressions on multi-channel speaker arrays and in binaural format on headphones, providing wavefield like effects over speaker arrays and highly realistic externalization effects over headphones.

Space3D uses the precedence effect and controls delays and amplitude of sounds over speakers to provide a large sweet space for listeners in concert settings. Space3D integrates geometrical acoustics (ray-tracing-based acoustic simulation) with a realistic volumetric diffraction and reflection model to account for object occlusion and frequency-dependent surface interactions. The CUDA/RTX implementation of this model on NVIDIA, takes advantage of the highly accelerated ray tracing capabilities of the NVIDIA's RTX infrastructure, and it is able to produce high-order (up to 6th-order) frequency-dependent reflections for complex virtual models (composed of millions of triangles) in real-time.

In this talk we shall discuss various algorithms of Space3D and provide real-time examples of its application in musical and spatial audio contexts.

Registration

This event is free and open to the public. Please fill out this MS form to register for the workshop.

Speaker

Shahrokh Yadegari, composer and computer musician, has collaborated with such artists as Peter Sellars, Robert Woodruff, Ann Hamilton, Christine Brewer, Gabor Tompa, Maya Beiser, Steven Schick, Keyavash Nourai, Siamak Shajarian, and Hossein Omoumi. He has performed and his productions, compositions, and designs have been presented internationally in such venues as the Carnegie Hall, Royce Hall, Festival of Arts and Ideas, OFF-DAvignon Festival, International Theatre Festival in Cluj, Romania, Ravinia Festival, Ruhr-Triennale, Vienna Festival, Holland Festival, Tirgan Festival, Forum Barcelona, Japan America Theatre, The Pulitzer Foundation for the Arts, and the Institut für Neue Musik und Musikerziehung (Darmstadt).

Yadegari holds a BS in Electrical Engineering from Purdue University, a Master's in Media Arts and Sciences from MIT's Media Lab, and a Ph.D. in music from University of California, San Diego. He has worked at Institut de Recherche et Coordination Acoustique/Musique (IRCAM), and he is one of the founders and the artistic director of Kereshmeh Records and Persian Arts Society, organizations dedicated to the preservation and dissemination of Persian traditional and new music. Yadegari is currently on the faculty and chair of the department of Music at University of California, San Diego, and the associate director at the Qualcomm Institute where he directs the Sonic Arts Research and Development group.