Description and Registration
Registration is now full. Please contact emeneses [AT] sat.qc.ca if you have any questions.
Software/hardware information
We will explore production pipelines to illustrate the use of the chosen software in tandem with existing tools that have been seeing broader adoption in recent years. For clarity, we present the proposed toolset in two groups: software developed by Metalab and other software.
Metalab software:
- LivePose: A computer-vision tool for real-time skeleton tracking from an RGB or grayscale video feed (live or not). LivePose applies various filters (for detection, selection, improving the data, etc.) and sends the results through the network (OSC and Websocket are currently supported).
- Splash: A modular mapping software that uses 3D models with UV mapping of the projection surface to calibrate multiple video projectors (intrinsic and extrinsic parameters, blending, and color), and feed them with the input video sources.
- SATIE: An audio spatialization engine developed for real-time rendering of dense audio scenes to large multi-channel loudspeaker systems. SATIE is capable of outputting multiple sound formats and speaker setups simultaneously. There is no geometry per se in SATIE. Rather, SATIE maintains a DSP graph of source nodes accumulated to a single “listener,” corresponding to the renderer’s output configuration (stereo and/or multi-channel).
- Shmdata: A library to share flows of data frames between processes via shared memory.
Other software and transmission protocols:
- libmapper/webmapper: A software library for declaring data signals on a shared network and enabling arbitrary connections between them. libmapper was initially developed at IDMIL/CIRMMT and is currently maintained between McGill, Dalhousie University, and collaborators, including Metalab.
- OSC: A data transport specification for network messaging between applications and hardware.
Most of the above software can run in most Linux-based systems, including low-cost, low-energy hardware such as Raspberry Pi and NVIDIA Jetson single-board computers. Participants can install the Metalab tools in their systems or use embedded systems (provided by Metalab) containing those tools.
Schedule
– 08h45 - Welcoming
– 09h15 - Presentation of Metalab tools: integration, interoperability, API, documentation, etc. – 09h30 - Introduction of the workshop and introduction of each participant
– 10h30 - Coffee break
– 11h00 - Work period 1: setting and connecting tools
– 12h00 - Lunch
– 13h00 - Work period 2: directed collective creation of an immersive space – 15h00 - Coffee break
– 15h30 - Immersive space finalization and deployment
– 16h00 - Closing remarks
Presenters
Edu Meneses is a music technologist, digital luthier, composer, and performer in the best interdisciplinary fashion. A Ph.D. in music technology at McGill University (IDMIL and CIRMMT), Edu is currently a researcher-developer at SAT. He works with embedded systems for artistic tools and sound spatialization.
Michał Seta is a composer, improviser, and digital arts researcher. Practitioner of transdisciplinary, transcalar, and integrative magic, he incants Metalab software in collective and improvised harmony. He is one of the main contributors to the SATIE software.
About Metalab
Founded in 2002, Metalab is the research laboratory of the Society for Arts and Technology [SAT]. Metalab’s missions are to stimulate the emergence of innovative immersive experiences and to make their design accessible to artists and art creators. Metalab accomplishes these missions through an ecosystem of free software that addresses problems not easily solved by existing tools. The software and hardware developed at Metalab are often used with other technologies to facilitate mixing video mapping, 3D audio, telepresence, and interaction.