NSERC/CIRMMT Engage Grant Demos

ABSTRACT

NSERC Engage grants encourage new collaborations between university and industrial partners in the form of funding for short-term research projects. In this demonstration, graduate students from the Input Devices and Music Interaction Lab at McGill present the results of two six-month development initiatives.


Project Title: “Audio Environment for the Emotional Imaging Composer”

Ian Hattwick, Ph.D candidate

R. Michael Winters, MA candidate

The Emotional-Imaging Composer is a multimedia instrument that translates biosignals into emotionally responsive environments in real time.  At the core of the EIC is a wireless finger sensor that maps a person's physiological signals into a realtime emotional profile.  This project involved the creation of two audio environments for the Emotional-Imaging Composer. The first audio environment enables the use of the EIC as an expressive tool for real-time music performance and and the second as a tool for data analysis and emotional monitoring.

 

Project Title: “Haptic feedback for 3D painting”

Marcello Giordano, Ph.D candidate

Steven Sinclair, Ph.D

Janro Imaging Lab's Sandde software allows painting and animation in a 3D space, similar in style to traditional cel animation. In this project, haptic feedback was added to Sandde to help give users a sense of presence while manipulating the 3D paint brush, and communicate information about brush styles and movement. Two approaches were investigated: vibrotactile feedback was added by modifying existing controllers, and force feedback was added by implementing mappings to the Phantom Omni and Freedom 6S haptic devices. This project also made extensive use of libmapper, a media mapping protocol developed in McGill's Input Devices and Music Interaction Lab.