Free-space gesture mappings for music and sound
| dc.contributor.author | Odowichuk, Gabrielle | |
| dc.contributor.supervisor | Driessen, Peter F. | |
| dc.contributor.supervisor | Tzanetakis, George | |
| dc.date.accessioned | 2012-09-21T22:23:02Z | |
| dc.date.available | 2012-09-21T22:23:02Z | |
| dc.date.copyright | 2012 | en_US |
| dc.date.issued | 2012-09-21 | |
| dc.degree.department | Department of Electrical and Computer Engineering | |
| dc.degree.level | Master of Applied Science M.A.Sc. | en_US |
| dc.description.abstract | This thesis describes a set of software applications for real-time gesturally con- trolled interactions with music and sound. The applications for each system are varied but related, addressing unsolved problems in the field of audio and music technology. The three systems presented in this work capture 3D human motion with spatial sensors and map position data from the sensors onto sonic parameters. Two different spatial sensors are used interchangeably to perform motion capture: the radiodrum and the Xbox Kinect. The first two systems are aimed at creating immersive virtually-augmented environments. The first application uses human ges- ture to move sounds spatially in a 3D surround sound by physically modelling the movement of sound in a space. The second application is a gesturally controlled self- organized music browser in which songs are clustered based on auditory similarity. The third application is specifically aimed at extending musical performance through the development of a digitally augmented vibraphone. Each of these applications is presented with related work, theoretical and technical details for implementation, and discussions of future work. | en_US |
| dc.description.scholarlevel | Graduate | en_US |
| dc.identifier.bibliographicCitation | Odowichuk G. and Tzanetakis G., "Browsing Music and Sound in a Self-organized 3D Space", In the Proceedings of the International Computer Music Conference, Ljubljana, Slovenia, 2012 | en_US |
| dc.identifier.bibliographicCitation | Trail S., Dean M., Tavares T., Odowichuk G., Driessen P., Schloss W.A., Tzanetakis G., "Non-invasive sensing and gesture control for pitched percussion hyper-instruments using the Kinect", In the Proceedings of the International Conference on New Interfaces for Musical Expression, Ann Arbor, USA, 2012 | en_US |
| dc.identifier.bibliographicCitation | Odowichuk G., Driessen P., Ness S., and Tzanetakis G., "Controlling Real Time Sound Spatialization Using the Radiodrum ", In the Proceedings of the International Computer Music Conference, Huddersfield, UK, 2011 | en_US |
| dc.identifier.bibliographicCitation | Odowichuk G., Trail S., Driessen P., Nie W. and Page W., "Sensor Fusion: Towards a Fully Expressive 3D Music Control Interface ", In the Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, Victoria, CA, 2011 | en_US |
| dc.identifier.uri | http://hdl.handle.net/1828/4288 | |
| dc.language | English | eng |
| dc.language.iso | en | en_US |
| dc.rights.temp | Available to the World Wide Web | en_US |
| dc.subject | Music | en_US |
| dc.subject | Gesture | en_US |
| dc.subject | Mappings | en_US |
| dc.subject | 3D | en_US |
| dc.subject | Spatialization | en_US |
| dc.subject | Self-organized Maps | en_US |
| dc.subject | Hyper-instruments | en_US |
| dc.subject | Spatial Sensors | en_US |
| dc.title | Free-space gesture mappings for music and sound | en_US |
| dc.type | Thesis | en_US |