Free-space gesture mappings for music and sound

dc.contributor.authorOdowichuk, Gabrielle
dc.contributor.supervisorDriessen, Peter F.
dc.contributor.supervisorTzanetakis, George
dc.date.accessioned2012-09-21T22:23:02Z
dc.date.available2012-09-21T22:23:02Z
dc.date.copyright2012en_US
dc.date.issued2012-09-21
dc.degree.departmentDepartment of Electrical and Computer Engineering
dc.degree.levelMaster of Applied Science M.A.Sc.en_US
dc.description.abstractThis thesis describes a set of software applications for real-time gesturally con- trolled interactions with music and sound. The applications for each system are varied but related, addressing unsolved problems in the field of audio and music technology. The three systems presented in this work capture 3D human motion with spatial sensors and map position data from the sensors onto sonic parameters. Two different spatial sensors are used interchangeably to perform motion capture: the radiodrum and the Xbox Kinect. The first two systems are aimed at creating immersive virtually-augmented environments. The first application uses human ges- ture to move sounds spatially in a 3D surround sound by physically modelling the movement of sound in a space. The second application is a gesturally controlled self- organized music browser in which songs are clustered based on auditory similarity. The third application is specifically aimed at extending musical performance through the development of a digitally augmented vibraphone. Each of these applications is presented with related work, theoretical and technical details for implementation, and discussions of future work.en_US
dc.description.scholarlevelGraduateen_US
dc.identifier.bibliographicCitationOdowichuk G. and Tzanetakis G., "Browsing Music and Sound in a Self-organized 3D Space", In the Proceedings of the International Computer Music Conference, Ljubljana, Slovenia, 2012en_US
dc.identifier.bibliographicCitationTrail S., Dean M., Tavares T., Odowichuk G., Driessen P., Schloss W.A., Tzanetakis G., "Non-invasive sensing and gesture control for pitched percussion hyper-instruments using the Kinect", In the Proceedings of the International Conference on New Interfaces for Musical Expression, Ann Arbor, USA, 2012en_US
dc.identifier.bibliographicCitationOdowichuk G., Driessen P., Ness S., and Tzanetakis G., "Controlling Real Time Sound Spatialization Using the Radiodrum ", In the Proceedings of the International Computer Music Conference, Huddersfield, UK, 2011en_US
dc.identifier.bibliographicCitationOdowichuk G., Trail S., Driessen P., Nie W. and Page W., "Sensor Fusion: Towards a Fully Expressive 3D Music Control Interface ", In the Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing, Victoria, CA, 2011en_US
dc.identifier.urihttp://hdl.handle.net/1828/4288
dc.languageEnglisheng
dc.language.isoenen_US
dc.rights.tempAvailable to the World Wide Weben_US
dc.subjectMusicen_US
dc.subjectGestureen_US
dc.subjectMappingsen_US
dc.subject3Den_US
dc.subjectSpatializationen_US
dc.subjectSelf-organized Mapsen_US
dc.subjectHyper-instrumentsen_US
dc.subjectSpatial Sensorsen_US
dc.titleFree-space gesture mappings for music and sounden_US
dc.typeThesisen_US

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Odowichuk_Gabrielle_MASc_2012.pdf
Size:
5.62 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.74 KB
Format:
Item-specific license agreed upon to submission
Description: