Human Motion Detection and Visual Augmentation of Chopin’s Etudes

Date

2014-11-25

Authors

Kerr, David Philip

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Chopin’s Etudes are difficult musical compositions for advanced piano students. Helmut Brauss, a professional pianist and educator, has created a number of videos to teach students motion patterns that will help them perfect the Etudes. The subtleties of motion shown in the videos are not apparently obvious to students, and in our research, we have developed four markerless based approaches to visually augment the videos: Predictive Optical Flow, Historical Optical Flow, Predictive Hand Tracking and Historical Hand Tracking. A survey of students learning the Etudes was conducted, and it was determined that the participants found the Historical techniques to be the most useful. No difference could be found between the usefulness of the Optical Flow and Hand Tracking augmentations.

Description

Keywords

Computer Vision, Human Motion Detection, Optical Flow, tracking

Citation