Tracking the Future: An Augmented Reality Approach to Visualizing and Measuring Biomechanics In Near Real Time
Date
2023-09-19
Authors
Michaud, Kai
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Body tracking is used in biomedical research to gather information during movement of the body. Most body trackers in use are expensive and lack portability. This project aims to use an augmented reality headset called the Hololens in conjunction with a laptop as a replacement. The Hololens takes pictures and sends them to the computer, which processes them into an array of points representing limbs. These points are combined with depth data from the depth camera on the headset, creating a 3D construction of the body which the Hololens can visualise for the user. The angles between different limbs can then be calculated, providing the user with the joint angles for the entire lower body. Targets can be tracked in 2D at a rate of ~10-12 frames per second, and in 3D at around 1-2 frames per second. A computer vision approach to body tracking can have lots of problems and further research and testing is required before this project can be compared to conventional tracking methods. If a similar accuracy is possible, this approach would substantially reduce tracking equipment cost and increase portability.
Description
Keywords
Biomedical, Augmented Reality, Body Tracking