Computer Vision Based Virtual Musical Instruments

Abstract

Most prospective musicians will ultimately need to make an investment in a musical instrument kit in order to pursue their art. This study intends to speed up musicians' exposure to the playing of musical instruments without the associated expenditures and to enable musicians to practise, at least sporadically, without a full musical instrument kit. Consequently, a larger audience may now enjoy the pleasure of playing musical instruments. The option we investigate is the creation of a virtual musical instrument set prototype that would just need users to have a laptop with a camera and readily available markers to simulate the tips of drum sticks or any blue/red color object for playing drum kit and knee motion, such as colorful papers for playing other musical instruments. This was done using OpenCV, a Python-based program that uses the concept of color-based blob recognition to find the markers.