The author explores the concept of using a flute as a controller for a mouse cursor in a first person shooter game. They developed a microcontroller-based solution called Pitch perfect pointer positioning (PiPePoPo) that allows a musician to control mouse movements based on pitch detection when playing a flute. The hardware solution involves using an RP2040 chip, which has a built-in microphone for audio applications. The author also created a browser extension for Chrome, so anyone can experience flute-based web-browsing without needing additional hardware. The code is available on GitHub, including an ANSI C implementation of the YIN pitch estimator. The project showcases the potential of unique interfaces in technology.
https://0110.be/posts/Making_a_flute_controlled_mouse