Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction

Meier P, Schwär S, Krump G, Müller M (2023)

Publication Language: English

Publication Type: Conference contribution

Publication year: 2023

Publisher: Gesellschaft für Informatik e.V.

Edited Volumes: INFORMATIK 2023 — Designing Futures: Zukünfte gestalten

Series: Lecture Notes in Informatics (LNI) - Proceedings, Volume P-337

City/Town: Bonn

Pages Range: 873-882

Conference Proceedings Title: INFORMATIK 2023 - Designing Futures: Zukünfte gestalten

DOI: 10.18420/inf2023_97

Abstract

Music-based games are an important genre in the gaming community and have become increasingly popular with games like SingStar and Guitar Hero. These types of games are usually based on reactive game mechanics, where the player must hit a certain note at a certain time in order to score points. In this contribution, we present a game prototype that goes beyond purely music-reactive game mechanics and focuses more on the creative aspect of making music in games. In particular, we developed a jump-and-run game that can be controlled with a gaming controller but also uses the player’s singing voice to interact with the game world. To this end, we estimate the pitch of a microphone signal in real time and use it as a creative input to the game. This input can be used to control parts of the game world, for instance by singing and adding stair-like elements that allow the player to overcome obstacles and reach the end of a game level. With our game prototype, we demonstrate how game designers can incorporate musical challenges into a well-known game environment while motivating musicians to creatively explore and practice their musical skills. Furthermore, motivated by our game prototype, we evaluate different real-time pitch estimation algorithms using common MIR metrics on a publicly available dataset to analyse what works best for our gaming scenario.

Authors with CRIS profile

Peter Meier International Audio Laboratories Erlangen (AudioLabs) Simon Schwär International Audio Laboratories Erlangen (AudioLabs) Meinard Müller Lehrstuhl für Semantische Audiosignalverarbeitung (AudioLabs)

Involved external institutions

Deggendorf Institute of Technology DE Germany (DE)

How to cite

APA:

Meier, P., Schwär, S., Krump, G., & Müller, M. (2023). Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction. In INFORMATIK 2023 - Designing Futures: Zukünfte gestalten (pp. 873-882). Bonn: Gesellschaft für Informatik e.V..

MLA:

Meier, Peter, et al. "Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction." Proceedings of the INFORMATIK 2023 - Designing Futures: Zukünfte gestalten Bonn: Gesellschaft für Informatik e.V., 2023. 873-882.

BibTeX: Download