Meier P, Schwär S, Krump G, Müller M (2023)
Publication Language: English
Publication Type: Conference contribution
Publication year: 2023
Publisher: Gesellschaft für Informatik e.V.
Edited Volumes: INFORMATIK 2023 — Designing Futures: Zukünfte gestalten
Series: Lecture Notes in Informatics (LNI) - Proceedings, Volume P-337
City/Town: Bonn
Pages Range: 873-882
Conference Proceedings Title: INFORMATIK 2023 - Designing Futures: Zukünfte gestalten
DOI: 10.18420/inf2023_97
Music-based games are an important genre in the gaming community and have become increasingly popular with games like SingStar and Guitar Hero. These types of games are usually based on reactive game mechanics, where the player must hit a certain note at a certain time in order to score points. In this contribution, we present a game prototype that goes beyond purely music-reactive game mechanics and focuses more on the creative aspect of making music in games. In particular, we developed a jump-and-run game that can be controlled with a gaming controller but also uses the player’s singing voice to interact with the game world. To this end, we estimate the pitch of a microphone signal in real time and use it as a creative input to the game. This input can be used to control parts of the game world, for instance by singing and adding stair-like elements that allow the player to overcome obstacles and reach the end of a game level. With our game prototype, we demonstrate how game designers can incorporate musical challenges into a well-known game environment while motivating musicians to creatively explore and practice their musical skills. Furthermore, motivated by our game prototype, we evaluate different real-time pitch estimation algorithms using common MIR metrics on a publicly available dataset to analyse what works best for our gaming scenario.
APA:
Meier, P., Schwär, S., Krump, G., & Müller, M. (2023). Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction. In INFORMATIK 2023 - Designing Futures: Zukünfte gestalten (pp. 873-882). Bonn: Gesellschaft für Informatik e.V..
MLA:
Meier, Peter, et al. "Evaluating Real-Time Pitch Estimation Algorithms for Creative Music Game Interaction." Proceedings of the INFORMATIK 2023 - Designing Futures: Zukünfte gestalten Bonn: Gesellschaft für Informatik e.V., 2023. 873-882.
BibTeX: Download