The CrossSong Puzzle: Developing a Logic Puzzle for Musical Thinking

There is considerable interest in music-based games and apps. However, in existing games, music generally serves as an accompaniment or as a reward for progress. We set out to design a game where paying attention to the music would be essential to making deductions and solving the puzzle. The result is the CrossSong Puzzle, a novel type of music-based logic puzzle that integrates musical and logical reasoning. The game presents a player with a grid of tiles, each representing a mash-up of excerpts from two different songs. The goal is to rearrange the tiles so that each row and column plays a continuous musical excerpt. To create puzzles, we implemented an algorithm to automatically identify a set of song fragments to fill a grid such that each tile contains an acceptable mash-up. We present several optimisations to speed up the search for high-quality grids. We also discuss the iterative design of the game’s interface and present the results of a user evaluation of the final design. Finally, we present some insights learned from the experience which we believe are important to developing music-based puzzle games that are entertaining, feasible and that challenge one’s ability to think about music.

[1]  Ja-Ling Wu,et al.  Automatic Mashup Creation by Considering both Vertical and Horizontal Mashabilities , 2015, ISMIR.

[2]  Stephen Hainsworth Beat Tracking and Musical Metre Analysis , 2006 .

[3]  Thomas D. Crute Effective use of Games and Puzzles in the Chemistry Classroom , 2010 .

[4]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.

[5]  S. Hedges DICE MUSIC IN THE EIGHTEENTH CENTURY , 1978 .

[6]  Mark Louis Gottlieb Secrets of the MIT mystery hunt : an exploration of the theory underlying the construction of a multi-puzzle contest , 1998 .

[7]  Hua Wang,et al.  Music Puzzle: An Audio-Based Computer Game That Inspires to Train Listening Abilities , 2013, Advances in Computer Entertainment.

[8]  G. Farnarier,et al.  Une médecine rurale de proximité: l′expérience des médecins de campagne au Mali , 2007, Education for Health.

[9]  Jonathan Foote,et al.  Automatic audio segmentation using a measure of audio novelty , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[10]  Jyh-Shing Roger Jang,et al.  Audio Musical Dice Game , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[11]  Nicholas J Hudson,et al.  Musical beauty and information compression: Complex to the ear but simple to the mind? , 2011, BMC Research Notes.

[12]  Masataka Goto,et al.  RWC Music Database: Music genre database and musical instrument sound database , 2003, ISMIR.

[13]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[14]  Masataka Goto,et al.  RWC Music Database: Popular, Classical and Jazz Music Databases , 2002, ISMIR.

[15]  Griffiths The educational benefits of videogames , 2002 .

[16]  Meinard Mller,et al.  Fundamentals of Music Processing: Audio, Analysis, Algorithms, Applications , 2015 .

[17]  Frank Sehnke,et al.  On Computer Integrated Rationalized Crossword Puzzle Manufacturing , 2012, FUN.

[18]  Lonce L. Wyse,et al.  The Viability of the Web Browser as a Computer Music Platform , 2013, Computer Music Journal.

[19]  Mike Preuss,et al.  BeatTheBeat music-based procedural content generation in a mobile game , 2012, 2012 IEEE Conference on Computational Intelligence and Games (CIG).

[20]  Gerhard Nierhaus,et al.  Algorithmic Composition: Paradigms of Automated Music Generation , 2008 .

[21]  Michael C. Frank,et al.  Search Lessons Learned from Crossword Puzzles , 1990, AAAI.

[22]  Daniel Müllensiefen,et al.  The Musicality of Non-Musicians: An Index for Assessing Musical Sophistication in the General Population , 2014, PloS one.

[23]  Meinard Müller,et al.  Music Structure Analysis , 2021, Fundamentals of Music Processing.

[24]  S. Gosling,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES The Do Re Mi’s of Everyday Life: The Structure and Personality Correlates of Music Preferences , 2003 .

[25]  Matthew E. P. Davies,et al.  AutoMashUpper: Automatic Creation of Multi-Song Music Mashups , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[26]  Jürgen Schmidhuber,et al.  Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes , 2008, ABiALS.

[27]  Florian Krebs,et al.  Rhythmic Pattern Modeling for Beat and Downbeat Tracking in Musical Audio , 2013, ISMIR.

[28]  Youngmoo E. Kim,et al.  Beat-Sync-Mash-Coder: A web application for real-time creation of beat-synchronous music mashups , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  D. Hoang FLOW: The Psychology of Optimal Experience , 2018 .

[30]  Anssi Klapuri,et al.  Signal Processing Methods for Music Transcription , 2006 .

[31]  Kjetil Falkenberg Hansen,et al.  An overview of sound and music applications for Android available on the market , 2012 .

[32]  Jordan B. L. Smith,et al.  Design and creation of a large-scale database of structural annotations , 2011, ISMIR.

[33]  Eran Egozy Approaches to Musical Expression in Harmonix Video Games , 2016 .