Funded by Dean's Award for Summer Research

Project Description

The first part of this project is a procedurally generated platformer game built in Unity. The user can play randomized levels where they can choose to collect energy cells using puzzles or using combat. These choices, as well as other user data like time taken, and amount of map explored, are then fed into a creative neural network built in Pure Data. This neural network then generates a live soundtrack for the game that is individualized to each player, and that evolves as more user data is sent in. Unity and Pure Data are collected through Kalimba, which allows Pure Data to access stored user data taken from Unity.

Source CodeBlog PostsResearch Paper

IAWM Presentation

This project was selected as a presentation at the IAWM (International Alliance of Women in Music) conference in 2022. It was also presented at the NYU Gallatin Keynote Research Conference. See this presentation below:

Technologies Used

  • Unity
  • Pure Data
  • Kalimba
  • A* Pathfinding Algorithm