1. About the project
We used the Oculus Quest 2 with Unity and FMOD to create an immersive virtual reality music room.
Our vision was to let people experience various instruments in VR – in front of an audience. Bystanders should join the action on mobile phones with a QR code.
Further team members: Qinbai, Xinmiao Yu, Christian Lindberg, Harits Nur Fauzan
2. Sound Design
I was responsible for Sound Design and implementation, also the production of audio content. Due to the license-free aspect, we decided to integrate the audio engine FMOD. Hence, I could easily record, edit, process and document our audio assets, for each member transparent and tidily.
Here is a song I created in Ableton:
We adjusted the cymbals’ pitch according to the player’s velocity of the stick swing (thanks to Christian Lindberg). Hence, a slow impact produces a lower pitch, and a fast impact a higher one.
Also, I implemented Pyro Effects to increase the immersion. Essential: In harmony with the music. I used FMOD EventCallbacks with Destination Markers (see image of the left).
Interactions in VR (such as simple button presses) have challenging requirements compared to non-VR games, like registering the virtual hand’s pressure to manage the interaction.
Thanks to everyone in the team, it was more than fun!
More information on our webpage.