Sound-Controlled Wolfenstein 3D

This is an experiment where we are playing games only using sounds. We've trained a few samples for each class (Up, Right, Left, Down, Shoot) in Wekinator.

Before this we did an earlier prototype with only one class. Here controlling Running T-Rex game in Chrome by whistling.


We used Processing to record the microphone input, then send that with OSC to Wekinator. Here we captured the various samples for each class.

After capturing all samples for all five classes, the prediction for every new microphone input was received in a node robot.js application which simulated they keystrokes and controlling the game.


Made together with Andreas Refsgaard