This is an experiment where we are playing games only using sounds. We've trained a few samples for each class (Up, Right, Left, Down, Shoot) in Wekinator.

Before this we did an earlier prototype with only one class. Here controlling Running T-Rex game in Chrome by whistling.

Technology

We used Processing to record the microphone input, then send that with OSC to Wekinator. Here we captured the various samples for each class.

After capturing all samples for all five classes, the prediction for every new microphone input was received in a node robot.js application which simulated they keystrokes and controlling the game.

Credits

Made together with Andreas Refsgaard