APD Week 7 Play and Sound

Theme

Play and Sound

Context

This approach was inspired by the game Don't Stop! Eighth Note(https://www.youtube.com/watch?v=d9Y55e2zzKs) in which the player needs to make a sound to control the character. Also inspired by the Phoenix Wright: Ace Attorney on NDS which require the player to blowing the microphone on NDS to blow the powder when fingerprinting in the game.

Method

Brainstorming about sound and connected the soundwave and sea wave.

Making a simulated water wave in Unity by utilizing the Line renderer and Mesh.

Making a surfing stick man as the sequence of the input.

When a user speaking to the microphone, the sound will be detected and add a force based on the volume to the water body.

Response

This work is an approach to make the sound as an input method. Before I made brainstorm about the content of sound as a part of feedback in the virtual world but forget that making sound can also be an intuitive way to interact with the virtual world. Not only the volume but also the frequency and tune can be manipulated by us. Based on Steve Swink's model of measuring input, the input space of sound is continuous and complex, which similar to analog or mouse. However, it's very hard to control the sound precisely like the mouse or analog. The advantage of making the sound as input is more intuitive and engaging.