In response to the theme of tinkering, I made a cube in Blender which shape would react to sound using shape keys.
The shape key was originally applied only on mouth to create different kind of mouth shapes for lip syncing in VRChat. However, by applying this feature to the entire model, I am able to create an object which shape would change according to the voice input.
Similar works has been presented by Gleen Jeon, whose work in
Interactive Sound Visualization explore this theme. The work visualized sound using GEM, a collection of externals which allow the user to create OpenGL graphics within Pd, a program for real-time audio processing.
About This Work
By Jerry Lee
Email Jerry Lee
Published On: 11/03/2021