1. Rationale: Intention
I intend to explore and study the interaction between sound and 3D animation. I want to explore the different ways sound and visuals can come together and interact to create captivating and emotive multimedia experiences. I want to experiment with the different ways I can create interaction, i.e through screen based user input, like a game/interactive code, as well as augmented/virtual reality interaction. This will also rely on creating my own music and soundscapes as part of my project.
2. Context: Field
The field my work will sit in are video games, 2D/3D Animation, and sound design/music. One key aspect of the combination of these fields that will play a big part in my project is specifically the idea of video game music, and video game/digital spaces that are reactive to said music. One outstanding practitioner in the field of video game music is the composer Hideki Naganuma, and his composition for the video game Jet Set Radio Future. Another outstanding practitioner in this field is Hivemind, a group that makes music videos and incorporates many 3D reactive elements into their videos.
3. Method:
The work will involve a lot of experimenting and trials in a lot of different mediums. Firstly I will be trying to determine just what it is that I want to create as a visual representation, in a more general idea sense, and then I will determine the medium for that visual representation, either game or animation. Finally I will work on playing with sound and creating compositions that match my visual experimentation.
4: Production: Tools and Timeline
The tools required will be a blend of different computer software, for now i’ve assumed mainly blender and Unity, however I want to learn more about other software. The process will involve sketching prototype designs as well as generating a lot of prototype designs, picking some and refining them, and then adding animated elements to them. Week 1 will focus on sketching, and prototyping the actual visual representations. Week 2 will be focused on modeling and creating different things from the prototypes, including experimenting with coding and video game based work, as well as making some sound work. Week 3 will involve picking and refining the modeled prototypes. Week 4 will focus on taking the refined models, and animating them in blender, or creating interactive coded elements in them. Week 5 will be specifically more focused on the audio aspect of whatever essentially finalised designs i’ve come up with. Week 6 will focus on creating the individual animations and games I have made and turning them into a whole singular project that flows from start to finish.
5. Outcome
The outcome will be a collection of individual animations or interactive "games" that interact with the music and sound design I have made through the semester.