Aim:
Using the actor's movement and edit her as a shadow play in 3D space on the cloth. Mimicing Shadow puppetry
Method:
Blender, Premiere Pro, Video shooting at 240fps, After Effects Rotoscoping brush
Result:
After many consultations with Nich, he gave me an idea: using the character's body and movement, edit her out, and place her on the cloth simulation itself. At first it was very confusing for me considering that I'm not sure how to edit her out frame by frame since I didn't shoot the footage on green screen. I realised After Effects has a tool called Roto Brush. It allows you to automatically detect movement and it rotoscopes for you. The result of the rotoscope was very sharp and not detailed. I decided to use the rotoscoped figure, color grade the figure into pitch black, and blur the figure out.
In the end, it looks like as if it's a shadow of someone's movement playing out on the cloth made in the 3D space.