Extended Mindmap | Studio 2

Related works - / Background : Technicals

https://medium.com/nanonets/how-to-do-image-segmentation-using-deep-learning-c673cc5862ef
https://www.linkedin.com/feed/update/urn:li:activity:6511736597082443776
https://medium.com/tensorflow/introducing-bodypix-real-time-person-segmentation-in-the-browser-with-tensorflow-js-f1948126c2a0
https://medium.com/arjs/webvr-for-augmented-reality-f1e69a505902

--------------------------- 

Related works - Experience
https://www.youtube.com/watch?v=5wrX98Up5hg
https://www.youtube.com/watch?v=LXAJpfR0SaU
https://vimeo.com/220686134
https://www.youtube.com/watch?v=5sl3blrTHdE

 

~ you dont even know what you don't know ..

most of forumns and personal convo's have told me webxr ( webar ) is not ready at all to compete on that stage.

What are the next steps and dimensions to experience music or to music visualizers?

Project aims to reflect upon the same and how to combine ar and human interactivity with (3D)audio to create unique immersive experiences possible promoting more awareness through interaction and audio perception. 

It'll also explore and extend to the limits on what this relatively new and upcoming tech is capable off, ..includes background technicals like the heaviness of the experience// performance issues. As it'll be running shape morphs, hand trackings, audio reactivity and advanced shader computing all in real time, and ofcourse AR background workings which include stereo rendering, positional tracking , and spatial(environment) mapping.(creating 3d model of environment to roto/occlude virtual from real) ...which may also lead to experimentation with different render pipelines and techniques building a log of tips and tricks to achieve the best possible performance and an audio reactive and human interactive mixed reality visual experience.