Movie Maker 3d

Example user-generated output using the realtime 3D model and VFX tools that my team built into the Windows 10 Movie Maker application:

 
 

It all started After Microsoft shut down its Windows Phone program...

... and I was looking for new opportunities within our team (photos, camera, and video editing). I'm lucky to work on a team where ideas are driven from the bottom-up, so I started a small prototyping effort with two other developers. We were able to create a pitch to our leadership team where we made a case for the new video editor that our team was building to replace Movie Maker should leverage computer vision algorithms and realtime graphics to deliver Hollywood-style effects for our users using the power of Unity 3D’s rendering. 

The pitch went well, and our team grew to about 5 developers. Between January 2017 and May 2017, we were able to build the following demo for the Microsoft Build conference:

I was responsible for the following features in the demo:

  • Animation system (incl. scrubbing, state machines, and events)

  • Lighting and shadow

  • Artist tools to import models, capture screenshots, and format for our app

  • Co-created the lighting spell's particle system

  • Wrote all uGUI controls for translation, rotation, and scaling of the assets

I also trained several members of our team to conduct the floor demos at Build, and I went on to attend the Augmented World Expo to present our team's work.

I'm currently working on developing new features for our video editing experience, including run-time loading of static and animated 3D models from Microsoft's Remix 3D online content repository:

Animation showing the flow for adding a model from the web

Animation showing the flow for adding a model from the web

Microsoft is pushing for adoption of a new 3D file format called glTF, and as part of this feature, I've had the opportunity to contribute to the Khronos Group's open-source Unity loader for glTF files. I added PBR specular-gloss material support and skinned animation playback to the loader.