June 25, 2017

How It’s Made: Holographic Videos Viewable by HoloLens

hl

 

I posted a while ago that Microsoft had created Holo-Video studio to capture holographic video to be played on Hololens. Now Microsoft posted a video (embedded below) to show how that works.

 

 

Here is what happens.

In order to mask the surroundings, performance are done on a green stage with green walls. It takes 106 synced RGB and IR cameras to capture the live information.

It first generates 2.7 million per frame point clouds with both RGB and IR info. Then It generates 1 million triangles (finite elements) per frame topology data. After they apply certain logic to determine which area are more important, so increase density of the mesh, which areas are not important to decrease mesh density. The result is 20K per frame triangles. Finally, they wrap it with texture. And then put all information together, compress it, encode it to form a single file, playing at 12Mbits/sec.

The last number is important one. 12 Mega bits/sec is not small. It means a 5 minutes video takes up 360MB storage. It’s big, but not huge. Streaming at 12Mbit/sec is piece of cake on WiFi. Streaming over Internet can be an issue though.

 

 

 

  • Andrew Hoeveler

    That’s 12 MegaBITS per second, not 12 Megabytes. 10 times smaller than your calculation.

    • Sean Leith

      You are right. Thanks.