What Happens When You Pair HoloLens With Kinect?

in Gallery • 2 years ago

We have been researching how to extend the capiblities of the Hololens and break down the barriers of mixed reality. Here is our latest project pairing Hololens with the Kinect.

We created a networked Cinder camera server that can stream depth and camera data. Here we are steaming the depth data to the Hololens. The use of Cinder and C++ enables us to heavily optimize the system to meet real-time performance.

http://www.emergingexperiences.com/blog-entries/2016/6/28/hololens-kinect

Replies(2)

JMYK

Re: What Happens When You Pair HoloLens With Kinect?

2 years ago

Looks like a promising technique. Are you planning on releasing any of the code? Hololens block perhaps?

Ed11

Re: What Happens When You Pair HoloLens With Kinect?

2 years ago

There wouldn't be much of a block, and our camera server is proprietary. The core communication between the cinder server and Hololens is UDP. From there, it would be possible to pack the depth data from the Kinect block and steam to the device. It is a bit tricky to get the UDP implemented through the stack, unity>UWP(windows store)>hololens. If you have any specific questions regarding the process Id be happy to discuss.

The last task is to map to the room coordinates. To do this we established a mapping between the Hololens world anchor and a physically marked out anchor.

Top Reply

Response title

Attachments