Illumiroom how does it work

It augments the area surrounding a television screen with projected visualizations to enhance the traditional living room entertainment experience.

IllumiRoom uses a Kinect for Windows camera and a projector to blur the lines between on-screen content and the environment we live in allowing us to combine our virtual and physical worlds. For example, our system can change the appearance of the room, induce apparent motion, extend the field of view, and enable entirely new game experiences. Cookie banner We use cookies and other tracking technologies to improve your browsing experience on our site, show personalized content and targeted ads, analyze site traffic, and understand where our audiences come from.

By choosing I Accept , you consent to our use of cookies and other tracking technologies. Cybersecurity Mobile Policy Privacy Scooters. Phones Laptops Headphones Cameras. Tablets Smartwatches Speakers Drones. Accessories Buying Guides How-tos Deals. Health Energy Environment. YouTube Instagram Adobe. Kickstarter Tumblr Art Club. Film TV Games. Fortnite Game of Thrones Books.

Comics Music. Filed under: Microsoft Gaming Apps. It can also modify how the room looks, adding an effect like desaturation and cel shading to real-world objects, or simulating the lighting from the game — adding virtual shadows and illumination.

No doubt many gamers would love to get their hands and eyes on the system, but it does have downsides. The projector-Kinect setup is expensive, for one thing: A wide-throw HD projector bright enough to work in moderate light could cost thousands of dollars, and even then sunlight makes it all but useless. It may also be difficult to integrate with existing games, and the extra computing power necessary could cause a framerate hit. It's still a fascinating demonstration, though it's unlikely to figure in Microsoft's new console, due to be unveiled May The Kinect sensor captures the color and geometry of the scene, and the system renders the illusions using the acquired depth map.

Careful calibration of the system is required in order for the illusions to tightly match the onscreen content and the physical environment. The calibration of the IllumiRoom system is fully automatic, determining the relative pose of the projector to the depth sensor and the position of the television in the projector image.

Therefore, setup only requires that the projector and depth camera are placed such that they cover the area surrounding the TV. Using the default parameters for the Kinect, we transform these correspondences into 3D points. We then solve for the intrinsic and extrinsic parameters of the projector.

As there is no depth data for specular surfaces such as that of shiny, black televisions, we recover the position of the TV using a 2D homography, with virtual markers displayed in each corner of the screen.

It is important to note that the calibration need only happen once. Thus the Kinect camera could be used to calibrate the projector and then returned to the TV stand for gaming. If you want to learn more, have a read on projection mapping.

Nothing compelling though, from their video it looks like using the projector with a big screen and without the Kinect would even be more immersive.