SuperVision: Spatial Control of Connected Objects in a Smart Home

Motivation

There is an increase in the number of remote-controllers that come with almost every domestic appliance. But today poeple are much more interested in richer and more intuitive interactions with objects using touch, voice or even gestures. Considering the end-user perspective for smart home related research, easy interaction with far away objects becomes extremely important. So it is very interesting to study "point and control" interaction in a smart home.

Brainstorming questions

-What is the acceptable range of pointing device- From how far do you want to control the objects in your environment?

-What is the required accuracy of a pointing gesture?

-Is it always better to point directly at object, or point at something which represents the object?

-Do you choose the object first and then choose the functionality, or choose the functionality first and then point at the object?

Problems of Pointing





Design Space Identification

SuperVision- The two important metaphors

The spotlight metaphor

The projector’s illumination acts like a spotlight which displays only certain parts of the virtual space, depending on where the projector is pointing. This metaphor is also known as the “peepHole interaction”.

The X-ray vision metaphor

We made an effort to realize superhuman powers in terms of “drilling” through a wall to visualize the scene behind it.

Supervision

A novel interaction technique for controlling connected objects in a smart home. Objects can be within the field of view of the user or outside it

iPad mock




How it works

A high end ART tracking system is utilized to continuously gather the orientation adn direction of the handheld controller. The controller has a projector inside it, which continually modifies the projected interface depending on the pointed direction. There are a few buttons on the controller which are used to interact with the projected interfaces A slider on the controller is used to virtually go through the wall and look behind it. Objects behind the wall can be seen now and controlled in the same way.

Links

Bachelor Thesis report : PDF

Final Presentation : PPT

Article in CHI 2015 (WIP) : PDF

Poster in CHI 2015 (WIP) : PDF

Other Projects

Portfolio

Portfolio

additional projects