Vision for Interaction

We are developing a vision-based technique for interaction with a cell phone augmented with a small projector device.

Background & Objective:  Naturally, cellphones have very small amount of screen space to provide a full interactive experience. On the other hand, a promising direction is to increase the display size by using a small projector. This makes it difficult to interact with such a projected image and new sensing techniques need to be developed. We are conducting an initial proof of concept investigation into using computer vision algorithms to be able to provide an interactive paradigm while using a regular table top surface.

Technical Discussion:  For the purposes of vision-based interaction with a projected image, one needs to establish a correspondence between observed image pixels and coordinates of these pixels in the projector space. We recover this correspondence by using an efficient 3D reconstruction technique using the projected image as a natural reference for 3D geometry of the scene.

Contact:  Yuri Ivanov

Technology Area:  Imaging

Modification Date:  April 2, 2008