Multi-Flash Imaging for Object Pose Estimation

Pose estimation of objects is a common task in many computer vision applications. In this project, we use the silhouettes of the objects along with a CAD model for fast and robust pose estimation. The silhouettes/depth edges are reliably obtained using a multi-flash camera without the need of obtaining 3D information.

Technical Discussion:  A multi-flash camera captures few (4 or 8) images using illumination from different directions. The shadow information is used to obtain the depth edges in real time. A 3D CAD model of the object is used to match the 2D silhouettes obtained by the multi-flash camera to estimate the pose of the object.

Future Direction:  1) Investigate segmenting silhouettes corresponding to the top-level object using shadows; and 2) Investigate pose estimation for specular objects.

Contacts:
Amit Agrawal
Ramesh Raskar

Technology Area:  Imaging

Modification Date:  July 5, 2007