Mitsubishi Electric Research Laboratories

Computer Vision for Interactive Computer Graphics

Citation:   Freeman, W.T.; Anderson, D.B.; Beardsley, P.A.; Dodge, C.N.; Roth, M.; Weissman, C.D.; Yerazunis, W.S.; Kage, H.; Kyuma, K.; Miyake, Y.; Tanaka, K., “Computer Vision for Interactive Computer Graphics”, IEEE Computer Graphics and Applications, Vol. 18, Issue 3, pp. 42-53, May-June 1998 (IEEE Computer Graphics and Applications)

MERL Report:  TR99-02: M. Roth, K. Tanaka, C. Weissman, W. Yerazunis
MERL Contact:   William Yerazunis
Research Area:  Imaging, Computer Vision

Computers looking through a camera at people is a potentially powerful technique to facilitate human-computer interaction. The computer can interpret the user's movements, gestures, and glances. Fundamental visual algorithms include tracking, shape recognition, and motion analysis. We describe several vision algorithms for interactive graphics, and present various vision controlled graphics applications which we have built which use them: vision-based computer games, a hand signal recognition system, and a television set controlled by hand gestures. Some of these applications can employ a special artificial retina chip for image detection or pre-processing.

 Read the full technical report (PDF: 8.9 MB)