Television Set Controlled By Hand Gestures
We made a prototype of a television set that the viewer could control by hand gestures, instead of a remote control. Our prototype was a two-screen system, using a computer workstation and a television. We were able to evaluate the feel of controlling a television set by hand signals. Controlling a television set remotely through hand gestures seemed to be exciting for the people who tried the prototype. However, "channel-surfing" would tire the arm; a more relaxed hand signal needs to be developed for extended viewing.
Background & Objective: Infra-red-based television remoted controls are a popular and successful television interface, which viewers value. We sought to explore other interface methods which might be complementary with the television remote control. The work addressed two fundamental issues of gesture--based human--computer interaction: (1) How can one communicate a rich set of commands without extensive user training and memorization of gestures? (2) How can the computer recognize the commands in a complicated visual environment?
Technical Discussion: Our solution to both the command vocabulary and the command recognition issues relies on the visual feedback provided by the television display. The user only needs to memorize a single hand signal (the open hand), which forms a distinct patten for the computer to recognize. There is a tradeoff between the system response time and field--of--view. To obtain reasonable response, we limited the field of view to 25 degrees during search for the trigger gesture, and 15 degrees during tracking of the hand.
Contacts:
Joseph Katz
Publications:
Matusik, W.; Forlines, C.; Pfister, H., "Multiview User Interfaces with an Automultiscopic Display", Advanced Visual Interfaces, Poster Session, ISBN 0-978-60558-141-5, pp. 363-366, May 2008 (ACM Press, TR2008-018)
Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Multi-view Video Compression for 3D Displays", Asilomar Conference on Signals, Systems and Computers (ACSSC), ISSN: 1058-6393, pp. 1506-1510, November 2007 (IEEE Xplore, TR2007-080)
Zwicker, M.; Vetro, A.; Yea, S.; Matusik, W.; Pfister, H.; Durand, F., "Resampling, Antialiasing, and Compression in Multiview 3-D Displays", IEEE Signal Processing Magazine, ISSN: 1053-5888, Vol. 24, Issue 6, pp. 88-96, November, 2007 (IEEE Xplore, TR2007-084)
Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Display Pre-filtering for Multi-view Video Compression", International Conference on Multimedia (ACM Multimedia), ISBN: 978-1-59593-702-5, Session: Systems 4 - Coding Support - pp. 1046-1053, September 2007 (ACM Press, TR2007-073)
Vetro, A.; Yea, S.; Zwicker, M.; Matusik, W.; Pfister, H., "Overview of Multiview Video Coding and Anti-Aliasing for 3D Displays", IEEE International Conference on Image Processing (ICIP), ISSN: 1522-4880, Vol. 1, pp. 1-17 - I-20, September 2007 (IEEE Xplore, TR2007-027)
Matusik, W.; Pfister, H., "3D TV: A Scalable System for Real-Time Acquistion, Transmission and Autostereoscopic Display of Dynamic Scenes", ACM Transactions on Graphics (TOG) SIGGRAPH, ISSN: 0730-0301, Vol. 23, Issue 3, pp. 814-824, August 2004 (ACM Press, TR2004-067)
| Technical Reports: | |
| Television Control by Hand Gestures | |
Technology Areas:
Computer Vision
Advanced Digital Television
Modification Date: January 23, 2007