3D TV
Three-dimensional TV is expected to be the next revolution in the history of television. It has only recently become feasible to deal with the high processing and bandwidth requirements for real-time acquisition, transmission, and display of high-resolution 3D TV content. In our past work, we have built a complete end-to-end 3D TV system that performs real-time acquisition, transmission, and 3D display of dynamic scenes. More recently, we have been participating in standardization on multiview video coding, and we have also developed an anti-aliasing method for 3D displays.
Background & Objective: Today, digital broadcast networks carry hundreds of channels and will presumably be capable of carrying even more as the most advanced video codecs become deployed. This makes it plausible that a number of them will be dedicated to 3D TV. Similar to HDTV, the introduction of 3D TV can proceed gradually, with one 3D channel at first and more to follow, depending on market demand. Our initial system demonstrated that 3D TV offers a richer, more immersive experience than regular TV. It increases entertainment value and realism without the encumbrance of special glasses. Recent work has centered on improving the quality of the experience further.
Technical Discussion: In our initial 3D TV system, image acquisition consisted of an array of hardware-synchronized cameras that captured multiple views of the scene. To deal with the high processing and bandwidth requirements, the system used a fully distributed architecture with clusters of PCs. A multi-projector 3D display with horizontal parallax was used on the output side. The system was scalable in the number of acquired, transmitted, and displayed realtime video streams. More recently, we have concentrated research efforts on anti-aliasing techniques that aim to improve the rendering of multiview video on 3D displays. View interpolation techniques are utilized to achieve an oversampling of the multiview signal in the view dimension. The oversampled signal is then filtered to suppress high frequency portions of the signal that contribute to aliasing, and finally sub-sampled to match the display characteristics.
Outside Collaborations: Matthias Zwicker (UC San Diego), Fredo Durand (MIT).
Future Direction: Improved 3D display, multi-view video coding, computational improvement of the displayed image.
Contact: Anthony Vetro
Publications:
Zwicker, M.; Vetro, A.; Yea, S.; Matusik, W.; Pfister, H.; Durand, F., "Resampling, Antialiasing, and Compression in Multiview 3-D Displays", IEEE Signal Processing Magazine, ISSN: 1053-5888, Vol. 24, Issue 6, pp. 88-96, November, 2007 (IEEE Xplore, TR2007-084)
Wigdor, D.; Penn, G.; Ryall, K.; Esenther, A.; Shen, C., "Living with a Tabletop: Analysis and Observations of Long Term Office Use of a Multi-Touch Table", IEEE International Workshop on Horizontal Interactive Human-computer Systems, ISBN: 978-0-7695-2013-1, October 2007 (IEEE Explore, TR2007-076)
Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Display Pre-filtering for Multi-view Video Compression", International Conference on Multimedia (ACM Multimedia), ISBN: 978-1-59593-702-5, Session: Systems 4 - Coding Support - pp. 1046-1053, September 2007 (ACM Portal, TR2007-073)
Shipman, S.; Divakaran, A.; Flynn, M., "Highlight Scene Detection and Video Summarization for PVR-Enabled High-Definition Television Systems", IEEE International Conference on Consumer Electronics (ICCE), pp. 1-2, January 2007 (IEEE Xplore, TR2007-060)
Matusik, W.; Pfister, H., "3D TV: A Scalable System for Real-Time Acquistion, Transmission and Autostereoscopic Display of Dynamic Scenes", ACM Transactions on Graphics (TOG) SIGGRAPH, ISSN: 0730-0301, Vol. 23, Issue 3, pp. 814-824, August 2004 (ACM Press, TR2004-067)
| Technical Reports: | |
| Coding Approaches for End-To-End 3D TV Systems | |
Technology Areas:
Multimedia
Advanced Digital Television
Audio Video Processing
Imaging
Modification Date: September 12, 2007
