3D TV
Three-dimensional TV is expected to be the next revolution in the history of television. It has only recently become feasible to deal with the high processing and bandwidth requirements for real-time acquisition, transmission, and display of high-resolution 3D TV content. In our past work, we have built a complete end-to-end 3D TV system that performs real-time acquisition, transmission, and 3D display of dynamic scenes. More recently, we have been participating in standardization on multiview video coding, and we have also developed an anti-aliasing method for 3D displays.
Background & Objective: Today, digital broadcast networks carry hundreds of channels and will presumably be capable of carrying even more as the most advanced video codecs become deployed. This makes it plausible that a number of them will be dedicated to 3D TV. Similar to HDTV, the introduction of 3D TV can proceed gradually, with one 3D channel at first and more to follow, depending on market demand. Our initial system demonstrated that 3D TV offers a richer, more immersive experience than regular TV. It increases entertainment value and realism without the encumbrance of special glasses. Recent work has centered on improving the quality of the experience further.
Technical Discussion: In our initial 3D TV system, image acquisition consisted of an array of hardware-synchronized cameras that captured multiple views of the scene. To deal with the high processing and bandwidth requirements, the system used a fully distributed architecture with clusters of PCs. A multi-projector 3D display with horizontal parallax was used on the output side. The system was scalable in the number of acquired, transmitted, and displayed realtime video streams. More recently, we have concentrated research efforts on anti-aliasing techniques that aim to improve the rendering of multiview video on 3D displays. View interpolation techniques are utilized to achieve an oversampling of the multiview signal in the view dimension. The oversampled signal is then filtered to suppress high frequency portions of the signal that contribute to aliasing, and finally sub-sampled to match the display characteristics.
Future Direction: Improved 3D display, multi-view video coding, computational improvement of the displayed image.
Contact: Anthony Vetro
Publications:
Vetro, A.; Yea, S; Smolic, A., "Towards a 3D Video Format for Auto-Stereoscopic Displays", SPIE Conference on Applications of Digital Image Processing XXXI, Vol. 7073, September 2008 (Proceedings of SPIE, TR2008-057)
Matusik, W.; Forlines, C.; Pfister, H., "Multiview User Interfaces with an Automultiscopic Display", Advanced Visual Interfaces, Poster Session, ISBN 0-978-60558-141-5, pp. 363-366, May 2008 (ACM Press, TR2008-018)
Yea, S.; Vetro, A., "View Synthesis Prediction for Rate-Overhead Reduction in FTV", 3DTV-Conference, ISBN: 978-1-4244-1670-5, pp. 145-148, May 2008 (IEEE Xplore, TR2008-016)
Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Multi-view Video Compression for 3D Displays", Asilomar Conference on Signals, Systems and Computers (ACSSC), ISSN: 1058-6393, pp. 1506-1510, November 2007 (IEEE Xplore, TR2007-080)
Zwicker, M.; Vetro, A.; Yea, S.; Matusik, W.; Pfister, H.; Durand, F., "Resampling, Antialiasing, and Compression in Multiview 3-D Displays", IEEE Signal Processing Magazine, ISSN: 1053-5888, Vol. 24, Issue 6, pp. 88-96, November, 2007 (IEEE Xplore, TR2007-084)
Zwicker, M.; Yea, S.; Vetro, A.; Forlines, C.; Matusik, W.; Pfister, H., "Display Pre-filtering for Multi-view Video Compression", International Conference on Multimedia (ACM Multimedia), ISBN: 978-1-59593-702-5, Session: Systems 4 - Coding Support - pp. 1046-1053, September 2007 (ACM Press, TR2007-073)
Vetro, A.; Yea, S.; Zwicker, M.; Matusik, W.; Pfister, H., "Overview of Multiview Video Coding and Anti-Aliasing for 3D Displays", IEEE International Conference on Image Processing (ICIP), ISSN: 1522-4880, Vol. 1, pp. 1-17 - I-20, September 2007 (IEEE Xplore, TR2007-027)
Vetro, A.; Matusik, W.; Pfister, H.; Xin, J., "Coding Approaches for End-to-End 3D TV Systems", Picture Coding Symposium (PCS), December 2004 (TR2004-137)
Matusik, W.; Pfister, H., "3D TV: A Scalable System for Real-Time Acquistion, Transmission and Autostereoscopic Display of Dynamic Scenes", ACM Transactions on Graphics (TOG) SIGGRAPH, ISSN: 0730-0301, Vol. 23, Issue 3, pp. 814-824, August 2004 (ACM Press, TR2004-067)
Technology Areas:
Multimedia
Advanced Digital Television
Audio Video Processing
Imaging
Modification Date: January 16, 2009