TR2010-116

Virtual View Synthesis Method and Self Evaluation Metrics for Free Viewpoint Television and 3D Video


    •  Oh, K.-J., Yea, S., Vetro, A., Ho, Y.-S., "Virtual View Synthesis Method and Self Evaluation Metrics for Free Viewpoint Television and 3D Video", International Journal of Imaging Systems and Technology, Vol. 20, No. 4, December 2010.
      BibTeX TR2010-116 PDF
      • @article{Oh2010dec,
      • author = {Oh, K.-J. and Yea, S. and Vetro, A. and Ho, Y.-S.},
      • title = {Virtual View Synthesis Method and Self Evaluation Metrics for Free Viewpoint Television and 3D Video},
      • journal = {International Journal of Imaging Systems and Technology},
      • year = 2010,
      • volume = 20,
      • number = 4,
      • month = dec,
      • url = {https://www.merl.com/publications/TR2010-116}
      • }
  • MERL Contact:
  • Research Area:

    Digital Video

Abstract:

Virtual view synthesis is one of the most important techniques to realize Free viewpoint TeleVision (FTV) and Three-Dimensional (3D) video. In this paper, we propose a view synthesis method to generate high quality intermediate views in such applications and new evaluation metrics named as SPSNR and TPSNR to measure spatial and temporal consistency, respectively. The proposed view synthesis method consists of five major steps: depth preprocessing, depth-based 3D warping, depth-based histogram matching, base plus assistant view blending, and depth-based hole-filling. The efficiency of the proposed view synthesis method has been verified by evaluating the quality of synthesized images with various metrics such as Peak Signal-to-Noise Ratio (PSNR), Structural SIMilarity (SSIM), DCT-based Video Quality Metric (VQM), and the newly proposed metrics. We have also confirmed that the synthesized images are objectively and subjectively natural.

 

  • Related News & Events