TR2010-080

Robust RVM Regression Using Sparse Outliers Model


Abstract:

Kernel regression techniques like Relevance Vector Machine (RVM) regression, Support Vector Regression and Gaussian Processes are widely used for solving many computer vision problems such as age, head pose, 3D human pose and lighting estimation. However the presence of outliers in the training dataset make the estimate from these regression techniques unreliable. In this paper, we propose robust versions of the RVM regression that can handle outliers in the training dataset. We decompose the noise term in the RVM formulation into an (sparse) outlier noise term and a Gaussian noise term. We then estimate the outlier noise along with the model parameters. We explore two natural approaches for solving this estimation problem: 1) a Bayesian approach which follows the RVM framework, and 2) an optimization approach based on Basis Pursuit Denoising. The Bayesian approach has the advantage that it can be seamlessly incorporated into the RVM framework and thus inherits the subsequent advancement made towards faster computations of the RVM. Empirical evaluation of the robust algorithms show that the Bayesian approach performs better than the optimization approach. We further show the effectiveness of the bayesian approach in solving image denoising and age estimation problems.

 

  • Related News & Events

    •  NEWS    CVPR 2010: 8 publications by C. Oncel Tuzel, Tim K. Marks, Yuichi Taguchi, Srikumar Ramalingam, Michael J. Jones and Amit K. Agrawal
      Date: June 13, 2010
      Where: IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
      MERL Contacts: Michael J. Jones; Tim K. Marks
      Brief
      • The papers "Optimal Coded Sampling for Temporal Super-Resolution" by Agrawal, A.K., Gupta, M., Veeraraghavan, A.N. and Narasimhan, S.G., "Breaking the Interactive Bottleneck in Multi-class Classification with Active Selection and Binary Feedback" by Joshi, A.J., Porikli, F.M. and Papanikolopoulos, N., "Axial Light Field for Curved Mirrors: Reflect Your Perspective, Widen Your View" by Taguchi, Y., Agrawal, A.K., Ramalingam, S. and Veeraraghavan, A.N., "Morphable Reflectance Fields for Enhancing Face Recognition" by Kumar, R., Jones, M.J. and Marks, T.K., "Increasing Depth Resolution of Electron Microscopy of Neural Circuits using Sparse Tomographic Reconstruction" by Veeraraghavan, A., Genkin, A.V., Vitaladevuni, S., Scheffer, L., Xu, S., Hess, H., Fetter, R., Cantoni, M., Knott, G. and Chklovskii, D., "Specular Surface Reconstruction from Sparse Reflection Correspondences" by Sankaranarayanan, A., Veeraraghavan, A.N., Tuzel, C.O. and Agrawal, A.K., "Fast Directional Chamfer Matching" by Liu, M.-Y., Tuzel, C.O., Veeraraghavan, A.N. and Chellappa, R. and "Robust RVM regression using sparse outlier model" by Mitra, K., Veeraraghavan, A. and Chellappa, R. were presented at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
    •