TR2021-026

Online Bayesian Inference and Learning of Gaussian-Process State-SpaceModels


    •  Berntorp, K., "Online Bayesian Inference and Learning of Gaussian-Process State-SpaceModels", Automatica, DOI: 10.1016/​j.automatica.2021.109613, Vol. 129, March 2021.
      BibTeX TR2021-026 PDF
      • @article{Berntorp2021mar,
      • author = {Berntorp, Karl},
      • title = {Online Bayesian Inference and Learning of Gaussian-Process State-SpaceModels},
      • journal = {Automatica},
      • year = 2021,
      • volume = 129,
      • month = mar,
      • doi = {10.1016/j.automatica.2021.109613},
      • issn = {0005-1098},
      • url = {https://www.merl.com/publications/TR2021-026}
      • }
  • MERL Contact:
  • Research Areas:

    Control, Signal Processing

Abstract:

This paper addresses the recursive joint inference (state estimation) and learning (system identification) problem for nonlinear systems admitting a state-space formulation. We model the system as a Gaussian-process state-space model (GP-SSM) and leverage a recently developed reduced-rank formulation of GP-SSMs to enable efficient, online learning. The unknown dynamical system is expressed as a basis-function expansion, where a connection to the GP makes it possible to systematically assign priors to the basis-function weights. The approach is formulated within the sequential Monte-Carlo framework, wherein each particle retains its own weights of the basis functions, which are updated recursively as measurements arrive. We report competitive results when compared to a state-of-the art offline Bayesian learning method. We also apply the method to a case study concerning tire-friction estimation. The results indicate that our method can accurately learn the tire friction using automotive-grade sensors in an online setting, and quickly detect sudden changes of the road surface.

 

  • Related News & Events

    •  NEWS    Karl Berntorp gave Spotlight Talk at CDC Workshop on Gaussian Process Learning-Based Control
      Date: December 5, 2022
      Where: Cancun, Mexico
      MERL Contact: Karl Berntorp
      Research Areas: Control, Machine Learning
      Brief
      • Karl Berntorp was an invited speaker at the workshop on Gaussian Process Learning-Based Control organized at the Conference on Decision and Control (CDC) 2022 in Cancun, Mexico.

        The talk was part of a tutorial-style workshop aimed to provide insight into the fundamentals behind Gaussian processes for modeling and control and sketching some of the open challenges and opportunities using Gaussian processes for modeling and control. The talk titled ``Gaussian Processes for Learning and Control: Opportunities for Real-World Impact" described some of MERL's efforts in using Gaussian processes (GPs) for learning and control, with several application examples and discussing some of the key benefits and limitations with using GPs for learning-based control.
    •