Jeroen van Baar

Jeroen van Baar
  • Biography

    Jeroen came to MERL in 1997 as intern, and was subsequently hired as research associate. He temporarily left MERL to pursue a Ph.D. and returned early 2013. At MERL he has made contributions in the areas of computer graphics, computer vision and computational photography. His interests include 3D reconstruction, medical imaging, GP-GPU for computational photography and computer vision.

  • Recent News & Events


    See All News & Events for Jeroen
  • Research Highlights

  • Internships with Jeroen

    • CV1546: Vibration analysis in video sequences

      MERL is looking for a self-motivated intern to work on vibration analysis in video sequences. The ideal candidate would be a Ph.D. student with a strong background in machine learning, optimization and computer vision. Experience in computational photography and MATLAB/Python is a plus. You are expected to collaborate with MERL researchers to develop algorithms and prepare manuscripts for scientific publications. The internship is for a minimum of 3 months and the start date is flexible. This internship is preferred to be onsite at MERL, but may be done remotely where you live if the COVID pandemic makes it necessary.

    • CV1569: Robot learning from videos of human demonstrations

      MERL is looking for a highly motivated and qualified intern to work on developing algorithms for robot learning from videos of human demonstrations. The ideal candidate would be a current Ph.D. student with a strong background in computer vision, deep learning, and robotics. Familiarity with imitation learning, learning from demonstrations (LfD), reinforcement learning, and machine learning for robotics will be valued. Proficiency in Python programming is necessary and experience in working with a physics engine simulator like Mujoco or pyBullet is a plus. A successful candidate will collaborate with MERL researchers and publication of the relevant results is expected. Start date is flexible and the expected duration of the internship is 3-4 months. Interested candidates are encouraged to apply with their recent CV and list of publications in related topics. This internship is preferred to be onsite at MERL, but may be done remotely where you live if the COVID pandemic makes it necessary.

    See All Internships at MERL
  • MERL Publications

    •  Ota, K., Jha, D., Romeres, D., van Baar, J., Smith, K., Semistsu, T., Oiki, T., Sullivan, A., Nikovski, D.N., Tenanbaum, J., "Data-Efficient Learning for Complex and Real-Time Physical Problem Solving using Augmented Simulation", IEEE Robotics and Automation Letters, DOI: 10.1109/​LRA.2021.3068887, Vol. 6, No. 2, March 2021.
      BibTeX TR2021-032 PDF
      • @article{Ota2021mar,
      • author = {Ota, Kei and Jha, Devesh and Romeres, Diego and van Baar, Jeroen and Smith, Kevin and Semistsu, Takayuki and Oiki, Tomoaki and Sullivan, Alan and Nikovski, Daniel N. and Tenanbaum, Joshua},
      • title = {Data-Efficient Learning for Complex and Real-Time Physical Problem Solving using Augmented Simulation},
      • journal = {IEEE Robotics and Automation Letters},
      • year = 2021,
      • volume = 6,
      • number = 2,
      • month = mar,
      • doi = {10.1109/LRA.2021.3068887},
      • url = {https://www.merl.com/publications/TR2021-032}
      • }
    •  Russel, R.H., Benosman, M., van Baar, J., "Robust Constrained-MDPs: Soft-Constrained Robust Policy Optimization under Model Uncertainty", Advances in Neural Information Processing Systems (NeurIPS)-workshop, January 2021.
      BibTeX TR2021-009 PDF
      • @inproceedings{Russel2021jan,
      • author = {Russel, Reazul Hasan and Benosman, Mouhacine and van Baar, Jeroen},
      • title = {Robust Constrained-MDPs: Soft-Constrained Robust Policy Optimization under Model Uncertainty},
      • booktitle = {Advances in Neural Information Processing Systems (NeurIPS)-workshop},
      • year = 2021,
      • month = jan,
      • url = {https://www.merl.com/publications/TR2021-009}
      • }
    •  Corcodel, R., Jain, S., van Baar, J., "Interactive Tactile Perception for Classification of Novel Object Instances", IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), DOI: 10.1109/​IROS45743.2020.9341795, November 2020, pp. 9861-9868.
      BibTeX TR2020-143 PDF
      • @inproceedings{Corcodel2020nov,
      • author = {Corcodel, Radu and Jain, Siddarth and van Baar, Jeroen},
      • title = {Interactive Tactile Perception for Classification of Novel Object Instances},
      • booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
      • year = 2020,
      • pages = {9861--9868},
      • month = nov,
      • publisher = {IEEE},
      • doi = {10.1109/IROS45743.2020.9341795},
      • url = {https://www.merl.com/publications/TR2020-143}
      • }
    •  He, W., Lee, T.-Y., van Baar, J., Wittenburg, K.B., Shen, H.-W., "DynamicsExplorer: Visual Analytics for Robot Control Tasks involving Dynamics and LSTM-based Control Policies", IEEE Pacific Visualization Symposium (PacificVis), DOI: 10.1109/​PacificVis48177.2020.7127, January 2020, pp. 36-45.
      BibTeX TR2020-011 PDF
      • @inproceedings{He2020jan,
      • author = {He, Wenbin and Lee, Teng-Yok and van Baar, Jeroen and Wittenburg, Kent B. and Shen, Han-Wei},
      • title = {DynamicsExplorer: Visual Analytics for Robot Control Tasks involving Dynamics and LSTM-based Control Policies},
      • booktitle = {IEEE Pacific Visualization Symposium (PacificVis)},
      • year = 2020,
      • pages = {36--45},
      • month = jan,
      • doi = {10.1109/PacificVis48177.2020.7127},
      • url = {https://www.merl.com/publications/TR2020-011}
      • }
    •  Paul, S., van Baar, J., Roy-Chowdhury, A.K., "Learning from Trajectories via Subgoal Discovery", Advances in Neural Information Processing Systems (NeurIPS), pp. 8409-8419, October 2019.
      BibTeX TR2019-128 PDF
      • @article{Paul2019oct,
      • author = {Paul, Sujoy and van Baar, Jeroen and Roy-Chowdhury, Amit K.},
      • title = {Learning from Trajectories via Subgoal Discovery},
      • journal = {Advances in Neural Information Processing Systems (NeurIPS)},
      • year = 2019,
      • pages = {8409--8419},
      • month = oct,
      • url = {https://www.merl.com/publications/TR2019-128}
      • }
    See All Publications for Jeroen
  • Software Downloads

  • Videos

  • MERL Issued Patents

    • Title: "System and Method for Multimodal, Motion-Aware Radar Imaging"
      Inventors: Boufounos, Petros T.; Mansour, Hassan; Srinivasa, Rakshith Sharma; Van Baar, Jeroen
      Patent No.: 10,768,294
      Issue Date: Sep 8, 2020
    • Title: "Method for Registering Deformable Images Using Random Markov Fields"
      Inventors: Van Baar, Jeroen; Seo, Dohyung
      Patent No.: 9,449,384
      Issue Date: Sep 20, 2016
    • Title: "Method for Deformable Image Registration"
      Inventors: Van Baar, Jeroen; Seo, Dohyung
      Patent No.: 9,449,246
      Issue Date: Sep 20, 2016
    • Title: "Image Denoising Using a Library of Functions"
      Inventors: Tuzel, Oncel; Thornton, Jay E.; Van Baar, Jeroen
      Patent No.: 9,262,810
      Issue Date: Feb 16, 2016
    • Title: "Motion-Based Text Input"
      Inventors: Van Baar, Jeroen; Beardsley, Paul A.
      Patent No.: 7,355,583
      Issue Date: Apr 8, 2008
    • Title: "System and Method for Mechanically Adjusting Projector Posewith Six Degrees of Freedom for Image Alignment"
      Inventors: Raskar, Ramesh N.; Van Baar, Jeroen
      Patent No.: 7,252,387
      Issue Date: Aug 7, 2007
    • Title: "Interactive Wireless Tag Location and Identification System"
      Inventors: Beardsley, Paul A.; Dietz, Paul H.; Van Baar, Jeroen; Raskar, Ramesh N.
      Patent No.: 7,154,395
      Issue Date: Dec 26, 2006
    • Title: "Projector-Camera System with Laser Pointers"
      Inventors: Van Baar, Jeroen; Beardsley, Paul A.; Raskar, Ramesh N.
      Patent No.: 7,137,707
      Issue Date: Nov 21, 2006
    • Title: "Self-Configurable Ad-Hoc Projector Cluster"
      Inventors: Beardsley, Paul A.; Van Baar, Jeroen; Raskar, Ramesh N.
      Patent No.: 6,834,965
      Issue Date: Dec 28, 2004
    • Title: "Geometrically Aware Projector"
      Inventors: Van Baar, Jeroen; Raskar, Ramesh N.; Beardsley, Paul A.
      Patent No.: 6,811,264
      Issue Date: Nov 2, 2004
    • Title: "Projecting Warped Images onto Curved Surfaces"
      Inventors: Raskar, Ramesh N.; Van Baar, Jeroen; Willwacher, Thomas; Rao, Srinivasa
      Patent No.: 6,793,350
      Issue Date: Sep 21, 2004
    • Title: "Method for Globally Aligning Multiple Projected Images"
      Inventors: Raskar, Ramesh N.; Van Baar, Jeroen; Beardsley, Paul A.
      Patent No.: 6,755,537
      Issue Date: Jun 29, 2004
    • Title: "Rendering Discrete Sample Points Projected to a Screen Space with a Continuous Resampling Filter"
      Inventors: Van Baar, Jeroen; Zwicker, Matthias B.; Gross, Markus H.; Pfister, Hans Peter
      Patent No.: 6,744,435
      Issue Date: Jun 1, 2004
    • Title: "Method for Determining a Largest Inscribed Rectangular Image within a Union of Projected QuadrilateralImages"
      Inventors: Raskar, Ramesh N.; Van Baar, Jeroen; Willwacher, Thomas
      Patent No.: 6,729,733
      Issue Date: May 4, 2004
    • Title: "Method and System for Displaying Images on Curved Surfaces"
      Inventors: Raskar, Ramesh N.; Van Baar, Jeroen; Willwacher, Thomas
      Patent No.: 6,715,888
      Issue Date: Apr 6, 2004
    • Title: "Rendering Pipeline for Surface Elements"
      Inventors: Gross, Markus H.; Pfister, Hans Peter; Van Baar, Jeroen; Zwicker, Matthias B.
      Patent No.: 6,583,787
      Issue Date: Jun 24, 2003
    • Title: "A Method for Generating Graphical Objects Represented as Surface Elements"
      Inventors: Van Baar, Jeroen; Pfister, Hans Peter; Oosterbaan, Collin E.
      Patent No.: 6,498,607
      Issue Date: Dec 24, 2002
    • Title: "Graphical Objects Represented as Surface Elements"
      Inventors: Pfister, Hans Peter; Van Baar, Jeroen; Oosterbaan, Collin E.
      Patent No.: 6,480,190
      Issue Date: Nov 12, 2002
    • Title: "Method for Rendering Graphical Objects Represented as Surface Elements"
      Inventors: Van Baar, Jeroen; Pfister, Hans Peter; Oosterbaan, Collin E.
      Patent No.: 6,448,968
      Issue Date: Sep 10, 2002
    • Title: "A Method for Modeling Graphical Objects Represented as Surface Elements"
      Inventors: Oosterbaan, Collin E.; Van Baar, Jeroen; Pfister, Hans Peter
      Patent No.: 6,396,496
      Issue Date: May 28, 2002
    • Title: "Method for Interactively Modeling Graphical Objects with Linked and Unlinked Surface Elements"
      Inventors: Pfister, Hans Peter; Oosterbaan, Collin E.; Van Baar, Jeroen
      Patent No.: 6,342,886
      Issue Date: Jan 29, 2002
    See All Patents for MERL