Robotics

MERL is seeking a highly motivated and qualified intern to collaborate with the Control for Autonomy team in the development of visual perception-aware control. The overall objective is to optimize control policy where the perception uncertainty is affected by the chosen policy. Application areas include mobile robotics, drones, autonomous vehicles, and spacecraft. The ideal candidate is expected to be working towards a PhD with a strong emphasis on stochastic optimal control/planning or visual odometry and to have interest and background in as many as possible among: output-feedback optimal control, visual SLAM, POMDP, information fields, motion planning, and machine learning. The expected start date is in the late Spring/Early Summer 2025, for a duration of 3-6 months.

Required Specific Experience

• Current/Past enrollment in a PhD program in Mechanical, Aerospace, Electrical Engineering, or a related field
• 2+ years of research in at least some of: optimal control, motion planning, computer vision, navigation, uncertainty quantification, stochastic planning/control
• Strong programming skills in Python and/or C++

MERL is looking for a self-motivated intern to work on problems at the intersection of multimodal large language models and embodied AI in dynamic indoor environments. The ideal candidate would be a PhD student with a strong background in machine learning and computer vision, as demonstrated by top-tier publications. The candidate must have prior experience in designing synthetic scenes (e.g., 3D games) using popular graphics software, embodied AI, large language models, reinforcement learning, and the use of simulators such as Habitat/SoundSpaces. Hands on experience in using animated 3D human shape models (e.g., SMPL and variants) is desired. The intern is expected to collaborate with researchers in computer vision at MERL to develop algorithms and prepare manuscripts for scientific publications.

Required Specific Experience

• Experience in designing 3D interactive scenes
• Experience with vision based embodied AI using simulators (implementation on real robotic hardware would be a plus).
• Experience training large language models on multimodal data
• Experience with training reinforcement learning algorithms
• Strong foundations in machine learning and programming
• Strong track record of publications in top-tier computer vision and machine learning venues (such as CVPR, NeurIPS, etc.).

MERL is seeking a graduate student to develop a scalable optimization-based framework for feedforward-feedback co-design for nonlinear dynamical systems subject to path constraints. The framework will 1) support modeling and operational uncertainties, and 2) guarantee static and dynamic feasibility in closed-loop. The solution approach will leverage the state-of-the-art in sequential convex programming, contraction analysis, and first-order methods for semidefinite programming. The methods will be evaluated on high-dimensional motion planning problems in robotics. The results of the internship are expected to be published in top-tier conferences and/or journal in robotics, control systems, and optimization.

The internship is expected to start in Spring or Summer 2025 with an expected duration of 3-6 months depending on the agreed scope and intermediate progress.

Required Specific Experience

• Current/Past enrollment in a Ph.D. program in Mechanical, Aerospace, Electrical Engineering, Computer Science, or Applied Mathematics.
• 2+ years of research in at least some of: first-order algorithms for SDPs, contraction analysis, nonconvex trajectory optimization.
• Strong programming skills in Python and/or C/C++.