TR2023-078

Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning


    •  Zhang, M., Jha, D.K., Raghunathan, A., Hauser, K., "Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning", Robotics: Science and Systems (RSS), DOI: 10.15607/​RSS.2023.XIX.044, July 2023.
      BibTeX TR2023-078 PDF Video
      • @inproceedings{Zhang2023jul,
      • author = {Zhang, Mengchao and Jha, Devesh K. and Raghunathan, Arvind and Hauser, Kris},
      • title = {Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning},
      • booktitle = {Robotics: Science and Systems (RSS)},
      • year = 2023,
      • month = jul,
      • doi = {10.15607/RSS.2023.XIX.044},
      • url = {https://www.merl.com/publications/TR2023-078}
      • }
  • MERL Contacts:
  • Research Areas:

    Optimization, Robotics

Abstract:

Complex dexterous manipulations require switching between prehensile and non-prehensile grasps, and sliding and pivoting the object against the environment. This paper presents a manipulation planner that is able to reason about diverse changes of contacts to discover such plans. It implements a hybrid approach that performs contact-implicit trajectory optimization for pivoting and sliding manipulation primitives and sampling- based planning to change between manipulation primitives and target object poses. The optimization method, simultaneous trajectory optimization and contact selection (STOCS), introduces an infinite programming framework to dynamically select from contact points and support forces between the object and environment during a manipulation primitive. To sequence manipulation primitives, a sampling-based tree-growing planner uses STOCS to construct a manipulation tree. We show that by using a powerful trajectory optimizer, the proposed planner can discover multi- modal manipulation trajectories involving grasping, sliding, and pivoting within a few dozen samples. The resulting trajectories are verified to enable a 6 DoF manipulator to manipulate physical objects successfully.

 

  • Related News & Events

    •  NEWS    MERL researchers present 3 papers on Dexterous Manipulation at RSS 23.
      Date: July 11, 2023
      Where: Daegu, Korea
      MERL Contacts: Siddarth Jain; Devesh K. Jha; Arvind Raghunathan
      Research Areas: Artificial Intelligence, Machine Learning, Robotics
      Brief
      • MERL researchers presented 3 papers at the 19th edition of Robotics:Science and Systems Conference in Daegu, Korea. RSS is the flagship conference of the RSS foundation and is run as a single track conference presenting a limited number of high-quality papers. This year the main conference had a total of 112 papers presented. MERL researchers presented 2 papers in the main conference on planning and perception for dexterous manipulation. Another paper was presented in a workshop of learning for dexterous manipulation. More details can be found here https://roboticsconference.org.
    •  
  • Related Video

  • Related Publication

  •  Zhang, M., Jha, D.K., Raghunathan, A., Hauser, K., "Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning", arXiv, June 2023.
    BibTeX arXiv
    • @article{Zhang2023jun,
    • author = {Zhang, Mengchao and Jha, Devesh K. and Raghunathan, Arvind and Hauser, Kris},
    • title = {Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning},
    • journal = {arXiv},
    • year = 2023,
    • month = jun,
    • url = {https://arxiv.org/abs/2306.06465}
    • }