Partial Motion Imitation for Learning Cart Pushing with Legged Manipulators

Computer Vision & MultiModal AI
Published: arXiv: 2603.26659v1
Authors

Mili Das Morgan Byrd Donghoon Baek Sehoon Ha

Abstract

Loco-manipulation is a key capability for legged robots to perform practical mobile manipulation tasks, such as transporting and pushing objects, in real-world environments. However, learning robust loco-manipulation skills remains challenging due to the difficulty of maintaining stable locomotion while simultaneously performing precise manipulation behaviors. This work proposes a partial imitation learning approach that transfers the locomotion style learned from a locomotion task to cart loco-manipulation. A robust locomotion policy is first trained with extensive domain and terrain randomization, and a loco-manipulation policy is then learned by imitating only lower-body motions using a partial adversarial motion prior. We conduct experiments demonstrating that the learned policy successfully pushes a cart along diverse trajectories in IsaacLab and transfers effectively to MuJoCo. We also compare our method to several baselines and show that the proposed approach achieves more stable and accurate loco-manipulation behaviors.

Paper Summary

Problem
The main problem this paper addresses is the challenge of learning robust loco-manipulation skills for legged robots. Loco-manipulation is the ability to perform tasks while moving, such as pushing a cart while walking. This is a crucial capability for robots that need to navigate and interact with their environment in real-world settings. However, learning this skill is challenging due to the need to balance stable locomotion with precise manipulation behaviors.
Key Innovation
The key innovation of this paper is a novel framework for learning a robust loco-manipulation policy using partial imitation learning. The approach involves training a locomotion policy first, which is then used as a reference to learn a loco-manipulation policy. The key insight is to preserve the stable lower-body locomotion styles while allowing the upper body to adapt freely to manipulation objectives. This is achieved using a partial adversarial motion prior, which imitates only the lower-body motions while allowing the arm to learn effective manipulation behaviors.
Practical Impact
The practical impact of this research is significant, as it enables legged robots to perform practical mobile manipulation tasks such as transporting and pushing objects in real-world environments. This has applications in various fields, including warehouse logistics, retail environments, and home automation. The ability to perform stable and accurate loco-manipulation behaviors will enable robots to interact with their environment in a more natural and efficient way, making them more useful and reliable.
Analogy / Intuitive Explanation
Imagine trying to ride a bike while carrying a tray of drinks. The bike represents the locomotion policy, and the tray of drinks represents the manipulation task. In this scenario, it's challenging to balance the bike while carrying the tray, as small movements or changes in balance can cause the tray to tip over. The key innovation of this paper is to develop a way to learn the balance and movement patterns of the bike (locomotion policy) first, and then use that knowledge to adapt to the manipulation task (carrying the tray) without compromising the balance of the bike. This analogy illustrates the challenges of loco-manipulation and the importance of preserving stable lower-body locomotion styles while adapting to manipulation objectives.
Paper Information
Categories:
cs.RO
Published Date:

arXiv ID:

2603.26659v1

Quick Actions