Artificial intelligence
Cross-embodiment learning
Definition
Cross-embodiment learning uses experience from different robot bodies to train representations or policies that can transfer across those bodies. It requires a way to handle differences in sensing, geometry, and available actions.
Also known as: Cross embodiment learning
Updated
Share experience across robot bodies
Open X-Embodiment brings robot datasets into standardized formats and studies policies trained across multiple robots. Its RT-X experiments investigate whether experience from different platforms can improve a policy's behavior beyond training on one platform alone.
A camera image of a cup may contain useful information for several robot arms. The motor commands needed to grasp that cup still depend on the arm, gripper, and controller.
Standardized data does not make bodies identical
Robot datasets can differ in sensor views, joint counts, command meanings, and task labels. A shared format helps access the data, but the learning system still needs compatible representations or adaptation mechanisms.
Octo explicitly studies fine-tuning to new observations and action spaces. Its results separate direct execution on supported setups from adaptation to new ones.
Distinguish learning from motion conversion
Motion retargeting maps a particular motion onto another body's geometry. Cross-embodiment learning instead concerns how training across bodies produces transferable knowledge or behavior. A pipeline can use both.
Transfer from one arm to another does not establish transfer to humanoid locomotion. The source and target bodies, available target data, and evaluated tasks are necessary context for any cross-embodiment result.
Sources
Related terms
Robot foundation model
A robot foundation model is a model pretrained on broad data to support adaptation to multiple robot tasks, environments, or bodies. The term describes a reusable learning base rather than a guarantee of general physical competence.
Generalist robot policy
A generalist robot policy is a learned action-selection model designed to perform multiple tasks across a range of robot settings. Its generality depends on the tasks, observations, action interfaces, and robot bodies included in training and evaluation.
Motion retargeting
Motion retargeting maps a motion recorded or designed for one body onto another body with different geometry or joints. In robotics it produces a compatible pose or trajectory reference, which still needs a controller to execute it physically.