A modular approach to learning manipulation strategies from human demonstration

Bidan Huang, Miao Li, Ravin Luis De Souza, Joanna J. Bryson, Aude Billard

Research output: Contribution to journalArticlepeer-review

19 Citations (SciVal)
388 Downloads (Pure)


Object manipulation is a challenging task for robotics, as the physics involved in object interaction is complex and hard to express analytically. Here we introduce a modular approach for learning a manipulation strategy from human demonstration. Firstly we record a human performing a task that requires an adaptive control strategy in different conditions, i.e. different task contexts. We then perform modular decomposition of the control strategy, using phases of the recorded actions to guide segmentation. Each module represents a part of the strategy, encoded as a pair of forward and inverse models. All modules contribute to the final control policy; their recommendations are integrated via a system of weighting based on their own estimated error in the current task context. We validate our approach by demonstrating it, both in a simulation for clarity, and on a real robot platform to demonstrate robustness and capacity to generalise. The robot task is opening bottle caps. We show that our approach can modularize an adaptive control strategy and generate appropriate motor commands for the robot to accomplish the complete task, even for novel bottles.
Original languageEnglish
Pages (from-to)1-25
Number of pages25
JournalAutonomous Robots
Issue number5
Early online date5 Oct 2015
Publication statusPublished - 2015


Dive into the research topics of 'A modular approach to learning manipulation strategies from human demonstration'. Together they form a unique fingerprint.

Cite this