Full Content is available to subscribers

Subscribe/Learn More  >

Gesture Based Training of Robots for Manufacturing Tasks

[+] Author Affiliations
Pramod Chembrammel, Thenkurussi Kesavadas

University of Illinois at Urbana-Champaign, Urbana, IL

Paper No. IMECE2016-68206, pp. V002T02A091; 6 pages
  • ASME 2016 International Mechanical Engineering Congress and Exposition
  • Volume 2: Advanced Manufacturing
  • Phoenix, Arizona, USA, November 11–17, 2016
  • Conference Sponsors: ASME
  • ISBN: 978-0-7918-5052-7
  • Copyright © 2016 by ASME


We report our work-in-progress on a new method to train an industrial robot that can learn from the demonstrations of manufacturing tasks by a skilled worker (trainer). A parametrized learning engine is trained based on identifiable features of the trainer’s body and objects. To achieve this, we collected a large number of depth data. Different objects in the scene are clustered using Gaussian mixture model and are manually labelled. Features are engineered to train random decision forest. Feature engineering is required since the number of dimensions (number of depth points) of samples vary because of variations in depth capture. Depth samples are transformed to a lower dimension space of 96 dimensions defined by means and covariance of data distribution. This method has a classification accuracy of 80.72%. Using these features, the robot can identify parts in real-time, tag as well as track them as the trainer moves them during the demonstration. Our ongoing work is on semantic classification of the tracked data into high level actions which will be combined using a set of rules called action-grammar.

Copyright © 2016 by ASME
Topics: Robots , Manufacturing



Interactive Graphics


Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In