Full Content is available to subscribers

Subscribe/Learn More  >

Development of a Mobile Robot Providing a Natural Way to Interact With Electronic Devices

[+] Author Affiliations
Jinfa Chen, Won-jong Kim

Texas A&M University, College Station, TX

Paper No. DSCC2016-9751, pp. V001T03A003; 10 pages
  • ASME 2016 Dynamic Systems and Control Conference
  • Volume 1: Advances in Control Design Methods, Nonlinear and Optimal Control, Robotics, and Wind Energy Systems; Aerospace Applications; Assistive and Rehabilitation Robotics; Assistive Robotics; Battery and Oil and Gas Systems; Bioengineering Applications; Biomedical and Neural Systems Modeling, Diagnostics and Healthcare; Control and Monitoring of Vibratory Systems; Diagnostics and Detection; Energy Harvesting; Estimation and Identification; Fuel Cells/Energy Storage; Intelligent Transportation
  • Minneapolis, Minnesota, USA, October 12–14, 2016
  • Conference Sponsors: Dynamic Systems and Control Division
  • ISBN: 978-0-7918-5069-5
  • Copyright © 2016 by ASME


This paper provides a natural, yet low-cost way for human to interact with electronic devices indoor: the development of a human-following mobile robot capable of controlling other electrical devices for the user based on the user’s gesture commands. The overall experimental setup consists of a skid-steered mobile robot, Kinect sensor, laptop, wide-angle camera and two lamps. The OpenNI middleware is used to process data from the Kinect sensor, and the OpenCV is used to process data from the wide-angle camera. A new human-following algorithm is proposed based on human motion estimation. The human-following control system consists of two feedback control loop for linear and rotational motions, respectively. A lead-lag and lead controller are developed for the linear and rotational motion control loop, respectively. Experimental results show that the tracking algorithm is robust and reduced the distance and angular error by 40% and 50%, respectively. There are small delays (0.5 s for linear motion and 1.5 s for rotational motion) and steady-state errors (0.1 m for linear motion and 1.5° for rotational motion) of the system’s response. However, the delays and errors are acceptable since they do not cause the tracking distance or angle out of the desirable range (±0.05m and ±10° of the reference input). There are four gestures designed for the user to control the robot, two switch-mode gestures, lamp-creation, lamp-selection and color change gesture. Success rates of gesture recognition are more than 90% within the detectable range of the Kinect sensor.

Copyright © 2016 by ASME
Topics: Mobile robots



Interactive Graphics


Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In