Full Content is available to subscribers

Subscribe/Learn More  >

Autonomous Collision Avoidance as a Markov Decision Process

[+] Author Affiliations
Hossein Rastgoftar, Xiangyu Ni, Ella M. Atkins

University of Michigan Ann Arbor, Ann Arbor, MI

Paper No. DSCC2016-9790, pp. V002T24A006; 9 pages
  • ASME 2016 Dynamic Systems and Control Conference
  • Volume 2: Mechatronics; Mechatronics and Controls in Advanced Manufacturing; Modeling and Control of Automotive Systems and Combustion Engines; Modeling and Validation; Motion and Vibration Control Applications; Multi-Agent and Networked Systems; Path Planning and Motion Control; Robot Manipulators; Sensors and Actuators; Tracking Control Systems; Uncertain Systems and Robustness; Unmanned, Ground and Surface Robotics; Vehicle Dynamic Controls; Vehicle Dynamics and Traffic Control
  • Minneapolis, Minnesota, USA, October 12–14, 2016
  • Conference Sponsors: Dynamic Systems and Control Division
  • ISBN: 978-0-7918-5070-1
  • Copyright © 2016 by ASME


In this paper, we apply a Markov Decision Process (MDP) to assure collision avoidance and specify optimal paths for evolution of an agent with nonlinear dynamics. We consider evolution of an autonomous wheeled robot in a motion field where a malicious agent has stochastic transitions over the field. By knowing the history of malicious agent transition as well as initial and goal destinations of the autonomous robot, the optimal path is obtained using the Bellman equation. We propose a novel finite time controller that assures reachability of desired way-points along the optimal path, where the optimal path is obtained without deriving the Hamiltonian.

Copyright © 2016 by ASME



Interactive Graphics


Country-Specific Mortality and Growth Failure in Infancy and Yound Children and Association With Material Stature

Use interactive graphics and maps to view and sort country-specific infant and early dhildhood mortality and growth failure data and their association with maternal

Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In