Title: Research of path planning based on adaptive dynamic programming for bio-mimetic robot fish

Authors: Zhenyu Wang, Yaping Dai, Yongwei Li

Addresses: School of Automation, Beijing Institute of Technology, 5 South Zhongguancun Street, Haidian District, Beijing 100081, China. ' School of Automation, Beijing Institute of Technology, 5 South Zhongguancun Street, Haidian District, Beijing 100081, China. ' College of Electrical Engineering and Information Science, Hebei University of Science and Technology, Shijiazhuang, Hebei 050018, China

Abstract: In robot path planning, artificial potential field (APF) is used to describe complex environment information. This paper proposes an artificial potential field-based adaptive dynamic programming (APFADP) method and applies it to the bio-mimetic robot fish path planning. In ADP, according to Bellman optimal theory, system cost is conventionally used to present control action cost. In APFADP, a novel potential field is defined according to system cost which is based on APF and the description of environment information can be given through the learning process. In the proposed method, we use action-dependent heuristic dynamic programming (ADHDP) that consists of two neural networks: the critic network and action network. The critic network is designed to approximate system cost by learning from position variables and angle between robot fish movement and target. The action network is designed as a controller to find the optimal path, which produces control outputs by learning from position variables. Verification has been conducted to illustrate the good performance of the proposed method by experiment results on bio-mimetic robot fish path planning.

Keywords: adaptive dynamic programming; artificial potential field; APF; robot path planning; biomimetics; robotic fish; neural networks; robot control; robot learning; position variables; robot positioning; robot navigation.

DOI: 10.1504/IJMIC.2011.041301

International Journal of Modelling, Identification and Control, 2011 Vol.13 No.3, pp.144 - 151

Published online: 21 Mar 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article