Simulation of unmanned ship real-time trajectory planning model based on Q-learning
by Jindong Liu; Jie Yang; Zhiqiang Guo; Hui Cao; Yongmei Ren
International Journal of Simulation and Process Modelling (IJSPM), Vol. 16, No. 4, 2021

Abstract: In view of the challenge in autonomous navigation of unmanned ships where environmental conditions are complicated, this paper proposes a global trajectory planning model with local risk collision avoidance. The model establishes MAKLINK global connectivity map from original sea area, and provides global trajectory planning strategy based on ACO algorithm, and then introduces Q-learning algorithm to realise local risk collision avoidance, thus achieving real-time trajectory planning for unmanned ships. Compared to traditional models, our proposed one reduces level of complexity in environmental modelling, without bringing path uncertainty due to the presence of reinforcement learning and also has a faster trajectory convergence rate and shorter path length. This work would bring meaningful insights to future autonomous navigation research.

Online publication date: Mon, 08-Nov-2021

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Simulation and Process Modelling (IJSPM):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com