Academic Journal

Informative Deep Reinforcement Path Planning for Heterogeneous Autonomous Surface Vehicles in Large Water Resources

التفاصيل البيبلوغرافية
العنوان: Informative Deep Reinforcement Path Planning for Heterogeneous Autonomous Surface Vehicles in Large Water Resources
المؤلفون: Alejandro Mendoza Barrionuevo, Samuel Yanes Luis, Daniel Gutierrez Reina, Sergio L. Toral Marin
المصدر: IEEE Access, Vol 12, Pp 71835-71852 (2024)
بيانات النشر: IEEE, 2024.
سنة النشر: 2024
المجموعة: LCC:Electrical engineering. Electronics. Nuclear engineering
مصطلحات موضوعية: Autonomous vehicles, deep reinforcement learning, environmental monitoring, heterogeneous multirobot systems, informative path planning, Electrical engineering. Electronics. Nuclear engineering, TK1-9971
الوصف: Water contamination in extensive aquatic resources is a pressing issue, especially during current drought conditions across the world. To adress this, a novel approach involving a heterogeneous sensing capabilities fleet of four autonomous surface vehicles is introduced for efficient contamination mapping. To reduce costs, vehicles may be equipped with low quality sensors meaning measurements reliability differs between vehicles and affects model accuracy. The diverse sensing capabilities are characterized by a wide range of sensor standard deviations, addressing the applicability of the framework in real-world scenarios with commercial sensors. This research leverages Gaussian Processes to accurately model spatial distribution of contamination, integrating measurements from the vehicles to understand contamination patterns comprehensively. Additionally, an informative path planning strategy is introduced based on a centralized neural network which implements a Double Deep Q-Learning algorithm, driving the decision-making process of all agents. Effective learning hinges on accurately defining the observation and reward functions, for which several proposals will be compared. These tailored definitions are essential for guiding the learning process, and minimizing the error towards the main goal: to obtain the best possible contamination model. Remarkably, the proposed system demonstrates superior performance in Ypacaraí Lake scenario, surpassing traditional heuristics like lawn mower or particle swarm optimization by up to 82% in reducing mean squared error in highly contaminated regions for several combinations of agents.
نوع الوثيقة: article
وصف الملف: electronic resource
اللغة: English
تدمد: 2169-3536
Relation: https://ieeexplore.ieee.org/document/10534782/; https://doaj.org/toc/2169-3536
DOI: 10.1109/ACCESS.2024.3402980
URL الوصول: https://doaj.org/article/396e4665dc9349c8a9b2b99db101c30d
رقم الانضمام: edsdoj.396e4665dc9349c8a9b2b99db101c30d
قاعدة البيانات: Directory of Open Access Journals
الوصف
تدمد:21693536
DOI:10.1109/ACCESS.2024.3402980