التفاصيل البيبلوغرافية
العنوان: |
Robust Event-Driven Interactions in Cooperative Multi-Agent Learning |
المؤلفون: |
Ornia, Daniel Jarne, Mazo Jr, Manuel |
المصدر: |
Formal Modeling and Analysis of Timed Systems. FORMATS 2022. Lecture Notes in Computer Science, vol 13465. Springer, Cham |
سنة النشر: |
2022 |
المجموعة: |
Computer Science |
مصطلحات موضوعية: |
Computer Science - Multiagent Systems, Computer Science - Artificial Intelligence, Electrical Engineering and Systems Science - Systems and Control |
الوصف: |
We present an approach to reduce the communication required between agents in a Multi-Agent learning system by exploiting the inherent robustness of the underlying Markov Decision Process. We compute so-called robustness surrogate functions (off-line), that give agents a conservative indication of how far their state measurements can deviate before they need to update other agents in the system. This results in fully distributed decision functions, enabling agents to decide when it is necessary to update others. We derive bounds on the optimality of the resulting systems in terms of the discounted sum of rewards obtained, and show these bounds are a function of the design parameters. Additionally, we extend the results for the case where the robustness surrogate functions are learned from data, and present experimental results demonstrating a significant reduction in communication events between agents. |
نوع الوثيقة: |
Working Paper |
DOI: |
10.1007/978-3-031-15839-1_16 |
URL الوصول: |
http://arxiv.org/abs/2204.03361 |
رقم الانضمام: |
edsarx.2204.03361 |
قاعدة البيانات: |
arXiv |