Not all agents are equal: Scaling up distributed POMDPs for agent networks

Janusz Marecki, Tapana Gupta, Pradeep Varakantham, Milind Tambe, Makoto Yokoo

研究成果: 書籍/レポート タイプへの寄稿会議への寄与

29 被引用数 (Scopus)

抄録

Many applications of networks of agents, including mobile sensor networks, unmanned air vehicles, autonomous underwater vehicles, involve 100s of agents acting collaboratively under uncertainty. Distributed Partially Observable Markov Decision Problems (Distributed POMDPs) are well-suited to address such applications, but so far, only limited scale-ups of up to five agents have been demonstrated. This paper escalates the scale-up, presenting an algorithm called FANS, increasing the number of agents in distributed POMDPs for the first time into double digits. FANS is founded on finite state machines (FSMs) for policy representation and expoits these FSMs to provide three key contributions: (i) Not all agents within an agent network need the same expressivity of policy representation; FANS introduces novel heuristics to automatically vary the FSM size in different agents for scale-up; (ii) FANS illustrates efficient integration of its FSM-based policy search within algorithms that exploit agent network structure; (iii) FANS provides significant speedups in policy evaluation and heuristic computations within the network algorithms by exploiting the FSMs for dynamic programming. Experimental results show not only orders of magnitude improvements over previous best known algorithms for smaller-scale domains (with similar solution quality), but also a scale-up into double digits in terms of numbers of agents.

本文言語英語
ホスト出版物のタイトル7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008
出版社International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS)
ページ478-485
ページ数8
ISBN(印刷版)9781605604701
出版ステータス出版済み - 2008
イベント7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008 - Estoril, ポルトガル
継続期間: 5月 12 20085月 16 2008

出版物シリーズ

名前Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS
1
ISSN(印刷版)1548-8403
ISSN(電子版)1558-2914

その他

その他7th International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS 2008
国/地域ポルトガル
CityEstoril
Period5/12/085/16/08

!!!All Science Journal Classification (ASJC) codes

  • 人工知能
  • ソフトウェア
  • 制御およびシステム工学

フィンガープリント

「Not all agents are equal: Scaling up distributed POMDPs for agent networks」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル