Reinforcement learning approach to multi-stage decision making problems with changes in action sets

Takuya Etoh, Hirotaka Takano, Junichi Murata

Research output: Contribution to journalArticlepeer-review


Multi-stage decision making (MSDM) problems often include changes in practical situations. For example, in the shortest route selection problems in road networks, travelling times of road sections vary depending on traffic conditions. The changes give rise to risks in adopting particular solutions to MSDM problems. Therefore, a method is proposed in this paper for solving MSDM problems considering the risks. Reinforcement learning (RL) is adopted as a method for solving those problems, and stochastic changes of action sets are treated. It is necessary to evaluate risks based on subjective views of decision makers (DMs) because the risk evaluation is by nature subjective and depends on DMs. Therefore, an RL approach is proposed which uses a new method for evaluating risks of the changes that can easily incorporate the DM's subjective view and can be readily imbedded in reinforcement learning algorithms. The effectiveness of the method is illustrated with a road network path selection problem.

Original languageEnglish
Pages (from-to)293-299
Number of pages7
JournalArtificial Life and Robotics
Issue number2
Publication statusPublished - Dec 2012

All Science Journal Classification (ASJC) codes

  • Biochemistry, Genetics and Molecular Biology(all)
  • Artificial Intelligence


Dive into the research topics of 'Reinforcement learning approach to multi-stage decision making problems with changes in action sets'. Together they form a unique fingerprint.

Cite this