TR2013-003

Fast Runcurve Optimization based on Markov Decision Process


    •  Fujii, S.; Yoshimoto, K.; Ueda, K.; Takahashi, S.; Nikovski, D., "Fast Runcurve Optimization based on Markov Decision Process", Symposium of the Society of Instrumentation and Control Engineers of Japan (SICE), January 2013.
      BibTeX Download PDF
      • @inproceedings{Fujii2013jan,
      • author = {Fujii, S. and Yoshimoto, K. and Ueda, K. and Takahashi, S. and Nikovski, D.},
      • title = {Fast Runcurve Optimization based on Markov Decision Process},
      • booktitle = {Symposium of the Society of Instrumentation and Control Engineers of Japan (SICE)},
      • year = 2013,
      • month = jan,
      • url = {http://www.merl.com/publications/TR2013-003}
      • }
  • MERL Contact:

This paper proposes a fast algorithm to solve runcurve optimization problem. We model the problem with Marcov decision process in which cost function is defined by a weighted sum of energy consumption and running time, select appropriate weight values, and compute optimal runcurve with dynamic programming. We have confirmed that the proposed algorithm could optimize runcurve of 2,000m within around 1 sec by simulation results.