What Are Dynamic Optimization Problems?

Haobo Fu, Peter R. Lewis, Bernhard Sendhoff, Ke Tang and Xin Yao
In Proceedings of the IEEE Congress on Evolutionary Computation (CEC) 2014, pp 1550-1557. IEEE Press, 2014.

Dynamic Optimization Problems (DOPs) have been widely studied using Evolutionary Algorithms (EAs). Yet, a clear and rigorous definition of DOPs is lacking in the Evolutionary Dynamic Optimization (EDO) community. In this paper, we propose a unified definition of DOPs based on the idea of multiple-decision-making discussed in the Reinforcement Learning (RL) community. We draw a connection between EDO and RL by arguing that both of them are studying DOPs according to our definition of DOPs. We point out that existing EDO or RL research has been mainly focused on some types of DOPs. A conceptualized benchmark problem, which is aimed at the systematic study of various DOPs, is then developed. Some interesting experimental studies on the benchmark reveal that EDO and RL methods are specialized in certain types of DOPs and more importantly new algorithms for DOPs can be developed by combining the strength of both EDO and RL methods.

title = "What Are Dynamic Optimization Problems?",
booktitle = "Proceedings of the 2014 IEEE Congress on Evolutionary Computation (CEC)",
author = "Haobo Fu and Peter R. Lewis and Bernhard Sendhoff and Ke Tang and Xin Yao",
publisher = "IEEE Press",
year = "2014",
pages = {1550--1557}