Optimization of Stochastic Discrete Systems and Control on Complex Networks
Computational Networks
Buch in deiner Nähe kaufen
Beschreibung
This book presents the latest findings on stochastic dynamic programming models and on solving optimal control problems in networks. It includes the authors’ new findings on determining the optimal solution of discrete optimal control problems in networks and on solving game variants of Markov decision problems in the context of computational networks. First, the book studies the finite state space of Markov processes and reviews the existing methods and algorithms for determining the main characteristics in Markov chains, before proposing new approaches based on dynamic programming and combinatorial methods. Chapter two is dedicated to infinite horizon stochastic discrete optimal control models and Markov decision problems with average and expected total discounted optimization criteria, while Chapter three develops a special game-theoretical approach to Markov decision processes and stochastic discrete optimal control problems. In closing, the book’s final chapter is devoted to finite horizon stochastic control problems and Markov decision processes. The algorithms developed represent a valuable contribution to the important field of computational network theory.
This book presents the latest findings on stochastic dynamic programming models and on solving optimal control problems in networks. It includes the authors’ new findings on determining the optimal solution of discrete optimal control problems in networks and on solving game variants of Markov decision problems in the context of computational networks. First, the book studies the finite state space of Markov processes and reviews the existing methods and algorithms for determining the main characteristics in Markov chains, before proposing new approaches based on dynamic programming and combinatorial methods. Chapter two is dedicated to infinite horizon stochastic discrete optimal control models and Markov decision problems with average and expected total discounted optimization criteria, while Chapter three develops a special game-theoretical approach to Markov decision processes and stochastic discrete optimal control problems. In closing, the book’s final chapter is devoted to finite horizon stochastic control problems and Markov decision processes. The algorithms developed represent a valuable contribution to the important field of computational network theory.
Systematizes the most important existing methods of stochastic dynamic optimization Describes new algorithms for solving different classes of stochastic dynamic programming problems Presents methods to solve practical decision problems from diverse areas such as ecology, economics, engineering and communication systems Includes supplementary material: sn.pub/extras
Autor*in
Dmitrii Lozovanu
Themen in »Optimization of Stochastic Discrete Systems and Control on Complex Networks«
Complex networks Discrete optimal control Game theory Linear programming Markov decision process Stochastic dynamic programming algorithm analysis and problem complexity
Stimmen zu »Optimization of Stochastic Discrete Systems and Control on Complex Networks«
“This book contributes to the systematization of the most relevant existing methods for these problems by introducing new algorithms for solving different classes of stochastic dynamic programming problems. … The mathematical and computational level of the book will enable students and practitioners to deepen their understanding of the topic. Numerous examples are included to illustrate the proposed algorithms and methods.” (Rosario Romera, Mathematical Reviews, July, 2015)
()