Stochastic Approximation: A Dynamical Systems Viewpoint

Beschreibung

This book serves as an advanced text for a graduate course on stochastic algorithms for the students of probability and statistics, engineering, economics and machine learning. This second edition gives a comprehensive treatment of stochastic approximation algorithms based on the ordinary differential equation (ODE) approach which analyses the algorithm in terms of a limiting ODE. It has a streamlined treatment of the classical convergence analysis and includes several recent developments such as concentration bounds, avoidance of traps, stability tests, distributed and asynchronous schemes, multiple time scales, general noise models, etc., and a category-wise exposition of many important applications. It is also a useful reference for researchers and practitioners in the field.
This book serves as an advanced text for a graduate course on stochastic algorithms for the students of probability and statistics, engineering, economics and machine learning. This second edition gives a comprehensive treatment of stochastic approximation algorithms based on the ordinary differential equation (ODE) approach which analyses the algorithm in terms of a limiting ODE. It has a streamlined treatment of the classical convergence analysis and includes several recent developments such as concentration bounds, avoidance of traps, stability tests, distributed and asynchronous schemes, multiple time scales, general noise models, etc., and a category-wise exposition of many important applications. It is also a useful reference for researchers and practitioners in the field.
Presents a comprehensive view of the ODE-based approach for the analysis of stochastic approximation algorithms Discusses important themes on stability tests, concentration bounds, and avoidance of traps Covers very recent developments with copious pointers to related literature

Autor*in

Vivek S. Borkar

Themen in »Stochastic Approximation: A Dynamical Systems Viewpoint«

stochastic approximation learning algorithms adaptive algorithms ODE approach to stochastic approximation dynamical systems view of algorithms sequential statistical methods artificial intelligence probability theory game theory control theory

Stimmen zu »Stochastic Approximation: A Dynamical Systems Viewpoint«

“This book is best suited for advanced readers with backgrounds in probability theory and dynamical systems, though its clear exposition makes it a valuable reference for researchers and practitioners interested in stochastic optimization and learning algorithms. A highly recommended read for those working in machine learning, engineering, and mathematical optimization.” (Pagadala Usha, Computing Reviews, March 27, 2025)

Details

Link teilen