Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems
Buch in deiner Nähe kaufen
Beschreibung
The book provides a timely coverage of the paradigm of knowledge distillation—an efficient way of model compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a variety of training schemes, teacher–student architectures, and distillation algorithms. The book covers a wealth of topics including recent developments in vision and language learning, relational architectures, multi-task learning, and representative applications to image processing, computer vision, edge intelligence, and autonomous systems. The book is of relevance to a broad audience including researchers and practitioners active in the area of machine learning and pursuing fundamental and applied research in the area of advanced learning paradigms.
The book provides a timely coverage of the paradigm of knowledge distillation—an efficient way of model compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a variety of training schemes, teacher–student architectures, and distillation algorithms. The book covers a wealth of topics including recent developments in vision and language learning, relational architectures, multi-task learning, and representative applications to image processing, computer vision, edge intelligence, and autonomous systems. The book is of relevance to a broad audience including researchers and practitioners active in the area of machine learning and pursuing fundamental and applied research in the area of advanced learning paradigms.
Comprehensive and up-to-date treatise of knowledge distillation cast in a general framework of transfer learning Focuses on a spectrum of methodological and algorithmic issues Includes recent developments in vision and language learning and relational architectures
Autor*in
Witold Pedrycz
Themen in »Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems«
Knowledge Distillation Intelligent Systems Distillation Learning