Advancements in Knowledge Distillation: Towards New Horizons of Intelligent Systems
The book provides a timely coverage of the paradigm of knowledge distillation—an efficient way of model compression. Knowledge distillation is positioned in a general setting of transfer learning, which effectively learns a lightweight student model from a large teacher model. The book covers a vari...
| Other Authors: | , |
|---|---|
| Format: | eBook |
| Language: | English |
| Published: |
Cham
Springer International Publishing
2023, 2023
|
| Edition: | 1st ed. 2023 |
| Series: | Studies in Computational Intelligence
|
| Subjects: | |
| Online Access: | |
| Collection: | Springer eBooks 2005- - Collection details see MPG.ReNa |
Table of Contents:
- Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation
- A Geometric Perspective on Feature-Based Distillation
- Knowledge Distillation Across Vision and Language
- Knowledge Distillation in Granular Fuzzy Models by Solving Fuzzy Relation Equations
- Ensemble Knowledge Distillation for Edge Intelligence in Medical Applications
- Self-Distillation with the New Paradigm in Multi-Task Learning
- Knowledge Distillation for Autonomous Intelligent Unmanned System