Information Theory and Language
"Information Theory and Language" is a collection of 12 articles that appeared recently in Entropy as part of a Special Issue of the same title. These contributions represent state-of-the-art interdisciplinary research at the interface of information theory and language studies. They conce...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | eBook |
| Language: | English |
| Published: |
Basel, Switzerland
MDPI - Multidisciplinary Digital Publishing Institute
2020
|
| Subjects: | |
| Online Access: | |
| Collection: | Directory of Open Access Books - Collection details see MPG.ReNa |
| Summary: | "Information Theory and Language" is a collection of 12 articles that appeared recently in Entropy as part of a Special Issue of the same title. These contributions represent state-of-the-art interdisciplinary research at the interface of information theory and language studies. They concern in particular: • Applications of information theoretic concepts such as Shannon and Rényi entropies, mutual information, and rate-distortion curves to the research of natural languages; • Mathematical work in information theory inspired by natural language phenomena, such as deriving moments of subword complexity or proving continuity of mutual information; • Empirical and theoretical investigation of quantitative laws of natural language such as Zipf's law, Herdan's law, and Menzerath-Altmann's law; • Empirical and theoretical investigations of statistical language models, including recently developed neural language models, their entropies, and other parameters; • Standardizing language resources for statistical investigation of natural language; • Other topics concerning semantics, syntax, and critical phenomena. Whereas the traditional divide between probabilistic and formal approaches to human language, cultivated in the disjoint scholarships of natural sciences and humanities, has been blurred in recent years, this book can contribute to pointing out potential areas of future research cross-fertilization. |
|---|---|
| Item Description: | Creative Commons (cc), https://creativecommons.org/licenses/by/4.0/ |
| Physical Description: | 1 electronic resource (244 p.) |
| ISBN: | 9783039360277 9783039360260 books978-3-03936-027-7 |