We wrote this book to introduce graduate students and research workers in var ious scientific disciplines to the use of information-theoretic approaches in the analysis of empirical data. In its fully developed form, the information-theoretic approach allows inference based on more than one model (including estimates of unconditional precision); in its initial form, it is useful in selecting a "best" model and ranking the remaining models. We believe that often the critical issue in data analysis is the selection of a good approximating model that best represents the inference supported by the data (an estimated "best approximating model"). In formation theory includes the well-known Kullback-Leibler "distance" between two models (actually, probability distributions), and this represents a fundamental quantity in science. In 1973, Hirotugu Akaike derived an estimator of the (relative) Kullback-Leibler distance based on Fisher's maximized log-likelihood. His mea sure, now called Akaike 's information criterion (AIC), provided a new paradigm for model selection in the analysis of empirical data. His approach, with a funda mental link to information theory, is relatively simple and easy to use in practice, but little taught in statistics classes and far less understood in the applied sciences than should be the case. We do not accept the notion that there is a simple, "true model" in the biological sciences.
Statisticians and applied scientists often must select a model to fit empirical data. This book introduces researchers and graduate students in many areas to an information criterion approach, first introduced by Hirotugu Akaike in 1973. The book will be of general interest, but the emphasis is on applications to the biological sciences.
Kenneth P. Burnham
Inference Likelihood Model Selection data analysis information theory optimization statistics
From the reviews of the second edition:
Burnham and Anderson (eschew) P-values completely and (focus) entirely on how to decide when a model or models adequately fits the data. In essence, this is what an ecologist wants to know-how do predictive models work? This simple categorization, however, belies the conceptual richness that Burnham and Anderson present in their book, and its importance." (Ecology)
"Bolstered by a new chapter and an additional 140 pages, this very specialized book is now quite a sizable affair in its second edition … . Subtitled ‘A Practical Information-Theoretic Approach,’ the book is built on the use of the Kullback-Leibler distance approach for multimodel inference. … The enthusiasm of the authors for their subject is apparent from the effort that they have made to extensively revise what already was a very unique book … ." (Technometrics, Vol. 54 (2), May, 2003)