### Abstract

goodness-of-fit and estimation, a fundamental issue in statistical inference. A geometric analysis of simple, yet representative, models involving the same population parameter compellingly establishes the main theme of the paper: namely, that goodness-of-fit is necessary but not sufficient for model selection. Visual examples vividly communicate this. Specifically, for a given estimation problem, we define a class of least-informative models, linking these to both nonparametric and maximum entropy methods. Any other model is then seen to involve an informative rotation, often embodying extra-data considerations. We also look at the way that translation of models generates a form of bias-variance trade-off. Overall, our approach is a global extension of pioneering local work by Copas and Eguchi which, we note, was also geometrically inspired.

Original language | English |
---|---|

Title of host publication | Computational Information Geometry |

Subtitle of host publication | For Image and Signal Processing |

Editors | Frank Nielsen, Kit Dodson, Frank Critchley |

Publisher | Springer |

Pages | 63-77 |

ISBN (Electronic) | 9783319470580 |

ISBN (Print) | 9783319470566 |

Publication status | Published - 2017 |

### Publication series

Name | Signals and Communication Technology |
---|

### Fingerprint

### Cite this

*Computational Information Geometry : For Image and Signal Processing*(pp. 63-77). (Signals and Communication Technology). Springer.

**On the geometric interplay between goodness-of-fit and estimation: Illustrative examples.** / Anaya-Izquierdo, Karim; Marriott, Paul; Vos, Paul; Critchley, Frank.

Research output: Chapter in Book/Report/Conference proceeding › Chapter

*Computational Information Geometry : For Image and Signal Processing.*Signals and Communication Technology, Springer, pp. 63-77.

}

TY - CHAP

T1 - On the geometric interplay between goodness-of-fit and estimation: Illustrative examples

AU - Anaya-Izquierdo, Karim

AU - Marriott, Paul

AU - Vos, Paul

AU - Critchley, Frank

PY - 2017

Y1 - 2017

N2 - We show how information geometry throws new light on the interplay betweengoodness-of-fit and estimation, a fundamental issue in statistical inference. A geometric analysis of simple, yet representative, models involving the same population parameter compellingly establishes the main theme of the paper: namely, that goodness-of-fit is necessary but not sufficient for model selection. Visual examples vividly communicate this. Specifically, for a given estimation problem, we define a class of least-informative models, linking these to both nonparametric and maximum entropy methods. Any other model is then seen to involve an informative rotation, often embodying extra-data considerations. We also look at the way that translation of models generates a form of bias-variance trade-off. Overall, our approach is a global extension of pioneering local work by Copas and Eguchi which, we note, was also geometrically inspired.

AB - We show how information geometry throws new light on the interplay betweengoodness-of-fit and estimation, a fundamental issue in statistical inference. A geometric analysis of simple, yet representative, models involving the same population parameter compellingly establishes the main theme of the paper: namely, that goodness-of-fit is necessary but not sufficient for model selection. Visual examples vividly communicate this. Specifically, for a given estimation problem, we define a class of least-informative models, linking these to both nonparametric and maximum entropy methods. Any other model is then seen to involve an informative rotation, often embodying extra-data considerations. We also look at the way that translation of models generates a form of bias-variance trade-off. Overall, our approach is a global extension of pioneering local work by Copas and Eguchi which, we note, was also geometrically inspired.

M3 - Chapter

SN - 9783319470566

T3 - Signals and Communication Technology

SP - 63

EP - 77

BT - Computational Information Geometry

A2 - Nielsen, Frank

A2 - Dodson, Kit

A2 - Critchley, Frank

PB - Springer

ER -