Introduction to Part I

Rational and optimal decision making

Anil K. Seth, Tony J. Prescott, Joanna J. Bryson

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

When an animal does one thing rather than another, it is natural to ask ‘why?’ A common explanation is that the action is optimal with respect to some goal. For example, when observing the foraging behaviour of a shorebird, one may ask whether the intake of food is being maximised. This ‘normative’ view, a direct extension of Darwinian principles, has its more recent roots in behavioural ecology (Krebs and Davies, 1997) and optimal foraging theory (Stephens and Krebs, 1986). Adopting a normative perspective on action selection can be very useful in placing constraints on possible underlying mechanisms, for developing and comparing theoretical frameworks relating behaviour to mechanism, and for explaining instances of apparently irrational or suboptimal behaviour. The seven chapters within this section present new insights and modelling results relevant to each of these issues. They also connect with the other parts of this book in important ways. The constraints on underlying mechanisms are thoroughly explored by the computational neuroscience models described in Part II, and patterns of both rational and irrational social behaviour are encountered in a variety of forms in Part III. Suboptimality and ‘matching’: Assessing animal behaviour from a normative perspective has particular value when observations deviate from predictions, because the scientist is now forced to consider the origin of the apparently suboptimal – or ‘irrational’ – behaviour. In one important example, many animals behave according to Herrnstein's (1961) ‘matching law’, in which responses are allocated in proportion to the reward obtained from each response. However, as both Houston et al. (this volume) and Seth (this volume) note, matching is not always optimal. One response to this observation is to propose that suboptimal matching arises as a side-effect of some underlying principle of behaviour, such as Thorndike's ‘law of effect’, which proposes that behaviour shifts towards alternatives that have higher immediate value (Thorndike, 1911). Another is given by the notion of ecological rationality – that cognitive mechanisms fit the demands of particular ecological niches and may deliver predictably suboptimal behaviour when operating outside these niches (Gigerenzer et al., 1999). In line with ecological rationality, Seth (this volume) shows that simple decision rules that lead to optimal foraging in competitive environments with multiple foragers also lead individual foragers to obey the matching law. The remainder of Seth's chapter describes a novel methodological approach that combines agent-based modelling and optimal/normative approaches via the use of genetic algorithms. The resulting approach, which is given the label ‘optimal agent-based modelling’, achieves the important task of integrating function and mechanism in explanations of action selection (McNamara and Houston, 2009).

Original languageEnglish
Title of host publicationModelling Natural Action Selection
EditorsA. K. Seth, T. J. Prescott, J. J. Bryson
PublisherCambridge University Press
Pages7-11
Number of pages5
ISBN (Electronic)9780511731525
ISBN (Print)9781107000490
DOIs
Publication statusPublished - 1 Jan 2011

Fingerprint

Decision Making
Systems Analysis
Animal Behavior
Social Behavior
Neurosciences
Ecology
Reward
Eating

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Seth, A. K., Prescott, T. J., & Bryson, J. J. (2011). Introduction to Part I: Rational and optimal decision making. In A. K. Seth, T. J. Prescott, & J. J. Bryson (Eds.), Modelling Natural Action Selection (pp. 7-11). Cambridge University Press. https://doi.org/10.1017/CBO9780511731525.005

Introduction to Part I : Rational and optimal decision making. / Seth, Anil K.; Prescott, Tony J.; Bryson, Joanna J.

Modelling Natural Action Selection. ed. / A. K. Seth; T. J. Prescott; J. J. Bryson. Cambridge University Press, 2011. p. 7-11.

Research output: Chapter in Book/Report/Conference proceedingChapter

Seth, AK, Prescott, TJ & Bryson, JJ 2011, Introduction to Part I: Rational and optimal decision making. in AK Seth, TJ Prescott & JJ Bryson (eds), Modelling Natural Action Selection. Cambridge University Press, pp. 7-11. https://doi.org/10.1017/CBO9780511731525.005
Seth AK, Prescott TJ, Bryson JJ. Introduction to Part I: Rational and optimal decision making. In Seth AK, Prescott TJ, Bryson JJ, editors, Modelling Natural Action Selection. Cambridge University Press. 2011. p. 7-11 https://doi.org/10.1017/CBO9780511731525.005
Seth, Anil K. ; Prescott, Tony J. ; Bryson, Joanna J. / Introduction to Part I : Rational and optimal decision making. Modelling Natural Action Selection. editor / A. K. Seth ; T. J. Prescott ; J. J. Bryson. Cambridge University Press, 2011. pp. 7-11
@inbook{bd235d2d3f044ae38e69a90a80502305,
title = "Introduction to Part I: Rational and optimal decision making",
abstract = "When an animal does one thing rather than another, it is natural to ask ‘why?’ A common explanation is that the action is optimal with respect to some goal. For example, when observing the foraging behaviour of a shorebird, one may ask whether the intake of food is being maximised. This ‘normative’ view, a direct extension of Darwinian principles, has its more recent roots in behavioural ecology (Krebs and Davies, 1997) and optimal foraging theory (Stephens and Krebs, 1986). Adopting a normative perspective on action selection can be very useful in placing constraints on possible underlying mechanisms, for developing and comparing theoretical frameworks relating behaviour to mechanism, and for explaining instances of apparently irrational or suboptimal behaviour. The seven chapters within this section present new insights and modelling results relevant to each of these issues. They also connect with the other parts of this book in important ways. The constraints on underlying mechanisms are thoroughly explored by the computational neuroscience models described in Part II, and patterns of both rational and irrational social behaviour are encountered in a variety of forms in Part III. Suboptimality and ‘matching’: Assessing animal behaviour from a normative perspective has particular value when observations deviate from predictions, because the scientist is now forced to consider the origin of the apparently suboptimal – or ‘irrational’ – behaviour. In one important example, many animals behave according to Herrnstein's (1961) ‘matching law’, in which responses are allocated in proportion to the reward obtained from each response. However, as both Houston et al. (this volume) and Seth (this volume) note, matching is not always optimal. One response to this observation is to propose that suboptimal matching arises as a side-effect of some underlying principle of behaviour, such as Thorndike's ‘law of effect’, which proposes that behaviour shifts towards alternatives that have higher immediate value (Thorndike, 1911). Another is given by the notion of ecological rationality – that cognitive mechanisms fit the demands of particular ecological niches and may deliver predictably suboptimal behaviour when operating outside these niches (Gigerenzer et al., 1999). In line with ecological rationality, Seth (this volume) shows that simple decision rules that lead to optimal foraging in competitive environments with multiple foragers also lead individual foragers to obey the matching law. The remainder of Seth's chapter describes a novel methodological approach that combines agent-based modelling and optimal/normative approaches via the use of genetic algorithms. The resulting approach, which is given the label ‘optimal agent-based modelling’, achieves the important task of integrating function and mechanism in explanations of action selection (McNamara and Houston, 2009).",
author = "Seth, {Anil K.} and Prescott, {Tony J.} and Bryson, {Joanna J.}",
year = "2011",
month = "1",
day = "1",
doi = "10.1017/CBO9780511731525.005",
language = "English",
isbn = "9781107000490",
pages = "7--11",
editor = "Seth, {A. K.} and Prescott, {T. J.} and Bryson, {J. J.}",
booktitle = "Modelling Natural Action Selection",
publisher = "Cambridge University Press",
address = "UK United Kingdom",

}

TY - CHAP

T1 - Introduction to Part I

T2 - Rational and optimal decision making

AU - Seth, Anil K.

AU - Prescott, Tony J.

AU - Bryson, Joanna J.

PY - 2011/1/1

Y1 - 2011/1/1

N2 - When an animal does one thing rather than another, it is natural to ask ‘why?’ A common explanation is that the action is optimal with respect to some goal. For example, when observing the foraging behaviour of a shorebird, one may ask whether the intake of food is being maximised. This ‘normative’ view, a direct extension of Darwinian principles, has its more recent roots in behavioural ecology (Krebs and Davies, 1997) and optimal foraging theory (Stephens and Krebs, 1986). Adopting a normative perspective on action selection can be very useful in placing constraints on possible underlying mechanisms, for developing and comparing theoretical frameworks relating behaviour to mechanism, and for explaining instances of apparently irrational or suboptimal behaviour. The seven chapters within this section present new insights and modelling results relevant to each of these issues. They also connect with the other parts of this book in important ways. The constraints on underlying mechanisms are thoroughly explored by the computational neuroscience models described in Part II, and patterns of both rational and irrational social behaviour are encountered in a variety of forms in Part III. Suboptimality and ‘matching’: Assessing animal behaviour from a normative perspective has particular value when observations deviate from predictions, because the scientist is now forced to consider the origin of the apparently suboptimal – or ‘irrational’ – behaviour. In one important example, many animals behave according to Herrnstein's (1961) ‘matching law’, in which responses are allocated in proportion to the reward obtained from each response. However, as both Houston et al. (this volume) and Seth (this volume) note, matching is not always optimal. One response to this observation is to propose that suboptimal matching arises as a side-effect of some underlying principle of behaviour, such as Thorndike's ‘law of effect’, which proposes that behaviour shifts towards alternatives that have higher immediate value (Thorndike, 1911). Another is given by the notion of ecological rationality – that cognitive mechanisms fit the demands of particular ecological niches and may deliver predictably suboptimal behaviour when operating outside these niches (Gigerenzer et al., 1999). In line with ecological rationality, Seth (this volume) shows that simple decision rules that lead to optimal foraging in competitive environments with multiple foragers also lead individual foragers to obey the matching law. The remainder of Seth's chapter describes a novel methodological approach that combines agent-based modelling and optimal/normative approaches via the use of genetic algorithms. The resulting approach, which is given the label ‘optimal agent-based modelling’, achieves the important task of integrating function and mechanism in explanations of action selection (McNamara and Houston, 2009).

AB - When an animal does one thing rather than another, it is natural to ask ‘why?’ A common explanation is that the action is optimal with respect to some goal. For example, when observing the foraging behaviour of a shorebird, one may ask whether the intake of food is being maximised. This ‘normative’ view, a direct extension of Darwinian principles, has its more recent roots in behavioural ecology (Krebs and Davies, 1997) and optimal foraging theory (Stephens and Krebs, 1986). Adopting a normative perspective on action selection can be very useful in placing constraints on possible underlying mechanisms, for developing and comparing theoretical frameworks relating behaviour to mechanism, and for explaining instances of apparently irrational or suboptimal behaviour. The seven chapters within this section present new insights and modelling results relevant to each of these issues. They also connect with the other parts of this book in important ways. The constraints on underlying mechanisms are thoroughly explored by the computational neuroscience models described in Part II, and patterns of both rational and irrational social behaviour are encountered in a variety of forms in Part III. Suboptimality and ‘matching’: Assessing animal behaviour from a normative perspective has particular value when observations deviate from predictions, because the scientist is now forced to consider the origin of the apparently suboptimal – or ‘irrational’ – behaviour. In one important example, many animals behave according to Herrnstein's (1961) ‘matching law’, in which responses are allocated in proportion to the reward obtained from each response. However, as both Houston et al. (this volume) and Seth (this volume) note, matching is not always optimal. One response to this observation is to propose that suboptimal matching arises as a side-effect of some underlying principle of behaviour, such as Thorndike's ‘law of effect’, which proposes that behaviour shifts towards alternatives that have higher immediate value (Thorndike, 1911). Another is given by the notion of ecological rationality – that cognitive mechanisms fit the demands of particular ecological niches and may deliver predictably suboptimal behaviour when operating outside these niches (Gigerenzer et al., 1999). In line with ecological rationality, Seth (this volume) shows that simple decision rules that lead to optimal foraging in competitive environments with multiple foragers also lead individual foragers to obey the matching law. The remainder of Seth's chapter describes a novel methodological approach that combines agent-based modelling and optimal/normative approaches via the use of genetic algorithms. The resulting approach, which is given the label ‘optimal agent-based modelling’, achieves the important task of integrating function and mechanism in explanations of action selection (McNamara and Houston, 2009).

UR - http://www.scopus.com/inward/record.url?scp=84923623802&partnerID=8YFLogxK

U2 - 10.1017/CBO9780511731525.005

DO - 10.1017/CBO9780511731525.005

M3 - Chapter

SN - 9781107000490

SP - 7

EP - 11

BT - Modelling Natural Action Selection

A2 - Seth, A. K.

A2 - Prescott, T. J.

A2 - Bryson, J. J.

PB - Cambridge University Press

ER -