Dynamic decision-making in uncertain environments I. The principle of dynamic utility

Abstract

Understanding the dynamics or sequences of animal behavior usually involves the application of either dynamic programming or stochastic control methodologies. A difficulty of dynamic programming lies in interpreting numerical output, whereas even relatively simple models of stochastic control are notoriously difficult to solve. Here we develop the theory of dynamic decision-making under probabilistic conditions and risks, assuming individual growth rates of body size are expressed as a simple stochastic process. From our analyses we then derive the optimization of dynamic utility, in which the utility of weight gain, given the current body size, is a logarithmic function: hence the fitness function of an individual varies depending on its current body size. The dynamic utility function also shows that animals are universally sensitive to risk and display risk-averse behaviors. Our result proves the traditional use of expected utility theory and game theory in behavioral studies is valid only as a static model.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 11 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.