Reinforcement learning in professional basketball players

Abstract

Reinforcement learning in complex natural environments is a challenging task because the agent should generalize from the outcomes of actions taken in one state of the world to future actions in different states of the world. The extent to which human experts find the proper level of generalization is unclear. Here we show, using the sequences of field goal attempts made by professional basketball players, that the outcome of even a single field goal attempt has a considerable effect on the rate of subsequent 3 point shot attempts, in line with standard models of reinforcement learning. However, this change in behaviour is associated with negative correlations between the outcomes of successive field goal attempts. These results indicate that despite years of experience and high motivation, professional players overgeneralize from the outcomes of their most recent actions, which leads to decreased performance. Reinforcement learning quantifies the change in behaviour in response to past experience. Using field goal attempt data from basketball, Neiman and Loewenstein demonstrate that even one failed or made attempt has an impact on subsequent attempts, showing that players overgeneralize from their most recent actions.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 70 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.