Modelling the effects of subjective and objective decision making in scientific peer review

In-Uck Park, M W Peacey, Marcus Munafo

Research output: Contribution to journalLetterpeer-review

67 Citations (SciVal)


The objective of science is to advance knowledge, primarily in two interlinked ways: circulating ideas, and defending or criticizing the ideas of others. Peer review acts as the gatekeeper to these mechanisms. Given the increasing concern surrounding the reproducibility of much published research, it is critical to understand whether peer review is intrinsically susceptible to failure, or whether other extrinsic factors are responsible that distort scientists' decisions. Here we show that even when scientists are motivated to promote the truth, their behaviour may be influenced, and even dominated, by information gleaned from their peers' behaviour, rather than by their personal dispositions. This phenomenon, known as herding, subjects the scientific community to an inherent risk of converging on an incorrect answer and raises the possibility that, under certain conditions, science may not be self-correcting. We further demonstrate that exercising some subjectivity in reviewer decisions, which serves to curb the herding process, can be beneficial for the scientific community in processing available information to estimate truth more accurately. By examining the impact of different models of reviewer decisions on the dynamic process of publication, and thereby on eventual aggregation of knowledge, we provide a new perspective on the ongoing discussion of how the peer-review process may be improved.
Original languageEnglish
Pages (from-to)93-96
Number of pages4
Issue number7486
Early online date4 Dec 2013
Publication statusPublished - 6 Feb 2014


Dive into the research topics of 'Modelling the effects of subjective and objective decision making in scientific peer review'. Together they form a unique fingerprint.

Cite this