← Back to browse

An experimental test of the effects of competition for priority on information sampling

AuthorsLeo TiokhinMaxime Derex
Year2018
VenueOSF
PublisherLeo Tiokhin, Maxime Derex

Incentive structures shape scientists' research practices. One incentive in science is the priority rule, which allocates disproportionate rewards to the first scientist to discover a novel result. Priority rewards create a "race to publish," encouraging scientists to work quickly. To test whether this rush reduces the amount of information scientists collect before publishing, we developed a laboratory experiment in which participants played a research game. Players could choose how much information to acquire before making a claim, balancing the cost and benefits of gathering more data against the risk of being scooped by a competitor. We found that competition for priority led participants to collect significantly less information before publishing compared to non-competitive conditions, which resulted in a higher rate of false claims. Our experiment provides proof of concept that rewarding priority of publication can incentivize individuals to acquire less information, producing lower-quality research as a consequence.

Tags

RSOSStage 1 Manuscript
AuthorsLeonid TiokhinMaxime Derex
Year2019
VenueRoyal Society Open Science

Incentive structures shape scientists' research practices. One incentive in particular, rewarding priority of publication, is hypothesized to harm scientific reliability by promoting rushed, low-quality research. Here, we develop a laboratory experiment to test whether competition affects information sampling and guessing accuracy in a game that mirrors aspects of scientific investigation. In our experiment, individuals gather data in order to guess true states of the world and face a tradeoff between guessing quickly and increasing accuracy by acquiring more information. To test whether competition affects accuracy, we compare a treatment in which individuals are rewarded for each correct guess to a treatment where individuals face the possibility of being ‘scooped’ by a competitor. In a second set of conditions, we make information acquisition contingent on solving arithmetic problems to test whether competition increases individual effort (i.e. arithmetic-problem solving speed). We find that competition causes individuals to make guesses using less information, thereby reducing their accuracy (H1a and H1b confirmed). We find no evidence that competition increases individual effort (H2, inconclusive evidence). Our experiment provides proof of concept that rewarding priority of publication can incentivize individuals to acquire less information, producing lower-quality research as a consequence.

Tags

RSOSStage 1 LinkedStage 2 Manuscript
i