Many granting agencies allow reviewers to know the identity of a proposal’s principal investigator (PI), which opens the possibility that reviewers discriminate on the basis of PI race and gender. We investigated this experimentally with 48 NIH R01 grant proposals, representing a broad range of NIH-funded science. We modified PI names to create separate white male, white female, black male and black female versions of each proposal, and 412 scientists each submitted initial reviews for 3 proposals. We find little to no race or gender bias in initial R01 evaluations, and additionally find that any bias that might have been present must be negligible in size. This conclusion was robust to a wide array of statistical model specifications. Pragmatically, important bias may be present in other aspects of the granting process, but our evidence suggests that it is not present in the initial round of R01 reviews.
Access optionsAccess options
Subscribe to Journal
Get full journal access for 1 year
only $8.67 per issue
All prices are NET prices.
VAT will be added later in the checkout.
Rent or Buy article
Get time limited or full article access on ReadCube.
All prices are NET prices.
All code used in this paper can be accessed at our project page at https://osf.io/c5csm/
Our data and materials have been deposited at https://osf.io/uy7vq/, which also includes our preregistered protocol. The modified grant proposals have not been deposited for confidentiality reasons. Modified grant proposals can be obtained by contacting the corresponding authors, who will seek permission to share these materials from the research teams that prepared the proposals.
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
We acknowledge E. Brandt, K. Lange, D. (Dianne) Lee, J. Marsh, V. Martinez, C. Mitamura, N. Mohan, Y. Lee, C. Henriques, R. Grzenia, K. Scott, S. Staples, D. Statz and P. Rienke for their help in conducting this research. We also acknowledge M. Carnes, C. Ford, A. Kaatz and J. Raclaw for their help in the design of the research. Finally, we acknowledge J. Westfall for his helpful comments on our analyses and J. Fox for his advice on the car package. This research was supported by NIH grant 5R01GM111002-02 to P.G.D. Part of this research was conducted using technical resources provided by the Open Science Grid25,26, which is supported by the National Science Foundation award 1148698 and the US Department of Energy’s Office of Science. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.