In our trial of a double-blind procedure for peer review, authors' awareness of their peer-review choices in the early stages of writing a paper is key for their decision to opt in or out.
Half a year ago, Nature Geoscience and Nature Climate Change started to offer authors the option to remain anonymous to referees ('double-blind review'). We intended to remove at least some of the bias associated with affiliation, personal reputation, gender or nationality from the peer review process (Nature Geosci. 6, 413; 2013). Since then, we have gathered numbers on submission and participation, as well as authors' opinions, to get a better idea of what influences our authors' choice to opt in or out. Intriguingly, although three quarters of respondents in our 2012 reader survey supported the principle of double-blind peer review (Nature Geosci. 5, 585; 2012), participation so far has amounted to only about 15% of authors overall.
The discrepancy made us curious. To understand the numbers better, we have been (and still are) inviting the corresponding authors of all submissions to Nature Geoscience and Nature Climate Change to complete a short survey on peer review, with a specific focus on our trial of the double-blind procedure. It turns out that a significant stumbling block to participation in the trial is the necessity for authors to ensure the paper does not reveal their identity. Very few authors knew before they started writing their papers (or early on in the process) that they were going to have the choice to go double-blind. Understandably, those who did not know about this option were reluctant to delay their submission once they had finalized their manuscript and were asked to choose between the double-blind and traditional peer-review options.
Time, together with further efforts from us to make the trial better known, should help raise awareness with those in the critical early phases of writing a paper. We take heart from the fact that more than half of those who chose the traditional peer-review process this time said they were quite likely or very likely to go for the double-blind process next time they submit to Nature Geoscience or Nature Climate Change — now they know that they have the option.
Other more systematic criticisms of the trial were also raised in the survey. To us, the most significant objection was that a double-blind peer review system works best when it is mandatory, rather than optional as in our trial. As one survey participant put it: “Those likely to benefit from their institutional affiliations and reputations will choose single-blind and still benefit from that discrimination.” We would not take the step of making double-blind review mandatory without strong demand from the community. However, we feel that this objection will become less important once a higher proportion of manuscripts take part in the trial.
About a quarter of the approximately 50 authors who filled in our survey before the cut-off date for this Editorial had chosen the double-blind peer review option — a higher, but not much higher proportion than the 15% of authors who participated in the trial overall. As such, despite some skew towards supporters of author anonymity in the survey, we are encouraged by the fact that almost all respondents agreed that the trial should continue.
From the responses we received, we gather that what is most needed is a higher awareness of the option earlier on in the writing process. Along this line, we encourage all our readers to discuss the trial with their colleagues.