Abstract
A recent shift in public attention to racism, racial disparities, and health equity have resulted in an abundance of calls for relevant papers and publications in academic journals. Peer-review for such articles may be susceptible to bias, as subject matter expertise in the evaluation of social constructs, like race, is variable. From the perspective of researchers focused on neonatal health equity, we share our positive and negative experiences in peer-review, provide relevant publicly available data regarding addressing bias in peer-review from 12 neonatology-focused journals, and give recommendations to address bias and knowledge gaps in the peer review process of health equity research.
Similar content being viewed by others
Introduction
In response to the murders of Breonna Taylor and George Floyd there has been a shift in public and academic attention to address racism, racial disparities, and health equity. Health equity is achieved when every person has the ability to attain their health potential. One of many major barriers to health equity include racism, or discrimination on the basis of one’s racial group. Racism can be individualized, internalized, and systemic and all forms contribute to racial disparities in health outcomes. Systemic racism is a form of racism that is embedded in laws, policies, and institutions, including academic medicine, that has resulted in a disparate distribution of goods, services, and opportunities for racial groups [1]. Despite an abundance of calls for papers addressing health equity in major journals, the extent that reviewers and editors are adequately trained to critically evaluate the use of social constructs, like race, in research studies is highly variable. A major contributor to this knowledge deficit is the historical false belief in race as a biological construct by the scientific community and a paucity of published articles naming racism as a major driver of racial disparities [2, 3]. Omission of rigorous research standards for evaluating race and racism has contributed to harmful rhetoric such as the biologic fallacy of race [4].
In addition to knowledge gaps by reviewers regarding the evaluation of social variables like race, explicit or implicit bias can occur in the manuscript review process [5, 6], which may be more epitomized during peer review of articles focused on health equity that use social variables in their approach. For example, microaggressions are a form of discrimination defined as “slights” that communicate a negative attitude toward marginalized groups. Microaggressions disproportionately impact marginalized groups and are commonplace in the workforce’s daily lives; peer-review is no exception [7]. In order to combat bias in reviews, scholars have suggested diversification of editorial boards, as well as intentional recruitment, education, and compensation of diverse pools of peer reviewers [4, 8, 9]. Others have called for explicit standards for evaluation of race and ethnicity [4, 10, 11]. In light of these concerns, more recently, some journals have established new author guidelines for addressing race and racism [5, 12,13,14,15,16]. However, standardized criteria have not been agreed upon or adopted for many academic journals.
As health equity researchers in academic neonatology, we offer [1]. Our own personal positive and negative experiences within the last two years that highlight knowledge gaps and bias in the peer-review process [2]; A brief summary of publicly available data from major, neonatal-focused journals regarding existing processes to evaluate health equity research and address bias in the review process; and [3] Our recommendations for neonatology-focused journals regarding these aforementioned issues.
Our experiences in peer-review of neonatology-focused journals
Knowledge gaps during peer-review
“After submitting a study for peer review that tracked hospital practices by race/ethnicity and language, a reviewer argued there was no rationale as to why such disparities in hospital practices could exist and questioned why we chose to examine this. Denial of disparities in care quality by this reviewer suggested a significant knowledge gap of long-standing literature. I alerted my concern to the editor who omitted this review and sent it out to a different reviewer.”
“When exploring the experience of traditionally marginalized communities in a qualitative study, a reviewer suggested that to increase the validity of the study, we should compare the experience to the majority’s experience. Centering whiteness and white normativity was problematic in a study designed to center at the margins [17]. Following this comment, our team opted to include prose in the discussion about findings of previous studies focused on white populations. It was eventually published.”
“As a peer reviewer I suggested capitalizing the ‘b’ in Black when identifying race and to not use ‘Blacks’ when referring to Black persons. The authors responded that they preferred not to edit for readability, despite the possibility of offensive interpretation and accepted terminology.12 Upon re-review, the editor agreed and sent me a positive reply acknowledging the ‘teaching moment’ for the authors.”
Bias in the peer-review process
“I revealed my identity in a commentary and received an inappropriate comment during the review process. I did not know where to anonymously report my experience of discrimination to avoid worrying about my future relationship with the journal.”
Evaluation
To better understand the extent that journals serving the academic neonatology audience have guidance regarding evaluation of social variables, like race and ethnicity, in articles and processes to address bias in peer-review, we examined the websites of 12 major academic journals that publish in neonatology. Journals were chosen by combining our searches of academic journals with high frequency of neonatal-perinatal material based on a PubMed query (currently utilized by neopapers, an automated literature Twitter account that has been created to publish recent articles with content related to neonatology and an active account in the #neoTwitter community [18, 19]), and authors’ familiarity. Journal characteristics were created by the authors to evaluate previous commitment to health equity topics, transparency of diversity, equity, and inclusion issues, intention to diversify editorial staff, and existence of an anonymous system of reporting discrimination in peer review. No formal recommendations or regimented criteria exist to evaluate journal processes for inclusion of health equity content or bias in review, thus our evaluation metrics were developed through iterative discussion by authors and guidance from previous literature [2,3,4, 8,9,10].
We summarize findings in Table 1. We found that more than 75% of journals have published at least one original research, commentary, and perspective piece on health equity since journal conception, suggesting recognition of addressing social variables in neonatology journals. Regarding processes which may improve bias in peer-review more broadly, no journal had readily available data on racial, ethnic, or gender diversity of reviewers, editors, editorial board, but four (33%) had a statement of current efforts to diversify reviewers, editors, and/or editorial boards and only one (8%) journal provided information for how to apply to be an editorial board member on their website. Only one (8%) journal had a statement separate from Committee of Publication Ethics (COPE) guidelines for how to address bias in peer-review. COPE is an organization dedicated to providing resources and leadership on publication ethics which has recently published guidance on addressing bias in peer review. Although contact information was nearly always available for both editor-in-chief and members of the editorial board as a potential pathway to report discrimination (83% and 100% respectively), we could find no evidence of journals with a transparent system of anonymous peer review feedback to report racism, bias, or discrimination on their website.
Discussion
Our anecdotal experience and review of publicly available data from journal websites suggest that there is room for improvement to address knowledge gaps in peer-review of neonatology articles focused on health equity, which often utilize social variables like race and ethnicity in their methodology and therefore may increase potential for bias in the peer-review process. With heightened national attention on the role of race, racism, and other social factors on health outcomes, we anticipate that research in this area will continue to grow. Therefore, journal guidelines for authors and reviewers are needed to educate the neonatal research community and set standards on use of race and racism in research. While our experiences focus primarily on the social construct of race and ethnicity, we believe that our experiences and our recommendations may impact those doing research in other domains that also utilize social variables such as income, primary language, and immigration status.
Researchers also must be protected from discrimination and bias in the peer-review process. Few journals have made transparent efforts to diversify staff or develop mechanisms for providing anonymous feedback in the setting of perceived racism and discrimination in the review process. In our review, many journals have statements demonstrating commitment to adhere to COPE guidelines, which recently organized a Diversity Equity and Inclusion (DEI) committee that has provided resources and a commitment to addressing ethics and DEI for journals [20]. A few journals we evaluated have also signed the joint commitment for action on inclusion and diversity in publishing, launched in June 2020 by the Royal Society of Chemistry with ongoing efforts to set minimum standards for inclusion and diversity for scholarly publishing. Planned efforts include, but are not limited to, setting minimum targets to achieve diverse representation of authors, reviewers, and editorial boards, developing language standards, reviewing and revising editor and editorial board member selection processes, and publicly reporting their progress [21]. We are encouraged by the intention and progress made by several journals and publishing bodies, and hope to see fully transparent standards for DEI in the peer-review process across all neonatology publishing journals.
We consider the diversification of reviewer, editorial boards, and editors to be of particular importance for the health equity publication process in neonatology journals. Not only does the inclusion of perspectives of lived experience and participation in scholarly health equity activities advance the quality of work in our field, it also begins to address historical exclusion of minoritized individuals from scientific discourse [8, 10]. In our field, there continues to be underrepresentation of minoritized trainees and physicians scientists [22]. Harm during the peer review process can negatively impact the pursuit of antiracism and health equity work and disproportionately impacts minoritized researchers [10, 23]. Building infrastructure for transparency and accountability is necessary for ongoing publication of high quality health equity research [10]. We hope that our recommendations on how to improve the peer-review process in neonatology journals can help improve the trust of neonatal researchers and mitigate systemic inequities in publication in research focused on health equity.
Our review was limited to information readily available on journal websites. This may not fully encompass efforts made by academic journals to support health equity research and address bias in the peer-review process. The journal processes evaluated were designed by authors and thus are not previously validated and may not sufficiently evaluate the performance of journals. Our perspective piece does not compare the performance of neonatology journals, which tend to be clinically focused, to social science or public health focused journals. Performance in neonatology journals may be different from journals dedicated specifically to health equity. Regardless we see importance in addressing bias and knowledge gaps within our field while understanding challenges may be different or similar to other fields.
Recommendations
We offer the following recommendations to improve the peer-review process:
-
A standard of proficiency of reviewers in evaluation of social variables and constructs, including race and racism. While there are a few resources available that address this topic [4, 12,13,14,15, 24], it is unclear what standard exists or should be followed among neonatology journals. At minimum, we recommend statements that confer that race is a social construct without biological basis and explicitly stating racism as a primary etiology of racial disparities.
-
Transparency of current demographics of authors, reviewers, editorial boards, and editors. Although lack of diversity in academia is a widely known problem and we suspect it is no different in neonatology, the demographics of the participants in the peer-review process was not explicitly stated in the journals reviewed. Transparency offers a route towards accountability.
-
Diversification of reviewers, editorial boards, and editors with transparent, publicly announced target dates and goals.
-
Transparency, evaluation, and equal opportunity of editorial board selection process to facilitate diversification.
-
Recruitment and appropriate compensation for subject matter experts for time. We are not aware of any current resources or guidelines that define subject matter expertise prior to review. In the case of health equity research, lived experience should be recognized as a form of subject matter expertise. Similarly, we are not aware of resources to guide overall reviewer recruitment nor compensation for reviewers by journals. If compensation for peer review is not provided by journals, institutions should consider ways in which to support faculty and trainees who participate in the peer-review process through financial incentives, promotion, or other forms of meaningful recognition.
-
Standardized and robust training on an antiracism and the measurement and evaluation of social constructs in academic medicine and biomedical research that begins early and continues throughout professional careers.
-
Anonymous reporting mechanism for authors to report racism and/or other types of bias in the peer-review process
Data availability
All data generated and analyzed during this study are included in this published article.
References
Aspen Institute, Roundtable on Community Change. Structural racism and community building. Washington, D.C: Aspen Institute Roundtable on Community Change; 2004.
Hardeman RR, Murphy KA, Karbeah J, Kozhimannil KB. Naming institutionalized racism in the public health literature: a systematic literature review. Public Health Rep. 2018;133:240–9.
Krieger N, Boyd RW, De Maio F, Maybank A. Medicine’s privileged gatekeepers: producing harmful ignorance about racism and health. Health Affairs Blog. https://doi.org/10.1377/hblog20210415.305480.
Boyd RW, Lindo EG, Weeks LD, McLemore MR. On racism: a new standard for publishing on racial health inequities. Health Affairs Blog. https://doi.org/10.1377/hblog20200630.939347.
Lipworth WL, Kerridge IH, Carter SM, Little M. Journal peer review in context: A qualitative study of the social and subjective dimensions of manuscript review in biomedical publishing. Soc Sci Med. 2011;72:1056–63.
Resch KI, Ernst E, Garrow J. A randomized controlled study of reviewer bias against an unconventional therapy. J R Soc Med. 2000;93:164–7.
Acholonu RG, Oyeku SO. Addressing microaggressions in the health care workforce—a path toward achieving equity and inclusion. JAMA Netw Open. 2020;3:e2021770.
Karvonen KL, Karvonen KA. Diversifying Medical Journal Editorial Boards. Acad Med. 2021 Sep [cited 2022 Mar 17]. Available from: https://journals.lww.com/10.1097/ACM.0000000000004414.
McFarling U. When a cardiologist flagged the lack of diversity at premier medical journals, the silence was telling. STATnews. 2021 Apr [cited 2022 Jan 13]. Available from: https://www.statnews.com/2021/04/12/lack-of-diversity-at-premier-medical-journals-jama-nejm/.
Eniasivam A, Medeiros A, Garg M. Addressing harm and establishing trust in peer review: recommendations for action. Med Educ. 2022;56:256–9.
Borrell LN, Elhawary JR, Fuentes-Afflick E, Witonsky J, Bhakta N, Wu AHB, et al. Race and genetic ancestry in medicine — a time for reckoning with racism. N Engl J Med 2021;384:474–80.
Rivara FP, Finberg L. Use of the terms race and ethnicity. Arch Pediatr Adolesc Med. 2001;155:119.
Pediatrics author guidelines. American Academy of Pediatrics; 2022. Available from: https://publications.aap.org/pediatrics/pages/author-instructions#race_and_ethnicity.
Instructions for Authors—January 2021. Obstet Gynecol. 2021 Jan;137:183–200.
AMA Manual of Style Committee. AMA Manual of Style: A Guide for Authors and Editors [Internet]. 11th ed. Oxford University Press; 2020 [cited 2022 Mar 17]. Available from: https://www.amamanualofstyle.com/view/10.1093/jama/9780190246556.001.0001/med-9780190246556.
Flanagin A, Frey T, Christiansen SL, Bauchner H. The reporting of race and ethnicity in medical and science journals: comments invited. JAMA 2021;325:1049.
Ford CL, Airhihenbuwa CO. Critical Race theory, Race equity, and public health: toward antiracism praxis. Am J Public Health. 2010;100:S30–5.
neopapers [Internet]. Twitter; 2022. Available from: https://twitter.com/neo_papers.
Proaño A, Keir A, Campbell DM, Courchia, B, Narvey, M, Bamat, NA. #neoTwitter: evaluation of its use within the neonatal-perinatal community. J Perinatol (2022). https://doi.org/10.1038/s41372-022-01373-x.
Diversity and inclusivity [Internet]. Committee on Publication Ethics; 2021 Dec [cited 2022 Mar 17]. Available from: https://publicationethics.org/node/52156.
Minimum standards for inclusion and diversity for scholarly publishing. [place unknown], Royal Society of Chemistry; 2022 [updated 2022; cited 2022 Jan 13]. Available from: https://www.rsc.org/new-perspectives/talent/minimum-standards-for-inclusion-and-diversity-for-scholarly-publishing/.
Montez K, Omoruyi EA, McNeal-Trice K, Mack WJ, Yemane L, Darden AR, et al. Trends in race/ethnicity of pediatric residents and fellows: 2007–2019. Pediatrics 2021;148:e2020026666.
Silbiger NJ, Stubler AD. Unprofessional peer reviews disproportionately harm underrepresented groups in STEM. PeerJ 2019;7:e8247.
Andrews AL, Ndidi N, Shah SS. New author guidelines for addressing race and racism in the journal of hospital medicine. J Hosp Med 2021;16:E1–4.
Author information
Authors and Affiliations
Contributions
MP initially conceptualized the perspective piece and provided additional support and guidance throughout the writing process. All authors (KK, EB, HB, YF, HL, AP, VW, MP) participated in conceptualization and design of the perspective piece, edited subsequent drafts, and agreed upon the final version. KK wrote the initial draft and analyzed the data. KK, HL, AP, VW, YF additionally collected data for the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Karvonen, K.L., Bonachea, E.M., Burris, H.H. et al. Addressing bias and knowledge gaps regarding race and ethnicity in neonatology manuscript review. J Perinatol 42, 1546–1549 (2022). https://doi.org/10.1038/s41372-022-01420-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41372-022-01420-7