Go beyond bias training

Ambiguity in expectations and evaluations harms progress, say Rodolfo Mendoza-Denton and colleagues.
Rodolfo Mendoza-Denton is professor of psychology and executive associate dean of diversity and inclusion at the University of California, Berkeley.

Search for this author in:

Colette Patt is assistant dean in the mathematical- and physical-sciences division at the University of California, Berkeley.

Search for this author in:

Mark Richards is professor of Earth and planetary sciences at the University of California, Berkeley.

Search for this author in:

Illustration by David Parkins

One morning in February 1934, the police showed up at J. Robert Oppenheimer’s home in Berkeley, California, to ask why he had left his date in a car by herself all night. Oppenheimer explained that he had gone for a stroll, got lost in his thoughts and walked home, forgetting his car and companion.

Newspapers reporting this story for Valentine’s Day revelled in tales of the absent-minded professor, an archetype that most of us recognize. Brilliant, but short on social graces, such thinkers are assumed to be too busy pondering the deepest questions of the Universe to be bothered with the quotidian.

This archetype, however, can also give licence to the neglect of students. Professors are often excused from knowing the requirements and timelines of graduate programmes. Graduate students regularly receive minimal guidance. The underlying supposition is that the path to success will reveal itself if the student ‘has what it takes’. Lack of direction is often deemed a litmus test for the brilliance of the student.

In our view, women and under-represented minorities face a double whammy under these conditions. First, ambiguous expectations and guidelines allow bias to influence professors’ judgements of student work. Second, environments with unclear or inchoate norms can depress the performance and progress of students in marginalized groups, further perpetuating notions of who qualifies as ‘brilliant’.

Interventions designed to address disparities in science focus largely on changing individual attitudes1. Our surveys of science, technology, engineering and medicine (STEM) departments at the University of California, Berkeley, suggest another, complementary target: the structure of the training programmes themselves, and the cultures built around them.

Ambiguity and bias

Professors are generally in control of deciding which of their students’ research is nurtured, funded and eventually published. And, like all individuals, professors’ judgements are subject to bias.

Ambiguous cues about trainees’ and candidates’ performance allow evaluators to incorporate their own, often unconscious, expectations into their assessments. Presented with job applications designed to represent credible but not stellar candidates (would-be research assistants with a published paper and two years of work experience, but low academic achievement), faculty members rated the same work and credentials more positively when it was accompanied by a male name than when associated with a female name2. A similar study found that research abstracts were rated as being of higher quality if presented as being authored by men and on topics, such as computer-mediated communication, that tend to be associated with males3. By contrast, another study showed that when candidates for a faculty job were presented as equally strong, according to numerical ratings presumably made by other faculty members, traditional gender biases were reversed, at least in this instance4. Similar patterns have been seen with respect to race5. In one study5, evaluators showed strong preferences towards white candidates when the candidates’ qualifications were ambiguous, but no preference when candidates were unambiguously strong or weak. In short, ambiguity serves as fertile ground for the expression of bias.

In addition, it dents the performance of those under evaluation. In one of our studies, about 150 women were asked to wait in one of three rooms arranged to reflect attitudes of their purported evaluator6. In one setting, to suggest that the evaluator held sexist views, the decor included a poster of a bikini-clad woman. In a second, the decor featured a volunteering award with a logo promoting equality to suggest that the evaluator advocated gender equality. The third room was ambiguous, with a banner from a university and a certificate for volunteering in the ‘Ivy League Undergraduate Division’. (A separate survey confirmed the rooms gave the desired impressions.)

We assessed study participants’ concerns about gender-based discrimination with an openly available, previously developed instrument7. Concerns did not affect test performance in either the chauvinist or progressive conditions: these groups answered about 8 of 12 moderately difficult analogies correctly. But in the ambiguous room, women who were concerned about being the target of prejudice averaged fewer than 7 correct answers, a strong effect.

Bright spot

A key requirement for advancement in academia is publication. Almost every step of that process — which project to encourage, how to allocate resources and credit, where and when to submit a manuscript — involves uncertainty. In a survey that R.M.D. conducted with Berkeley psychologist Aaron Fisher and his colleagues across the university’s Division of Mathematical and Physical Sciences, the Department of Electrical Engineering and Computer Science and the College of Chemistry8, graduate students were asked whether they had been an author on a paper submitted for publication in the past year. This reflects scholars’ participation in the research enterprise independent of the vagaries of manuscript review and acceptance.

Response rates for men who were not in under-represented minorities and for all students in the engineering and mathematics departments were around 40%. Those for women, people in under-represented groups and the chemistry college were just over 50%. Women and people in under-represented minority groups had fewer submissions than did their white or Asian male counterparts, even when controlling for factors such as time in the programme, advancement to PhD candidacy and teaching responsibilities. To our surprise, however, race and gender did not predict the likelihood of publishing for people in the chemistry college (see ‘No gap in chemistry’).

Intrigued, we went on to examine 15 years’ worth of data from Berkeley’s PhD exit survey, which boasts a completion rate of 98%. The survey includes the questions: “Were you encouraged by faculty in your department to publish?” and “did you deliver any papers at national scholarly meetings?”. The latter is often a precursor to publication.

Again, we found that, overall, women and under-represented minorities were much more likely than white and Asian men to answer ‘no’ to both questions across STEM fields. There were no statistically significant differences in the College of Chemistry.

What is happening in the college that seems to be levelling the playing field? Noting that the chemistry programme has been independently recognized for placing women with PhDs into elite faculty positions9, our team has embarked on a series of interviews with faculty members, alumni and student advisers in this unit to identify some of the factors that could be fuelling the success of women and minority groups there. We are also interviewing people in the mathematics and physics departments, where we see strong disparities.

Three hallmarks

Although preliminary, our data suggest that the chemistry college has the following characteristics.

Advancement processes and procedures are clearly defined and systematically applied. For example, every student is expected to regularly present their research to colleagues and peers, including at a departmental seminar in the second year. This sets a public norm for productivity and affords multiple opportunities to learn from peers and near-peers as they themselves meet these expectations.

Student progress is overseen by multiple faculty members. For example, in each broad sub-field of the department, one adviser actively manages students’ progress through the early stages of the programme, including helping to match students with research advisers. In addition to the academic and research advisers, each graduate student is entitled to a departmental ‘associate adviser’ once they pass their qualifying exam. This process ensures that students don’t fall through the cracks, and engages multiple faculty members in collegial feedback as the student moves through the programme.

There is department-wide agreement about expectations for advancement. There are written guidelines for when students must choose an adviser, deliver seminars and pass qualifying exams. The expectation to publish is promoted officially. Before a student takes a qualifying exam, for example, advisers fill out a form that includes their assessment of when students will submit a paper, establishing that this is a norm, and prompting discussion.

These three observations suggest that requirements and regulations might not be enough. Rather, the community’s knowledge, implementation and even application of standards are crucial to creating a culture in which students know what they need to do, and advisers know what they should encourage. We refer to this as a culture of structure.

The University of California at Berkeley campus

Setting clear expectations from the start can help all trainees to thrive.Credit: Jim Wilson/NYT/Redux/eyevine

Rapport and structure

Structured programmes need not be impersonal or automated. The twists and turns of discovery, and of people’s lives, demand flexibility and exceptions. Our research suggests that trust between lab heads and lab members is essential — particularly in mentoring relationships that are interracial.

One of us (R.M.D.) and his colleagues published a study earlier this year intended to model interracial mentoring10. Some participants were asked to play the part of mentor, giving feedback on a speech for which a trainee had just three minutes to prepare. Trainees were asked to rate the quality of the feedback. In reality, all ‘interactions’ occurred through a video-chat in which one member of the pair was an actor performing a pre-recorded script.

Before the speech, half of the pairs were assigned an activity in which participants took turns asking and answering questions that escalate in self-disclosure — an exercise known to increase feelings of rapport. The control group took turns reading passages of novels to each other11.

According to independent coders — who did not know which activity preceded the feedback session — trainees in pairs assigned to the rapport-building task gave better speeches and mentors provided warmer and more helpful feedback than did those in the control group. This held true for both same-race and interracial pairings.

Of course that’s just one study, and more research is needed. But if the tenor of manipulated, short-term ‘mentoring’ can affect performance and feedback, it seems likely that the tenor of a trainee–adviser relationship could, too. In many STEM departments, emotions and feelings are deemed distractions. Our research suggests, instead, that establishing trust could be a key way to boost performance and parity through the ability to value each other.

In sum, our findings suggest fresh ways of interrupting bias in STEM education. Departments should adopt transparent policies and expectations for student progress that are communicated clearly to all. Professors and mentors should take time to build trust and rapport with students.

It is time we laid to rest the ‘see you in five years’ model, rooted in the specious notion that brilliance will find a way. Brilliance is most reliably nurtured through structure and trust.

Nature 557, 299-301 (2018)

doi: 10.1038/d41586-018-05144-7
Nature Briefing

Sign up for the daily Nature Briefing email newsletter

Stay up to date with what matters in science and why, handpicked from Nature and other publications worldwide.

Sign Up


  1. 1.

    Moss-Racusin, C. A. et al. Science 343, 615–616 (2014).

  2. 2.

    Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J. & Handelsman, J. Proc. Natl Acad. Sci. USA 109, 16474–16479 (2012).

  3. 3.

    Knobloch-Westerwick, S., Glynn, C. J. & Huge, M. Sci. Commun. 35, 603–625 (2013).

  4. 4.

    Williams, W. M. & Ceci, S. J. Proc. Natl Acad. Sci. USA 112, 5360–5365 (2015).

  5. 5.

    Dovidio, J. F. & Gaertner, S. L. Psychol. Sci. 11, 315–319 (2000).

  6. 6.

    Mendoza-Denton, R., Shaw-Taylor, L., Chen, S. & Chang, E. J. Exp. Soc. Psychol. 45, 275–278 (2009).

  7. 7.

    London, B., Downey, G., Romero-Canyas, R., Rattan, A. & Tyson, D. J. Pers. Soc. Psychol. 102, 961–979 (2012).

  8. 8.

    Mendoza-Denton, R. et al. PLoS ONE 12, e0174296 (2017).

  9. 9.

    Laursen, S. L. & Weston, T. J. J. Chem. Educ. 91, 1762–1776 (2014).

  10. 10.

    Leitner, J., Ayduk, Ö., Boykin, C. M. & Mendoza-Denton, R. PLoS ONE 13, e0194123 (2018).

  11. 11.

    Page-Gould, E., Mendoza-Denton, R. & Tropp, L. R. J. Pers. Soc. Psychol. 95, 1080–1094 (2008).

Download references