Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

# The COVID-19 pandemic masks the way people perceive faces

## Abstract

The unprecedented efforts to minimize the effects of the COVID-19 pandemic introduce a new arena for human face recognition in which faces are partially occluded with masks. Here, we tested the extent to which face masks change the way faces are perceived. To this end, we evaluated face processing abilities for masked and unmasked faces in a large online sample of adult observers (n = 496) using an adapted version of the Cambridge Face Memory Test, a validated measure of face perception abilities in humans. As expected, a substantial decrease in performance was found for masked faces. Importantly, the inclusion of masks also led to a qualitative change in the way masked faces are perceived. In particular, holistic processing, the hallmark of face perception, was disrupted for faces with masks, as suggested by a reduced inversion effect. Similar changes were found whether masks were included during the study or the test phases of the experiment. Together, we provide novel evidence for quantitative and qualitative alterations in the processing of masked faces that could have significant effects on daily activities and social interactions.

## Introduction

Faces are among the most informative and significant visual stimuli in human perception. Brief presentation of a person’s face readily exposes their identity, gender, emotion, age, and race1. The unprecedented efforts to minimize the effects of the novel coronavirus include a recommendation (and in most countries, a requirement) to wear face masks in public to reduce virus transmission2,3. Around the globe, mask-wearing is being introduced as a new requirement as governments ease restrictions to reopen the economy. This new constraint introduces a whole new arena for face recognition in which typical and commonly encountered faces are partially occluded. Given the importance of intact face processing to everyday life and to social interactions, it is imperative to characterize how wearing masks might hamper these abilities.

A reduction in recognition of masked faces is predicted by previous research. In one such study, a small sample of human participants were found to be impaired in recognition of masked faces4. In a separate study, recognition accuracy was similarly reduced when different features (eyes, mouth, nose) of the face were systemically removed5. Other studies showed that the recognition of facial expressions is modulated if the lower part of the face is occluded by a scarf or ethnic related headdresses6. More recently, it was found that surgical masks impair face perception of familiar and unfamiliar faces7. These findings are also consistent with experiments in which Gaussian masks (i.e., bubbles) were parametrically added to face images, revealing that the mouth and eye regions are among the most important sources of information that support face identification8. Together, these previous studies suggest that the occlusion of specific face features can impair face recognition abilities. However, the extent of this impairment and the perceptual-cognitive mechanism that mediates it remain unclear. The current study aims to address these outstanding questions.

Normal face perception is characterized by a unique processing style that emphasizes holistic aspects of the face rather than its specific features9,10. Maurer and colleagues10 distinguish between three types of configural processes that contribute to face perception: 1. detecting the first-order relations that define faces (i.e., two eyes above a nose and mouth), 2. integrating the features into a coherent gestalt, and 3. processing second-order relations between features. Face masks conceal the lower part of the face, including the mouth and nose area. This information is critical for processing the face as a whole, and, therefore, it is expected that at least some aspects of holistic processing would be disrupted by a mask covering part of a face.

Previous research demonstrated a relationship between holistic processing and face perception performance. For example, face recognition accuracy was found to be correlated with the extent to which observers process the faces holistically11. Neuropsychological investigations have shown that alterations of holistic processing are associated with deficits in face perception abilities. For example, disruption in holistic processing has been observed in individuals with acquired12,13,14 and congenital15,16 prosopagnosia, further emphasizing the significance of this form of processing to face perception. The importance of holistic processing has also been demonstrated in observers with normal face perception abilities. Indeed, previous research documented a robust deficit in the perception of inverted vs. upright faces17 that is termed the face inversion effect (FIE). The FIE is disproportionately larger for faces compared with other visual categories and is often considered as a signature of disrupted holistic processing of faces17,18,19. Notably, it was demonstrated that the lower part of the face (mouth region) has a disproportional contribution to holistic processing compared with the upper part (eye region), such that the inversion manipulation impairs recognition of the mouth much more than the eyes20.

The COVID-19 outbreak has led to widespread adoption of face masks as a primary line of protection. Given that previous research has already shown that occlusion of face parts hinders face perception abilities4 and can also reduce holistic processing21, we predict that face masks will disrupt face perception abilities and change the way faces are processed. To directly test these predictions, we used the Cambridge Face Memory Test (CFMT)22,23, which is a widely used and established test of face recognition abilities. Specifically, we created an identical version of this task in which faces were masked, and examined performance differences across these two versions. To test whether any reduction in face perception is accompanied by a qualitative change in holistic face perception, we also constructed upright and inverted versions of the test phase. The study was conducted online in a large sample (nearly 500 participants across two experiments) and provides a comprehensive, novel account of face recognition abilities with and without masks.

## Methods

### Materials and procedure

The materials and procedure were similar to those used in Experiment 1, except for the following changes. During the CFMT task, masked faces were included only during the study phase (mask-at-study) or alternatively during the test phase (mask-at-test). The “study phase” includes only the familiarization images (for each of the CFMT phases). Following completion of the CFMT experiment with upright and inverted faces (counterbalanced order), all participants completed the PI20, a 20-item questionnaire for assessing congenital prosopagnosia symptoms based on self-report31. Difficulties with face processing are scored on a Likert scale ranging between 1 and 5, with lower scores reflecting better perceived face recognition ability. We also added 3 new questions pertaining to the perception of masked faces (extended PI20). These items were: (1) “My face recognition ability is worse when people wear masks,” (2) “When people wear masks, I often mistake people I have met before for strangers,” and (3) “When people wear masks, without hearing their voices, I struggle to recognize them”.

## Results

To explore whether the effect of face masks on face recognition depends on the phase in which they are presented, participants completed the CFMT when faces were masked only during the study or the test phase. The results (Fig. 3A) were similar to those obtained in Experiment 1.

An ANOVA with group (mask, no-mask, mask at study, mask at test), gender, and face orientation revealed a robust inversion effect [F(1,488) = 692, p < 0.001, ηp2 = 0.58] as well as a main effect of group [F(1,488) = 22.29, p < 0.001, ηp2 = 0.12]. Critically, planned comparisons showed that mask covering during either the test phase [F(1,488) = 33.57, p < 0.001] or study phase [F(1,488) = 37.65, p < 0.001] led to reduced CFMT scores compared with the non-mask group. However, no differences were found between the other conditions. The inclusion of a face mask led to similar impaired performance regardless of whether the mask was included in the test or study phase [Fs < 1].

The two main effects were qualified by a two-way interaction [F(1,488) = 25 , p < 0.001 , ηp2 = 0.13], as the inversion effect was greater for the no-mask group compared with the other three groups [F(1,488) = 75.41, p < 0.001]. The inversion effect was similar in magnitude for the three mask conditions [Fs < 1] (see Supplementary Materials for description of full statistical levels of inversion). These findings suggest that the inclusion of a mask hampers performance to a similar extent and leads to a similar decrease in holistic processing regardless of whether the mask is included at study, at test, or in both experimental phases. We note that in accordance with the results of Experiment 1, a main effect of gender was found [F(1,488) = 31.6 , p < 0.001 , ηp2 = 0.13], again pointing to superior face perception abilities among females.

Finally, we correlated the CFMT scores with self-reported face processing abilities as indicated by the extended 20-item Prosopagnosia index (PI20 + 3 additional mask-related questions; see “Methods”). Because we did not identify any differences between the two groups, we collapsed the correlational analysis across all participants (Fig. 3B). The results showed a weak correlation between the upright CFMT score and the extended PI20 score [r =  − 0.2, p < 0.005, CI − 0.33, − 0.07], (A similar result was obtained for the original PI-20 [upright: r =  − 0.21, p < .005, CI − 0.34, − 0.08; inverted: r =  − 0.04, p = .52, CI − 0.18, 0.09) such that better CFMT scores were associated with a lower score on the extended PI20 (i.e., better self-reported face perception abilities). A similar correlation was not found for inverted faces [r =  − 0.04, p = 0.52, CI  − 0.18, 0.09]. We note that previous studies reported higher correlations between face perception abilities and the PI2031,32 (e.g., r =  − 0.68 n = 110 data from 32; difference from the current reported correlation -Fisher r-to-z transformation—Z = 5.28, p < 0.001). However, the inclusion of the masked faces in the present study might have led to such reduced correlation.

## Discussion

Face masks are an important tool in the effort to minimize COVID-19 virus transmission and, as a result, are increasingly prominent in everyday social interactions. Here, we evaluated the extent to which face masks lead to a decrease in face perception abilities. We have documented quantitative and qualitative alterations in face processing abilities for masked faces. In Experiment 1, we found that the face masks led to a robust decrease in face processing abilities measured by the well-established CFMT. This quantitative reduction was accompanied by a weaker inversion effect, suggesting that the processing of masked faces is less holistic.

Experiment 2 extended these findings in showing that including a face mask in only one of the CFMT phases (i.e., either study or test) led to a similar deficit in face recognition abilities and to reduced holistic processing. This finding corroborates the results from Experiment 1 and further suggests that the face masks can alter different aspects of the face recognition system. Together, these findings imply that face processing abilities are highly susceptible to the inclusion of masks. Below we discuss plausible mechanisms that could account for the observed changes in masked face processing.

### Reduced inversion effect for masked faces

A key finding in the current experiment is the reduction of the face inversion effect for masked faces. In particular, for faces with no masks, we found a decrease of 14 points (26%) in the CFMT score for inverted faces, while a smaller inversion effect (7 points, 16%) was found for masked faces. The inversion of a face makes it difficult to extract configural relationships between face parts17,18,19, and, therefore, the twofold smaller inversion effect for masked faces can be taken as evidence that holistic processing is largely reduced (though not entirely abolished). Thus, the processing of masked faces relies more heavily on their available features rather than on configural or holistic information. Future research should utilize other measurements of holistic processing such as the Garner interreference task33,34 to further characterize the changes along the processing style of faces.

According to Rossion35, the inversion effect reflects a reduction in holistic processing and a sequential, spatially restricted processing of face features. This view can account for the current results. In particular, the upright masked faces are processed in a less holistic manner, resulting in reduced face perception abilities. For the inverted masked faces, feature processing is spatially limited, and, therefore, the effect of the mask is less evident, leading to a reduced face inversion effect. A similar alteration of face perception in general, and of holistic processing in particular, has been found within a different context—namely, the other race effect36. Michel et al.37 found a smaller face composite effect38 for other race faces compared with same race faces. This effect was interpreted as evidence for reduced holistic processing of other race faces. Together, these findings support the co-occurrence of a reduction in face perception abilities and a disruption of holistic face processing.

### Individual differences in face perception

Previous research already alluded to the remarkable individual differences in face perception abilities even within the normal population. At the extremes (or outside) of the normal range, there are individuals who are exceptionally good at face perception (i.e., super-recognizers)23,24 but also individuals with severe deficits in face perception (i.e., prosopagnosia)39,40.

Here we documented high variability in face perception abilities (see Figs. 2B, 3B) alongside a consistent advantage for females across all conditions and in both experiments, consistent with previous results24,41 (faces with and without masks; see Fig. 2C). We also replicated the relationship between self-reported face perception abilities and face perception performance. Notably, this effect was weaker than previously reported31,32, but this might be due to the use of masked faces to assess face perception abilities.

Recently it was reported that eye-movement patterns of faces also exhibit between-subject variability. In particular, four idiosyncratic but consistent, natural eye-pattern clusters were discovered. Those eye-movement patterns can be clustered based on the main focus of fixations on (1) the left eye, (2) the right eye, (3) the nasal bridge, and (4) the nose and upper lip. However, these patterns of fixation did not predict face perception abilities42. Given that masks occlude parts of the nose and the mouth, it is reasonable to assume that observers who exhibit preferential fixation to parts of the faces outside the region of the eyes in (3) and (4) would be more adversely affected by masks. Given that the current data were collected online, we could not evaluate this hypothesis. However, future research should examine this issue.

## Conclusion

The current study provides novel evidence for quantitative and qualitative changes in the processing of masked faces. These changes in performance, together with the alteration along the processing style of partially occluded faces, could have significant effects on activities of daily living, including social interactions, as well as other situations involving personal interactions such as education. Previous research already indicated that reduced face perception abilities following age-related macular degeneration is accompanied by negative consequences of social disengagement, a decrease in the level of social confidence, and a general decrease in quality of life43. Given that wearing masks has rapidly become an important norm in countries around the globe, future research should explore the social and psychological implications of this behavior.

## References

1. 1.

Tsao, D. Y. & Livingstone, M. S. Mechanisms of face perception. Annu. Rev. Neurosci. 31, 411–437 (2008).

2. 2.

Canada, P. H. A. of. Coronavirus disease (COVID-19): Measures to reduce COVID-19 in your community. aem https://www.canada.ca/en/public-health/services/diseases/2019-novel-coronavirus-infection/prevention-risks/measures-reduce-community.html#w (2020).

3. 3.

CDC. Coronavirus Disease 2019 (COVID-19). Centers for disease control and prevention. https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/diy-cloth-face-coverings.html (2020).

4. 4.

Dhamecha, T. I., Singh, R., Vatsa, M. & Kumar, A. Recognizing disguised faces: Human and machine evaluation. PLoS ONE 9, e99212 (2014).

5. 5.

Stephan, B. C. M. & Caine, D. What is in a view? The role of featural information in the recognition of unfamiliar faces across viewpoint transformation. Perception 36, 189–198 (2007).

6. 6.

Kret, M. & De Gelder, B. Islamic headdress influences how emotion is recognized from the eyes. Front. Psychol. 3, 1–13 (2012).

7. 7.

Carragher, D. & Hancock, P. J. Surgical face masks impair human face matching performance for familiar and unfamiliar faces (2020). https://doi.org/10.31234/osf.io/n9mt5.

8. 8.

Gosselin, F. & Schyns, P. G. Bubbles: A technique to reveal the use of information in recognition tasks. Vis. Res. 41, 2261–2271 (2001).

9. 9.

Farah, M. J., Wilson, K. D., Drain, M. & Tanaka, J. N. What is ‘special’ about face perception? Psychol. Rev. 105, 482–498 (1998).

10. 10.

Maurer, D., Grand, R. L. & Mondloch, C. J. The many faces of configural processing. Trends Cogn. Sci. 6, 255–260 (2002).

11. 11.

Wang, R., Li, J., Fang, H., Tian, M. & Liu, J. Individual differences in holistic processing predict face recognition ability. Psychol. Sci. 23, 169–177 (2012).

12. 12.

Busigny, T., Joubert, S., Felician, O., Ceccaldi, M. & Rossion, B. Holistic perception of the individual face is specific and necessary: Evidence from an extensive case study of acquired prosopagnosia. Neuropsychologia 48, 4057–4092 (2010).

13. 13.

Ramon, M., Busigny, T. & Rossion, B. Impaired holistic processing of unfamiliar individual faces in acquired prosopagnosia. Neuropsychologia 48, 933–944 (2010).

14. 14.

Ramon, M. & Rossion, B. Impaired processing of relative distances between features and of the eye region in acquired prosopagnosia—Two sides of the same holistic coin?. Cortex 46, 374–389 (2010).

15. 15.

Avidan, G., Tanzer, M. & Behrmann, M. Impaired holistic processing in congenital prosopagnosia. Neuropsychologia https://doi.org/10.1016/j.neuropsychologia.2011.05.002 (2011).

16. 16.

Tanzer, M., Freud, E., Ganel, T. & Avidan, G. General holistic impairment in congenital prosopagnosia: Evidence from Garner’s speeded-classification task. Cogn. Neuropsychol. 30, 429–445 (2013).

17. 17.

Yin, R. K. Looking at upside-down faces. J. Exp. Psychol. 81, 141 (1969).

18. 18.

Farah, M. J., Tanaka, J. W. & Drain, H. M. What causes the face inversion effect. J. Exp. Psychol. Hum. Percept. Perform. 21, 628–634 (1995).

19. 19.

Freire, A., Lee, K. & Symons, L. A. The face-inversion effect as a deficit in the encoding of configural information: Direct evidence. Perception 29, 159–170 (2000).

20. 20.

Tanaka, J. W., Kaiser, M. D., Hagen, S. & Pierce, L. J. Losing face: Impaired discrimination of featural and configural information in the mouth region of an inverted face. Atten. Percept. Psychophys. 76, 1000–1014 (2014).

21. 21.

Tanaka, J. W. & Farah, M. J. Parts and wholes in face recognition. Q. J. Exp. Psychol. 46, 225–245 (1993).

22. 22.

Duchaine, B. & Nakayama, K. The Cambridge Face Memory Test: Results for neurologically intact individuals and an investigation of its validity using inverted face stimuli and prosopagnosic participants. Neuropsychologia 44, 576–585 (2006).

23. 23.

Russell, R., Duchaine, B. & Nakayama, K. Super-recognizers: People with extraordinary face recognition ability. Psychon. Bull. Rev. 16, 252–257 (2009).

24. 24.

Bobak, A. K., Pampoulov, P. & Bate, S. Detecting superior face recognition skills in a large sample of young British adults. Front. Psychol. 7, 1378 (2016).

25. 25.

Murray, E. & Bate, S. Diagnosing developmental prosopagnosia: Repeat assessment using the Cambridge Face Memory Test. R. Soc. Open Sci. 7, 200884 (2020).

26. 26.

Corrow, S. L., Albonico, A. & Barton, J. J. Diagnosing prosopagnosia: The utility of visual noise in the Cambridge Face Recognition Test. Perception 47, 330–343 (2018).

27. 27.

JASP team. JASP. (2020).

28. 28.

Herlitz, A. & Lovén, J. Sex differences and the own-gender bias in face recognition: A meta-analytic review. Vis. Cogn. 21, 1306–1336 (2013).

29. 29.

Arizpe, J. M., Noles, D. L., Tsao, J. W. & Chan, A.W.-Y. Eye movement dynamics differ between encoding and recognition of faces. Vision 3, 9 (2019).

30. 30.

Hsiao, J. H. & Cottrell, G. Two fixations suffice in face recognition. Psychol. Sci. 19, 998–1006 (2008).

31. 31.

Shah, P., Gaule, A., Sowden, S., Bird, G. & Cook, R. The 20-item prosopagnosia index (PI20): A self-report instrument for identifying developmental prosopagnosia. R. Soc. Open Sci. 2, 140343 (2015).

32. 32.

Shah, P., Sowden, S., Gaule, A., Catmur, C. & Bird, G. The 20 item prosopagnosia index (PI20): Relationship with the Glasgow face-matching test. R. Soc. Open Sci. 2, 150305 (2015).

33. 33.

Ganel, T. & Goshen-Gottstein, Y. Perceptual integrality of sex and identity of faces: Further evidence for the single-route hypothesis. J. Exp. Psychol. Hum. Percept. Perform. 28, 854–867 (2002).

34. 34.

Pomerantz, J. R. & Garner, W. R. Stimules configuration in selective attention tasks. Percept. Psychophys. 14, 565–569 (1973).

35. 35.

Rossion, B. Distinguishing the cause and consequence of face inversion: The perceptual field hypothesis. Acta Psychol. (Amst.) 132, 300–312 (2009).

36. 36.

Meissner, C. A. & Brigham, J. C. Thirty years of investigating the own-race bias in memory for faces: A meta-analytic review. Psychol. Public Policy Law 7, 3 (2001).

37. 37.

Michel, C., Rossion, B., Han, J., Chung, C.-S. & Caldara, R. Holistic processing is finely tuned for faces of one’s own race. Psychol. Sci. 17, 608–615 (2006).

38. 38.

Young, A. W., Hellawell, D. & Hay, D. C. Configurational information in face perception. Perception 16, 747–759 (1987).

39. 39.

Behrmann, M. & Avidan, G. Congenital prosopagnosia: Face-blind from birth. Trends Cogn. Sci. 9, 180–187 (2005).

40. 40.

Duchaine, B. C. & Nakayama, K. Developmental prosopagnosia: A window to content-specific face processing. Curr. Opin. Neurobiol. 16, 166–173 (2006).

41. 41.

McBain, R., Norton, D. & Chen, Y. Females excel at basic face perception. Acta Psychol. (Amst.) 130, 168–173 (2009).

42. 42.

Arizpe, J. M., Walsh, V., Yovel, G. & Baker, C. I. The categories, frequencies, and stability of idiosyncratic eye-movement patterns to faces. Vis. Res. 141, 191–203 (2017).

43. 43.

Lane, J. et al. Impacts of impaired face perception on social interactions and quality of life in age-related macular degeneration: A qualitative study and new community resources. PLoS ONE 13, e0209218 (2018).

44. 44.

Ma, D. S., Correll, J. & Wittenbrink, B. The Chicago face database: A free stimulus set of faces and norming data. Behav. Res. Methods 47, 1122–1135 (2015).

Download references

## Acknowledgements

This study was supported by the Vision Science to Applications (VISTA) program funded by the Canada First Research Excellence Fund (CFREF, 2016–2023) (EF,RSR) by the Natural Sciences and Engineering Research Council (EF) and by the ISF Grant 296/15 (GA). We thank Yoav Carmel and Or Ezer for early discussions on the manuscript.

## Author information

Authors

### Contributions

E.F., T.G., R.S.R. and G.A. developed the study concept and contributed to study design. A.S. collected the data. E.F. analyzed the data. E.F. drafted the first version of the manuscript. T.G., R.S.R. and G.A. edited the manuscript.

### Corresponding author

Correspondence to Erez Freud.

## Ethics declarations

### Competing interests

The authors declare no competing interests.

## Additional information

### Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and Permissions

## About this article

### Cite this article

Freud, E., Stajduhar, A., Rosenbaum, R.S. et al. The COVID-19 pandemic masks the way people perceive faces. Sci Rep 10, 22344 (2020). https://doi.org/10.1038/s41598-020-78986-9

Download citation

• Received:

• Accepted:

• Published:

## Further reading

• ### The consequences of COVID-19 on social interactions: an online study on face covering

• Marta Calbi
• Nunzio Langiulli
• Maria Alessandra Umiltà

Scientific Reports (2021)

• ### The impact of face masks on interpersonal trust in times of COVID-19

• Samreen Malik
• Benedikt Mihm
• Malte Reichelt

Scientific Reports (2021)

## Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

## Search

### Quick links

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing