Abstract
We investigated the emotion perception process based on hospitality expertise. Forty subjects were divided into the OMOTENASHI group working at inns considered to represent the spirit of hospitality, OMOTENASHI in Japan, and CONTROL group without experience in the hospitality industry. We presented neutral, happy, and angry faces to investigate P100 and N170 by these faces, and psychophysical changes by the favor rating test to evaluate emotional perception. In the favor rating test, the score was significantly smaller (less favorable) in OMOTENASHI than in CONTROL. Regarding event-related potential components, the maximum amplitude of P100 was significantly larger for a neutral face at the right occipital electrode in OMOTENASHI than in CONTROL, and it was significantly larger for an angry face at both occipital electrodes in OMOTENASHI than in CONTROL. However, the peak latency and maximum amplitude of N170 were not significantly different between OMOTENASHI and CONTROL at both temporal electrodes for each emotion condition. Differences on the favor rating test and P100 in OMOTENASHI suggested that workers at inns may more quickly notice and be more sensitive to the facial emotion of guests due to hospitality training, and/or that hospitality expertise may increase attention to emotion by top-down and/or bottom-up processing.
Similar content being viewed by others
Introduction
In our daily lives, the information from the face, for example, sex, age, and familiarity, is important. Facial emotion, in particular, is essential for our social communication, because it reflects the state of mind of others, and humans can read and sympathize with their state.
In many psychological studies, models of face recognition have been hypothesized. Bruce and Young1 suggested a model in which faces are initially processed in a stage of structural encoding, which includes view-centered and expression-independent descriptions of faces. After this description, facial identification, facial speech, and emotional expression are processed in parallel and independently. Facial identification begins from structural encoding and arrives at a face recognition unit (FRU), where structural codes of familiar faces are stored.
Non-invasive neuroimaging methods were recently used to investigate the human perception and recognition systems. Event-related potentials (ERPs) using electroencephalography (EEG) are especially useful to investigate the time course of perception and recognition processes in humans because of the high temporal resolution. There have been many studies about face recognition using ERPs, and N170 is known as a major component specific to face recognition and is mainly elicited approximately 170 ms at both temporal electrodes after the presentation of a face2,3. The characteristics of N170 are as follows: (1) N170 is larger for faces than for animals, cars, or chairs. (2) N170 is larger for faces at the right temporal electrode than at the left. (3) N170 is smaller for upright faces than for inverted faces, i.e., face inversion effect4. (4) N170 is smaller for upright faces than for eyes.
P100 (P1) and N100 are also known as components related to the early process of visual perception in general, and begin 90–120 ms at occipital electrodes after luminance2,5. The Pl00 recorded was not sensitive to stimulus category, but rather to stimulation of luminance, luminance contrast, and size5, whereas N100 was larger for a scrambled face than for an unscrambled face2. In addition, P100 is affected by visual attention6,7. P100 is elicited involuntarily at the appearance of a visual stimulus when not attended, whereas its amplitude increases when a person allocates attention to the stimulus.
There have been several studies on facial emotion using ERPs8,9,10,11. Regarding the N170 component, a meta-analysis demonstrated that anger, fear, and happiness elicited the largest amplitudes of N170 with respect to neutral, non-expressive faces11, and another study systematized facial emotion effects as a function of different attention, and revealed that N170 emotion effects are most consistently found in passive viewing designs12. In addition, other studies reported the following characteristics about the alteration of N170 by emotion and naturalness: (1) It is independent of perceptual load, but regulated by the inter-stimulus interval (ISI)13. (2) The N170 emotional alteration is task-independent and unaffected by feature-based attention14. (3) Fearful faces and decreasing face naturalness elicited a substantially larger N17015. (4) N170 emotional alteration requires the processing of figural facial expression features16. (5) N170 emotional alteration depends mainly on configural information of faces, i.e., recognizing a face17. (6) N170 emotional alteration is unaffected by expression-specific spatial frequencies18.
As for P100, previous ERP studies revealed that it is also influenced by facial emotion. Dennis et al.10 found that the latency of P100 was shortened in response to a fearful face compared with a sad face, and P100 emotion and face effects are strongly influenced by low-level information in contrast to the N170 component16,19. Furthermore, the following characteristics about the alteration of P100 by emotion and naturalness were noted: (1) P100 emotional alteration is dependent of perceptual load, irrespective of the ISI13. (2) It appears strongly in perceptual tasks13. (3) Lower face naturalness results in a larger P10015. (4) P100 emotional alteration strongly depends on low-level visual information16. (5) Expression-specific spatial frequencies alter P10018.
The process of human perception and recognition is also affected by many factors such as age, expertise, and training. Many previous studies reported that ERPs related to facial emotion change with age. Batty and Taylor20 revealed that the sensitivity of N170 to emotions in adults appeared late at 14 to 15 years of age. Based on our previous study21, the areas of the brain involved in perceiving changes in facial emotion have not matured by 14 years of age, and we hypothesized that the developmental changes in the perception of facial emotional change are driven, in part, by different factors, such as skull growth and myelination in the visual cortex, and by perceptual and cognitive development.
In Japan, the expression of kind, warm, and sensitive hospitality is termed “OMOTENASHI”. Workers at Japanese hot spring spa inns are considered representatives of OMOTENASHI. This is the major reason for why Japanese prefer staying at such inns, and foreign travelers also enjoy not only hot spring spas, but also this expression of OMOTENASHI. In addition, workers at hot spring spa inns observe guests carefully, thus workers at hot spring spa inns can judge what kind of person guests are, how guests are, and whether guests are favorable to inn. However, no studies have investigated OMOTENASHI.
Therefore, we investigated OMOTENASHI by evaluating the processes of facial emotion perception. The main objective of this study was to assess whether the facial emotion perception is affected by the existence of expertise in Japanese hospitality (OMOTENASHI). In this study, we investigated the differences in P100 and N170 of ERPs, and psychophysical changes by an original test evaluating the characteristics of emotional perception between subjects who worked at hot spring spa inns and those without experience in the hospitality industry.
Results
Psychophysical study
The stimulus condition (F = 201.689, p < 0.05, partial η2 = 0.841) and subject group (F = 9.982, p < 0.05, partial η2 = 0.208) had significant effects on the score on the favor rating test. The score was significantly smaller in OMOTENASHI than in CONTROL (Table 1). The score for Neutral was significantly smaller in OMOTENASHI than in CONTROL by Welch's t test (p < 0.05) (Table 1).
P100
Waveform of P100
The grand-averaged waveforms of P100 obtained for each subject group for all stimulus conditions (Neutral, Happy, and Angry) by the O1 (left) and O2 (right) electrodes are shown in Fig. 1. The mean (and standard deviation) values in the peak latency and maximum amplitude (baseline-to-peak) of P100 obtained for each group (OMOTENASHI or CONTROL) for each stimulus condition (Neutral, Happy, or Angry) by the O1 (left) and O2 (right) electrodes are shown in Tables 2 and 3.
Peak latency of P100
The electrode (F = 4.606, p < 0.05, partial η2 = 0.108) had a significant effect on the peak latency of P100. The peak latency of P100 was shorter at the O2 electrode (right) than at the O1 electrode (left). However, stimulus condition (F = 1.410, p > 0.05, partial η2 = 0.036) and subject group (F = 0.799, p > 0.05, partial η2 = 0.021) did not have significant effects on P100 latency.
We investigated the differences in the peak latency of P100 among the stimulus condition in each subject group at each electrode using post hoc analysis. Stimulus condition and electrode did not have significant effects on the peak latency of P100 in either subject group. In addition, we investigated the differences in the latency among subject group for each stimulus at each electrode. Subject group did not have a significant effect on the peak latency of P100.
Maximum amplitude of P100
The subject group (F = 6.662, p < 0.05, partial η2 = 0.149) and electrode (F = 4.110, p < 0.05, partial η2 = 0.098) had significant effects on the maximum amplitude of P100. The maximum amplitude of P100 was significantly larger in OMOTENASHI than in CONTROL. However, the effect of stimulus condition (F = 0.491, p > 0.05, partial η2 = 0.013) on the maximum amplitude of P100 was not significant.
We investigated the differences in the maximum amplitude of P100 among the stimulus condition in each group at each electrode using post hoc analysis. Among the stimulus condition, there were no significant effects on the maximum amplitude of P100 in each group at each electrode. In addition, we investigated the differences in the maximum amplitude of P100 among subject group for each stimulus at each electrode by Welch's t test. After the presentation of Neutral, the maximum amplitude of P100 was significantly larger in OMOTENASHI than in CONTROL at the O2 electrode (right). In addition, after the presentation of Angry, the maximum amplitude of P100 was significantly larger in OMOTENASHI at O1 (left) and O2 (right) electrodes than in CONTROL.
Topographical map of P100
The topographical maps of P100 when the P100 amplitude in grand-averaged waveforms was largest at the O2 electrode (right) in each subject group for all stimulus conditions (Neutral, Happy, and Angry) are shown in Fig. 1. The amplitude at the bilateral occipital areas was larger for Neutral and Angry in the OMOTENASHI than in the CONTROL, and was larger for Happy than Neutral or Angry in the CONTROL.
N170
Waveform of N170
The grand-averaged waveforms of N170 recorded for each subject group in each stimulus condition (Neutral, Happy, or Angry) by the T5 (left) and T6 (right) electrodes are shown in Fig. 2. The mean (and standard deviation) values in the peak latency and maximum amplitude (baseline-to-peak) of N170 obtained for each group (OMOTENASHI or CONTROL) for each stimulus condition (Neutral, Happy, or Angry) by the T5 (left) and T6 (right) electrodes are shown in Tables 4 and 5.
Peak latency of N170
The effects of stimulus condition (F = 1.460, p > 0.05, partial η2 = 0.037), electrode (F = 0.217, p > 0.05, partial η2 = 0.006), and subject group (F = 0.153, p > 0.05, partial η2 = 0.004) on the peak latency of N170 were not significant, nor were any of the interactions between the parameters.
Maximum amplitude of N170
The electrode (F = 5.192, p < 0.05, partial η2 = 0.120) had a significant effect on the maximum amplitude of N170 (baseline-to-peak). The maximum amplitude of N170 was significantly larger at T6 (right) than at T5 (left). However, the effects of stimulus condition (F = 1.071, p > 0.05, partial η2 = 0.027) and subject group (F = 0.034, p > 0.05, partial η2 = 0.001) on the maximum amplitude of N170 were not significant, nor were any of the interactions between the parameters.
We investigated the differences in the maximum amplitude of N170 among electrode in each age group for each stimulus condition using post hoc analysis. In CONTROL, the maximum amplitude of N170 was significantly larger for Neutral at the T6 electrode (right) than at the T5 electrode (left).
Topographical map of N170
The topographical maps of N170 when the N170 amplitude in grand-averaged waveforms was largest at the T6 electrode (right) obtained for each subject group for all stimulus conditions (Neutral, Happy, and Angry) are shown in Fig. 2. The amplitude at the bilateral temporal areas was lower for each condition in CONTROL than in OMOTENASHI.
Discussion
This psychophysical study can be summarized as follows: (1) the score on the favor rating test was significantly lower in OMOTENASHI than in CONTROL, and (2) OMOTENASHI favored Neutral significantly less than CONTROL.
We developed this favor rating test for use in this study. In CONTROL, angry faces were perceived as unfavorable, neutral faces as neither favorable nor unfavorable, and happy faces as favorable in this study. Therefore, we considered this favor rating test to be useful and appropriate for evaluating emotional perception.
The lower score on the favor rating test for OMOTENASHI in this study suggested that workers at hot spring inns are more sensitive to the facial emotion of guests due to their hospitality expertise. In addition, the workers at hot spring inns did not prefer a neutral face in the favor rating test because a neutral face may not make them feel at ease. These significant differences revealed a greater sensitivity to facial emotion and higher sense of responsibility in workers at hot spring spa inns than in common people, probably due to hospitality training for a long period.
The ERP results can be summarized as follows: (1) the maximum amplitude of P100 was significantly larger for OMOTENASHI than for CONTROL, (2) the maximum amplitude of P100 was significantly larger for Neutral in OMOTENASHI than in CONTROL at the right occipital electrode, (3) the maximum amplitude of P100 was significantly larger for Angry in OMOTENASHI than in CONTROL at the bilateral occipital electrodes, and (4) the peak latency and maximum amplitude of N170 were not significantly different between OMOTENASHI and CONTROL, although the amplitude in the topographical map of N170 at the bilateral temporal areas was lower for each condition in CONTROL than in OMOTENASHI.
P100 and N170 are considered to reflect activities of the early and late stages of face perception, respectively. Therefore, a difference in the P100 and unchanged N170 in OMOTENASHI suggested that workers at hot spring spa inns noticed facial emotion of guests faster than common people because of their experience in calming guests for a short period. In addition, the P100 amplitude in OMOTENASHI was significantly larger than in CONTROL, particularly for an angry face. This suggested that workers at hot spring spa inns are more sensitive to the uncomfortable feelings of guests than common people and they consider how to manage guests due to their hospitality expertise. This sensitivity in face perception may be one of the most important factors of OMOTENASHI. A previous study presented evidence of cortical hypervigilance in social phobia, expressed as generally increased P100 amplitudes to emotional faces, regardless of facial expression22. In another study, migraine patients had significantly more negative ERPs between 100 and 180 ms for all three picture categories (positive, negative, and neutral), and generally heightened sensitivity to all complex pictorial stimuli23. In addition, a study designed to investigate the differences in cortical processing of facial stimuli when neutral faces were presented in a context that involved information about emotional valence and self-reference demonstrated that depressed patients have larger mean P100 amplitudes than healthy controls across conditions (self-related/physically threatening, self-related/socially threatening, self-related/neutral, other-related/physically threatening, other-related/socially threatening, other-related/neutral)24. Therefore, our study is consistent with these previous studies.
Previous studies about visual perception revealed that the P100 amplitude increases more for attended stimuli than for non-attended stimuli6, and that emotion perception is automatic and unconscious due to bottom-up processing by the amygdala25,26,27,28, and/or top-down processing by orbital and ventromedial prefrontal cortices29,30,31,32. Based on previous studies, we also considered the possibility that hospitality expertise increased attention to emotion by top-down and/or bottom-up processing. Furthermore, a previous study revealed that patients who underwent right temporal lobe resection (rTLR) including the amygdala have a higher P100 amplitude than controls33. Our study is partly consistent with this previous rTLR patient study.
There are a number of limitations in this study. First, the favor rating test was developed for this study. Based on the results in CONTROL, this favor rating test may be useful to evaluate the impression of faces. However, there is a possibility that this test cannot be used by others as it is an original design.
Second, the peak latency and maximum amplitude of N170 were not significantly different between OMOTENASHI and CONTROL at both right and left temporal electrodes in this study, although the amplitude in the topographical map of N170 at the bilateral temporal areas was lower for each emotion condition in CONTROL than in OMOTENASHI. In addition, there were no significant differences among emotion conditions at both right and left temporal electrodes in each subject group. Based on previous studies, there were no significant differences as mentioned above in N170 due to not only the variability among individual subjects, but also the following possibilities: (1) the difference in the reference in EEG recording34, (2) the differences in the electrodes in N170 analysis35,36,37,38, (3) the difference in bandpass filter, especially the high-pass filter39,40, (4) the difference in the ISI13, (5) difference in face naturalness15, (6) the differences in figural facial expression features16, and (7) the differences in configural information of faces17. Therefore, further studies are warranted to eliminate these possibilities and confirm our findings.
Third, topographic differences suggest differences in neural generators because topography was a conventional criterion for defining ERP components41, and we partially agreed with the usefulness of topographic differences revealing whether two scalp topographies differ (e.g., Angry/Neutral). On the other hand, there were no significant differences in the P100 and N170 maximum amplitudes between each condition in each group, and we also confirmed that the subtraction method used in the topographic differences may show artificial activity and/or reducing real activity. Therefore, only the topographical maps of P100 and N170 were shown, and not the topographic differences. However, we did not deny that others did not easily recognize the differences between each condition in this study.
In conclusion, we investigated ERPs and psychophysical changes related to facial emotion perception based on Japanese hospitality (OMOTENASHI) expertise. The changes in P100 suggested that it is related to emotion perception and is affected by expertise in OMOTENASHI, differing from N170. Based on P100, workers at hot spring spa inns are more sensitive to the feelings of guests than common people due to their hospitality expertise. This is the first study to demonstrate the sensitivity in facial perception due to the specific type of hospitality OMOTENASHI.
Methods and materials
Subjects
Forty normal right-handed females with normal or corrected visual acuity participated in this study. The subjects were divided into two groups, i.e., OMOTENASHI (n = 21, age (mean and standard deviation): 50.5 ± 12.0 years), and CONTROL (n = 19, age: 50.4 ± 11.4 years). Subjects in OMOTENASHI were workers at hot spring spa inns in Gamagori city, Aichi Prefecture, Japan, which is a well-known hot spring spa area. On the other hand, subjects in CONTROL had no experience in the hospitality, service, medical, or education industry. There were no significant differences in age between OMOTENASHI and CONTROL by Welch's t test.
All subjects provided informed consent to participate in the experiment, which was approved by the ethics committee of the National Institute for Physiological Sciences. All experiments were conducted according to the Declaration of Helsinki. Each subject was compensated at the end of the experiment.
Visual stimuli
In the visual field, a rotating teapot with a rotation cycle of 4 s was projected as a background image, the same as the modified stimulus used in our previous study42 (Fig. 3).
The image of the teapot was in gray-scale. The total field of stimulation was 9.4 degrees (height) × 9.6 degrees (width), and the fixation point (red cross) was at the center of the visual field. Inserted into the background image were the following 5 stimuli (Fig. 3):
-
(1)
Neutral: neutral face stimuli.
-
(2)
Happy: happy face stimuli.
-
(3)
Angry: angry face stimuli.
-
(4)
Alphabet: images of A, B, C, D, E, and F.
-
(5)
Target: image of a star. The subjects were asked to push a button as quickly as possible when the target stimuli were presented.
In this stimulus presentation method, a rotating teapot continuously activated other visual areas except for the visual area related to face perception. Therefore, we thought this method may mainly evoke the responses in the visual areas related to the visual process of the face perception when face stimuli were presented, with minimizing and reducing the evoked responses in other visual areas.
We presented Alphabet and Target stimuli to ensure that the experimental task functioned as an implicit face perception task, and the luminance and contrast of the Alphabet stimuli differed from those of the neutral face (Neutral), happy face (Happy), and angry face (Angry) stimuli. Therefore, we analyzed the results obtained under conditions (1), (2), and (3).
We used neutral, happy, and angry faces of Japanese (ATR Promotions, Inc., Kyoto, Japan), which had no hair, ears, or neck (3 male and 3 female faces), and which were used in our previous study (Fig. 3)21, and subjects easily perceived and judged these stimuli as each emotion. Emotion rating tests were performed by ATR Promotions. Twenty-seven adults rated each face from 1 (low) to 7 (high) in each category of emotion (happy, sad, surprise, anger, disgust, fear, and contempt). As results of the test for the stimuli used in this study by ATR promotion, the happy face was highly rated as happy, the angry face was highly rated as angry, and the neutral face was rated as neither happy nor angry. In addition to the test by ATR Promotions, the test was performed after the experiments for all subjects who participated in this study. The results of this test in each group were the same as those in the test performed by ATR Promotions, and there were no significant differences between groups in any condition.
All face images were in gray-scale and unfamiliar to the subjects, and alphabet and star images were in gray-scale. The size of face, alphabet and star images was 9.4 degrees (height) × 9.6 degrees (width) the same as the teapot image (Fig. 3). The stimuli were shown for 500 ms. Each of the five conditions was automatically and randomly presented once or twice per one rotating circle of the teapot, and thus the time of the inter-stimulus interval (ISI) was random within 2050–3433 (2964.9 ± 186.9: means and standard deviation) ms.
A rotating teapot and visual stimuli were presented on a personal computer (OPTIPLEX 980: Dell Technologies, USA) and cathode ray tube (CRT) screen (FlexScan T961: Eizo Nanao Corporation, Japan). The distance between the subject’s eyes and the CRT screen was 110 cm. Stimuli were projected centrally in the visual presentation field. Subjects sat on the chair for EEG measurement and were asked to focus on a small red cross at the center of the stimulus during the experiment. To minimize habituation and drowsiness, each subject took part in more than 10 short-term recording sessions.
Psychophysical study
Workers in the hospitality industry, such as at hot spring spa inns, scrutinize guests as to their favorability. Therefore, we made an original test scoring how favorable presented image of faces are, termed the favor rating test, and performed it after the experiment. Subjects rated each face from 1 (low: not favorite) to 7 (high: favorite) for Neutral, Happy, and Angry. For favor rating, a repeated measures two-way ANOVA was performed with stimulus condition (Neutral, Happy, or Angry) as a within-subject factor and subject group (OMOTENASHI, CONTROL) as a between-subject factor. In addition, Welch's t test was used between OMOTENASHI and CONTROL to investigate the effects of hospitality on each face and p < 0.05 was considered significant.
ERP recording and data analysis
ERPs were recorded using 7 electrodes according to the international 10–20 system (Fz, Cz, T5, T6, Pz, O1, and O2), with an additional 2 electrodes, T5’ (2 cm below T5) and T6’ (2 cm below T6)21,43 with Ag/AgCl disk electrodes. The impedance of electrodes was kept below 5 k ohm. The reference was placed at the tip of the nose far from the temporal area because the reference used in this study may be less affected by the temporal area activity than other references, and useful for recording N170 judging from our previous studies21,44. Electrooculography (EOG) was also recorded using an electrode located above the right eye and the reference electrode to assess blinking and eye movements.
We used Neurofax (Nihon-Kohden, Tokyo, Japan) to record the data and EPlyzer (Kiseei Comtec, Nagano, Japan) to analyze the data. The bandpass filter was 0.03–120 Hz and the sampling rate was 1000 Hz during on-line recording. Eye movements of subjects were monitored during EEG recordings with EOG. Epochs in which signal variations of EEG and EOG were larger than ± 150 µV were automatically excluded from the averaging.
As for the ERP analysis after on-line recording, the finite impulse response bandpass filter with filter properties forward was 1–30 Hz off-line after stimulus onset to minimize the influence of artifacts, and we confirmed that this bandpass filter did not smear the components or alter the amplitude of the components for each subject. We checked each epoch for each stimulus in each subject off-line, and epochs in signal variations of EEG and EOG that were large were excluded from the off-line averaging by visual inspection. More than 40 epochs were averaged off-line for each condition in each subject. The time window for the analysis ran from 100 ms before to 400 ms, and the data obtained during the 100 ms before stimulus onset were used as the baseline.
The peak latency and maximum amplitude (baseline-to-peak) of the P100 and N170 components were measured at the O1 (left) and O2 (right), and at the T5 (left) and T6 (right) electrodes respectively. The peak latency when the amplitude of the P100 and N170 components was maximal after stimulus onset for each condition, and the maximum amplitude of the component were individually measured visually within the range of 85–175 ms for P100 and 145–280 ms for N170. In addition, the distribution of P100 and N170 on the scalp was shown by the topographical maps of P100 and N170, when P100 amplitude in grand-averaged waveforms was largest at the O2 electrode in each subject group for all stimulus conditions (Neutral, Happy, and Angry), and when N170 in grand-averaged waveforms was largest at the T6 electrode in each subject group for all stimulus conditions (Neutral, Happy, and Angry)41.
For peak latency and maximum amplitude of P100 and N170, a repeated measures three-way ANOVA was performed with stimulus condition (Neutral, Happy, or Angry) and electrode (O1, O2 for the P100, and T5, T6 for the N170) as within-subject factors, and subject group (OMOTENASHI and CONTROL) as a between-subject factor to examine the effects of hospitality. Lastly, a repeated measures two-way factorial ANOVA was performed with stimulus condition (Neutral, Happy, or Angry) and electrode as factors in OMOTENASHI or CONTROL to examine the effects of condition and electrode in each subject group. Welch's t test was then performed with subject group (OMOTENASHI and CONTROL) for each stimulus (Neutral, Happy, or Angry) at each electrode.
The degrees of freedom were corrected using the Greenhouse–Geisser correction coefficient epsilon, and F and p values were recalculated. The Bonferroni multiple comparison test was used for the post hoc analysis and p < 0.05 was considered significant. In addition, Welch's t test was used between OMOTENASHI and CONTROL for peak latency and maximum amplitude, and p < 0.05 was considered significant.
Data availability
The data that support the findings of this study are available from the corresponding author, K.M., upon reasonable request.
References
Bruce V, Young A (1986) Understanding face recognition. Br. J. Psychol. 77:305–327. https://doi.org/10.1111/j.2044-8295.1986.tb02199.x
Bentin S, Allison T, Puce A, Perez E, McCarthy G (1996) Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 8:551–565. https://doi.org/10.1162/jocn.1996.8.6.551
Takamiya N, Maekawa T, Yamasaki T, Ogata K, Yamada E, Tanaka M, Tobimatsu S (2020) Different hemispheric specialization for face/word recognition: A high-density ERP study with hemifield visual stimulation. Brain. Behav. 10. https://doi.org/10.1002/brb3.1649
Sadeh, B. & Yovel, G. Why is the N170 enhanced for inverted faces? An ERP competition experiment. Neuroimage 53, 782–789. https://doi.org/10.1016/j.neuroimage.2010.06.029 (2010).
Allison T, Puce A, Spencer DD, McCarthy G (1999) Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cereb. Cortex 9:415–430. https://doi.org/10.1093/cercor/9.5.415
Hillyard SA, Vogel EK, Luck SJ (1998) Sensory gain control (amplification) as a mechanism of selective attention: Electrophysiological and neuroimaging evidence. Philos. Trans. R. Soc. Lond. B 353:1257–1270. https://doi.org/10.1098/rstb.1998.0281
Mangun GR (1995) Neural mechanisms of visual selective attention. Psychophysiology 32:4–18. https://doi.org/10.1111/j.1469-8986.1995.tb03400.x
Eimer, M. & Holmes, A. An ERP study on the time course of emotional face processing. Neuroreport 13, 427–431. https://doi.org/10.1097/00001756-200203250-00013 (2002).
Martens U, Leuthold H, Schweinberger SR (2010) On the temporal organization of facial identity and expression analysis: Inferences from event-related brain potentials. Cogn. Affect. Behav. Neurosci. 10:505–522. https://doi.org/10.3758/CABN.10.4.505
Dennis TA, Malone MM, Chen CC (2009) Emotional face processing and emotion regulation in children: An ERP study. Dev. Neuropsychol. 34:85–102. https://doi.org/10.1080/87565640802564887
Hinojosa JA, Mercado F, Carretié L (2015) N170 sensitivity to facial expression: A meta-analysis. Neurosci. Biobehav. Rev. 55:498–509. https://doi.org/10.1016/j.neubiorev.2015.06.002
Schindler S, Bublatzky F (2020) Attention and emotion: An integrative review of emotional face processing as a function of attention. Cortex 130:362–386. https://doi.org/10.1016/j.cortex.2020.06.010
Schindler S, Caldarone F, Bruchmann M, Moeck R, Straube T (2020) Time-dependent effects of perceptual load on processing fearful and neutral faces. Neuropsychologia 146:107529. https://doi.org/10.1016/j.neuropsychologia.2020.107529
Schindler S, Bruchmann M, Steinweg A-L, Moeck R, Straube T (2020) Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces. Soc. Cogn. Affect. Neurosci. 15:765–774. https://doi.org/10.1093/scan/nsaa098
Schindler S, Bruchmann M, Bublatzky F, Straube T (2019) Modulation of face- and emotion-selective ERPs by the three most common types of face image manipulations. Soc. Cogn. Affect. Neurosci. 14:493–503. https://doi.org/10.1093/scan/nsz027
Schindler S, Bruchmann M, Gathmann B, Moeck R, Straube T (2021) Effects of low-level visual information and perceptual load on P1 and N170 responses to emotional expressions. Cortex 136:14–27. https://doi.org/10.1016/j.cortex.2020.12.011
Bruchmann, M., Schindler, S., Dinyarian, M. & Straube, T. The role of phase and orientation for ERP modulations of spectrum-manipulated fearful and neutral faces. Psychophysiology 59, e13974. https://doi.org/10.1111/psyp.13974 (2022).
Bruchmann M, Schindler S, Straube T (2020) The spatial frequency spectrum of fearful faces modulates early and mid-latency ERPs but not the N170. Psychophysiology 57. https://doi.org/10.1111/psyp.13597
Rossion B, Caharel S (2011) ERP evidence for the speed of face categorization in the human brain: Disentangling the contribution of low-level visual cues from face perception. Vis. Res. 51:1297–1311. https://doi.org/10.1016/j.visres.2011.04.003
Batty M, Taylor MJ (2006) The development of emotional face processing during childhood. Dev. Sci. 9:207–220. https://doi.org/10.1111/j.1467-7687.2006.00480.x
Miki K, Watanabe S, Teruya M, Takeshima Y, Urakawa T, Hirai M, Honda Y, Kakigi R (2011) The development of the perception of facial emotional change examined using ERPs. Clin. Neurophysiol. 122:530–538. https://doi.org/10.1016/j.clinph.2010.07.013
Kolassa, I.-T., Kolassa, S., Musial, F. & Miltner, W. H. R. Event-related potentials to schematic faces in social phobia. Cogn. Emot. 21, 1721–1744. https://doi.org/10.1080/02699930701229189 (2007).
Steppacher, I., Schindler, S. & Kissler, J. Higher, faster, worse? An event-related potentials study of affective picture processing in migraine. Cephalalgia 36, 249–257. https://doi.org/10.1177/0333102415587705 (2016).
Iffland, B., Klein, F., Schindler, S., Kley, H. & Neuner, F. “She finds you abhorrent” - The impact of emotional context information on the cortical processing of neutral faces in depression. Cogn. Affect. Behav. Neurosci. 21, 426–444. https://doi.org/10.3758/s13415-021-00877-x (2021).
Adolphs R (2008) Fear, faces, and the human amygdala. Curr. Opin. Neurobiol. 18:166–172. https://doi.org/10.1016/j.conb.2008.06.006
Phelps, E. A. Emotion and cognition: insights from studies of the human amygdala. Annu. Rev. Psychol. 57, 27–53. https://doi.org/10.1146/annurev.psych.56.091103.070234 (2006).
Ohman A (2005) The role of the amygdala in human fear: Automatic detection of threat. Psychoneuroendocrinology 30:953–958. https://doi.org/10.1016/j.psyneuen.2005.03.019
Anderson, A. K., Christoff, K., Panitz, D., De Rosa, E. & Gabrieli, J. D. E. Neural correlates of the automatic processing of threat facial signals. J. Neurosci. 23, 5627–5633. https://doi.org/10.1523/JNEUROSCI.23-13-05627.2003 (2003).
Ochsner, K. N. et al. Reflecting upon feelings: An fMRI study of neural systems supporting the attribution of emotion to self and other. J. Cogn. Neurosci. 16, 1746–1772. https://doi.org/10.1162/0898929042947829 (2004).
O’Doherty, J. P. Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14, 769–776. https://doi.org/10.1016/j.conb.2004.10.016 (2004).
Arana FS, Parkinson JA, Hinton E, Holland AJ, Owen AM, Roberts AC (2003) Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J. Neurosci. 23:9632–9638. https://doi.org/10.1523/JNEUROSCI.23-29-09632.2003
Taylor, S. F., Phan, K. L., Decker, L. R. & Liberzon, I. Subjective rating of emotionally salient stimuli modulates neural activity. Neuroimage 18, 650–659. https://doi.org/10.1016/s1053-8119(02)00051-4 (2003).
Mielke, M. et al. Right medial temporal lobe structures particularly impact early stages of affective picture processing. Hum. Brain Mapp. 43, 787–798. https://doi.org/10.1002/hbm.25687 (2022).
Rellecke, J., Sommer, W. & Schacht, A. Emotion effects on the N170: a question of reference? Brain Topogr. 26, 62–71. https://doi.org/10.1007/s10548-012-0261-y (2013).
Rossion B, Jacques C (2008) Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170. Neuroimage 39:1959–1979. https://doi.org/10.1016/j.neuroimage.2007.10.011
Bentin S, Taylor MJ, Rousselet GA, Itier RJ, Caldara R, Schyns PG, Jacques C, Rossion B (2007) Controlling interstimulus perceptual variance does not abolish N170 face sensitivity. Nat. Neurosci. 10:801–802. https://doi.org/10.1038/nn0707-801
Thierry, G., Martin, C. D., Downing, P. & Pegna, A. J. Controlling for interstimulus perceptual variance abolishes N170 face selectivity. Nat. Neurosci. 10, 505–511. https://doi.org/10.1038/nn1864 (2007).
Thierry, G., Martin, C. D., Downing, P. E. & Pegna, A. J. Is the N170 sensitive to the human face or to several intertwined perceptual and conceptual factors?. Nat. Neurosci. 10, 802–803. https://doi.org/10.1038/nn0707-802 (2007).
Tanner D, Morgan-Short K, Luck SJ (2015) How inappropriate high-pass filters can produce artifactual effects and incorrect conclusions in ERP studies of language and cognition. Psychophysiology 52:997–1009. https://doi.org/10.1111/psyp.12437
Tanner D, Norton JJS, Morgan-Short K, Luck SJ (2016) On high-pass filter artifacts (they’re real) and baseline correction (it’s a good idea) in ERP/ERMF analysis. J. Neurosci. Methods 266:166–170. https://doi.org/10.1016/j.jneumeth.2016.01.002
Keil A, Debener S, Gratton G, Junghöfer M, Kappenman ES, Luck SJ, Luu P, Miller GA, Yee CM (2014) Committee report: Publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography. Psychophysiology 51:1–21. https://doi.org/10.1111/psyp.12147
Hoshiyama M, Kakigi R, Watanabe S, Miki K, Takeshima Y (2003) Brain responses for the subconscious recognition of faces. Neurosci. Res. 46:435–442. https://doi.org/10.1016/s0168-0102(03)00121-4
Watanabe S, Kakigi R, Koyama S, Kirino E (1999) Human face perception traced by magneto- and electro-encephalography. Brain Res. Cogn. Brain Res. 8:125–142. https://doi.org/10.1016/s0926-6410(99)00013-0
Miki K, Honda Y, Takeshima Y, Watanabe S, Kakigi R (2015) Differential age-related changes in N170 responses to upright faces, inverted faces, and eyes in Japanese children. Front. Hum. Neurosci. 9:263. https://doi.org/10.3389/fnhum.2015.00263
Acknowledgements
We are grateful for the cooperation of Gamagori city and Gamagori City Tourist Association. This study was funded by ImPACT Program of Council for Science, Technology and Innovation (Cabinet Office, Government of Japan). In addition, this study was supported by JSPS KAKENHI Grant Number JP17K12101, a Grant-in-Aid from Japanese Red Cross Academy, a Grant-in-Aid from Daiko Foundation, and a Grant-in-Aid from Aichi Health Promotion Foundation to K.M.
Author information
Authors and Affiliations
Contributions
K.M. designed the experiments. K.M. and T.K. performed the experiments and EEG data recording. K.M performed the EEG data analysis and statistical analyses. Y.T. made the program used for the stimulus presentation in this study. K.M. wrote the manuscript. R.K. made suggestions about this study. K.M. had overall responsibility for this study.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Miki, K., Takeshima, Y., Kida, T. et al. The ERP and psychophysical changes related to facial emotion perception by expertise in Japanese hospitality, “OMOTENASHI”. Sci Rep 12, 9089 (2022). https://doi.org/10.1038/s41598-022-11905-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-022-11905-2
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.