- Open Access
Reactivity to fearful expressions of familiar and unfamiliar people in children with autism: an eye-tracking pupillometry study
Journal of Neurodevelopmental Disorders volume 6, Article number: 14 (2014)
Individuals with autism are often reported to have difficulty with emotion processing. However, clinical and experimental data show that they are sensitive to familiarity; for example, they show normative attachment to familiar people, and have normative brain activity in response to familiar faces. To date, no study has measured their reactivity to the emotions of familiar vs. unfamiliar people. Thus, our aim was to determine whether individuals with autism would show normative reactivity to emotion in familiar people.
Participants were 21 children with autism and 21 children with typical development, aged two to five years, matched on age and gender. The children observed videos of familiar people (their child-care teachers) and unfamiliar people expressing fear, whilst their visual attention and pupillary reactions were recorded (the latter as an index of emotional reactivity), using eye tracking technology.
The children with autism showed normative pupillary reactions (peak magnitude) to fear expressed by familiar people, but a reduced response to fear expressed by unfamiliar people. However, across familiarity conditions, the children with autism had longer latency peak responses than the typically developing children. This pattern of findings was independent of cognitive factors or visual attention as visual attention by group was not related to familiarity condition. The children with autism had reduced visual attention to neutral faces; however, on fearful faces there were no group differences. Abnormalities in pupillary reactivity in the autism group were related to less prosocial behaviour and more severe play and communication deficits.
Children with autism were less atypical in their responses to fearful expressions of people they know, arguing against a pervasive emotional impairment in autism, but rather one that may be mediated by familiarity.
Emotional communication is one of the threads in the fabric of life that weaves together human relationships [1, 2]. Individuals with Autism Spectrum Disorders (ASDs), a group of neurodevelopmental disorders defined by social-communicative difficulties and behavioural rigidity , have difficulty with the processing of emotions (for review, see ). For example, they have difficulty recognising subtle and complex emotional expressions [5, 6], and a reduced physiological responses to emotion in others [7–9]. Despite the immense body of work on emotions in ASD to date (over 200 studies), nearly all studies have investigated the processing of emotion expressed by people who are unfamiliar to the participants . Thus, an important question remains regarding whether individuals with ASD also have difficulty with the processing of emotion expressed by people who are familiar to them.
Reactivity to the emotions of familiar vs. unfamiliar people
The differentiation in reactions to people based on familiarity is foundational for the organisation of social-emotional life [10, 11]. Familiarity and prior affective contact with a person determines the personal relevance of their emotions; for example, a big smile from an old friend is not processed in the same way as a big smile from an unfamiliar person. In typical development, evidence from social and developmental psychology indicates that the processing of emotions of familiar people is easier, faster and achieved earlier in development, than the processing of emotions of unfamiliar people [12–19]. Moreover, recent evidence suggests that even at 12 months, infants have similar brain activation patterns to adults during the processing of emotion in familiar people . Furthermore, typically developing individuals show more empathy towards familiar than unfamiliar people (for review, see ).
The only published study to date that has specifically contrasted emotion processing of familiar vs. unfamiliar people in participants with ASD has shown that children with ASD, like typically developing children, are more empathic towards caregivers than to unfamiliar people . However, a recent study by Fox and colleagues  on infants with a high- and low-risk for ASD (that is, children who did, and did not have an older sibling with ASD, respectively), found that high-risk infants did not show differentiated brain responses to happy expressions of familiar vs. unfamiliar people, as did the low-risk infants. Thus, more research is needed to determine whether individuals with ASD react to the emotions of familiar people in a normative way, and whether this is related to their everyday empathic functioning. This information is crucial for advancing our understanding of emotion processing in ASD; if normative processing of emotions in familiar people is found, then the neural architecture for emotion processing may be functional in ASD, but may require ‘bootstrapping’ from other neural circuits, such as those involved in the processing of familiar persons (for review, see [24, 25]).
Neural responses to familiar vs. unfamiliar people
Differential neural responses to emotions expressed by familiar vs. unfamiliar people rely on early emerging capacities to distinguish between people who are known vs. people who are not. Indeed, newborn infants show different behavioural responses to (emotionally neutral) familiar and unfamiliar people [26–28]. A developmental transition in responses to familiar vs. unfamiliar people is apparent in typical development, whereby very young infants (six to nine months old) show greater brain responses to familiar (neutral) faces than to unfamiliar (neutral) faces [29–31], in 18- to 24-month-old children this differentiation is marginal, it disappears in 24- to 45-month-olds and re-emerges in the opposite direction in 3- to 6-year-olds [32–35]. Thus, during the first years of life there seems to be a shift from a greater neural response to familiar faces to a greater neural response to unfamiliar ones.
Research on the processing of familiar vs. unfamiliar faces in ASD suggests that children, adolescents and adults process (emotionally neutral) familiar faces using typical neural networks, despite atypical brain activation during the processing of (emotionally neutral) unfamiliar faces [36–38]. Furthermore, whilst typically developing preschoolers show greater neural responses to unfamiliar (neutral) faces, relative to familiar (neutral) faces, pre-schoolers with ASD do not show this pattern of responses  (but see ). Together, these findings suggest neural abnormalities in the processing of unfamiliar, but not familiar, but not familiar persons, in those with ASD. This evidence is consistent with data suggesting that children with ASD are able to form attachments with their caregivers [40–42], along with findings of abnormalities in approach behaviour towards unfamiliar people [43–45].
Autonomic responses to familiar vs. unfamiliar people
Other than by measuring neural responses, responses to familiar vs. unfamiliar people may be captured by measuring autonomic responses. Certain autonomic nervous system (ANS) or physiological indicators signify only the sympathetic or parasympathetic branch of the ANS, such as skin conductance responses and respiratory sinus arrhythmia (RSA), respectively; other measures are indicators of both branches, such as heart rate and pupil size . Only one study has examined autonomic responses to familiar vs. unfamiliar people in autism, finding that school-aged children with autism had decreased RSA to unfamiliar people reading a story, compared to typically developing children, with no group differences in RSA to familiar people reading a story. However, to date, no study has measured autonomic responses to the emotion of familiar vs. unfamiliar people in individuals with ASD.
Timing of emotional responses in autism
Aside from the magnitude of one’s emotional responses, the timing of these responses plays an important role in everyday emotional reactivity and social reciprocity. For example, a delayed social smile from someone carries with it a different meaning than a social smile that is temporally contingent (upon the initial smile). In ASD, atypical emotional reactivity has been documented in studies focused on latency/timing of response to faces and other stimuli. Research on the processing of unfamiliar faces in individuals with ASD has identified slower event-related potentials (ERPs) to faces  and to emotional facial expressions , as well as slower emotion recognition [49, 50] and delayed facial reactivity to emotions . Importantly, shorter response latency to emotion in unfamiliar people has been associated with more empathic behaviour in young children with ASD , and more accurate emotion recognition in children and adolescents with ASD .
Few studies have reported on latency of response to familiar people in individuals with ASD. Dawson et al.  found no group differences in ERP latency to neutral facial expressions of familiar people in pre-schoolers with ASD compared to controls; however, there were also no group differences in ERP latency to unfamiliar people in this study. Key and Stone  studied ERP latency of response to expressively neutral familiar faces in infants with a high- and low-risk for ASD, and found that whilst low-risk children showed a longer latency response to unfamiliar faces (compared to familiar faces), high-risk children did not differentiate on the basis of familiarity. As no study has examined how individuals with ASD react to emotion in familiar people, it is also unknown if the timing of their response to emotion in familiar people is normative.
Measuring emotional responses with eye-tracking pupillometry
As emotional responses can be captured with a variety of neural and autonomic indicators, it is important to consider the advantages of a given measure over other measures. The recording of pupillary reactivity, a reliable indicator of emotional arousal [55, 56], using eye-tracking pupillometry (which measures pupillary responses with sensors in a computer-like monitor), offers three main advantages. First, eye-tracking pupillometry is non-invasive, and thus circumvents the issues surrounding the application of electrodes (for measuring ERPs, skin conductance responses or heart-rate), as this may in itself cause elevated arousal in these individuals due to common tactile sensitivities .
Second, as the measurement of neural and autonomic responses is sensitive to motion and individuals with ASD often have difficulty in following instructions and staying still for prolonged periods of time, movement-related artefacts are common in such data [58, 59]. However, advanced eye-tracking pupillometry systems are not susceptible to these artefacts (explained further in the Apparatus section).
Third, this technique may be easily combined with traditional eye-tracking parameters (that is, for gaze analysis). This is important, as attention to the emotional stimuli as well as gaze patterns may be measured, and relationships between attention patterns and emotional reactivity can be explored. For example, one study found no group differences in pupillary response to facial emotions; however, in the ASD group only visual attention to the mouth region was related to the pupillary response . Thus, this technology allows for an analysis of the relationship between attention to emotions and emotional reactivity, which is not available to neurophysiological and physiological systems that are not combined with eye tracking.
The use of eye-tracking pupillometry is fast gaining momentum in the study of emotion and face processing in ASD. One study identified that individuals with ASD, unlike typically developing individuals, have a greater pupillary response to inverted, relative to upright neutral faces . Another study found that unlike control participants, individuals with ASD do not have greater pupillary responses to smiling faces with direct eye gaze, compared to smiling faces with averted gaze . Also, two recent studies have identified abnormal pupillary reactions to emotional facial and vocal expressions in individuals with ASD [8, 63].
Studies using traditional eye-tracking parameters have shown that individuals with ASD use atypical face-scanning patterns, most notably, with less attention to the eye region [64–67]. Sterling and colleagues , examining familiar and unfamiliar (neutral) face-scanning, found less visual attention to the eye region in adults with ASD compared to typically developing adults, regardless of whether the stimulus face was familiar or unfamiliar. Thus, the face-scanning pattern of emotionally neutral familiar faces also seems to be atypical in ASD; however, it is not yet known if this applies to familiar faces expressing emotion.
The current study
The aim in the current study was to determine whether preschool children with ASD react to emotion in familiar vs. unfamiliar people in a normative way. To do so, we measured the pupillary reactions (magnitude and latency) of children with ASD and age- and gender-matched typically developing children to the fearful expressions of familiar vs. unfamiliar people, using eye-tracking pupillometry. We chose to use fearful facial expressions as this emotion has been found to produce large, detectable neurophysiological and physiological responses [69, 70]. Also, some research has indicated that individuals with ASD may have particular difficulty with recognising and reacting to fearful expressions of unfamiliar people [52, 71–74], but it is unclear if this is also the case for fearful expressions of familiar people.
Based on the findings reviewed above, we predicted that children with ASD would show abnormal reactions to fearful expressions in unfamiliar people, but normative reactions to fearful expressions in familiar people, compared to the comparison children. Furthermore, we predicted that the children with ASD would have less visual attention to the eye region of neutral faces, across familiarity conditions. We also aimed to explore any group differences in visual attention to fearful faces, to examine whether everyday empathic behaviour was related to attention as well as to the magnitude and latency of reactivity in each group. We also investigated the relationship between emotional reactivity and autism severity.
Twenty-five children with ASD and 21 typically developing (TD) children, aged two to five years, participated in the study. However, four children in the ASD group were excluded due to low visual attention (<20%) to the stimuli, that is, <800 ms viewing time of the face region (Eye area of interest (AOI) + Mouth AOI) during the neutral or fear still frames of any of the videos (see Materials section). This resulted in 21 participants with ASD being included in subsequent analyses.
Participant characteristics are presented in Table 1. Both groups were recruited through a community childcare centre. The Mullen Scales of Early Learning was administered to all participants to measure cognitive ability (MSEL ). Following the recommendations of Dykens and Lense , our group was representative of the greater ASD population in terms of cognitive ability , with 66.7% low-functioning and 33.3% high-functioning (at a cut-off of 70 standard score for high-functioning ). Thus, as expected, the ASD group was lower in cognitive ability than the TD group (who all had a MSEL standard score in the normal range). Cognitive ability was, therefore, used as a covariate in the analyses, where appropriate.
Diagnoses of the children with ASD were confirmed using the Autism Diagnostic Observation Schedule (ADOS; ) by expert clinicians with 15 children meeting criteria for Autistic Disorder and 6 meeting criteria for ASD. One participant was taking methylphenidate at the time of testing; however, as this participant was not an outlier on any dependent variable, and results were not altered with the exclusion of the participant’s data, he was retained in the sample. Exclusion criteria for the TD children were a history of autistic symptoms, as reported by their parents and the child-care staff. All participants, including the typically developing participants, were free from any other medical conditions, and had no visual, hearing or motor impairments. The research was approved by the La Trobe University Human Ethics Committee (Approval Number 11–052).
A Tobii 120 binocular eye tracker and Tobii Studio software (version 3.0.3 Tobii, Stockholm, Sweden) was used to present stimuli and record gaze position and pupil diameter. This system presents stimuli on a computer-like monitor (see Figure 1) and does not require any equipment to be fastened onto the participant. Using multiple sensors, with bright and dark pupil tracking, a 3D model of the pupil (taking into account optical distortions from the cornea and lens) is built, allowing for both pupil diameter and distance to be measured at a sampling rate of 60 Hz (one sample every 16.67 ms). With this tracking technique movement-related artefacts are dealt with in two ways. Firstly, as pupil size is usually a function of distance (of the participant’s head to the monitor), the effect of head movements (perpendicular to the monitor) was eliminated from pupil diameter on a sample-to-sample basis by the Tobii system, using basic principles of trigonometry. Secondly, other head movements (that is, parallel to the monitor) were accurately tracked by the Tobii system (up to 25 cm per second). Brightness of the eye-tracking monitor (W: 34 cm × H: 27 cm) was set to 100%.
Stimuli were videos of people initially showing a neutral expression, which gradually changed into a prototypic fear expression (eyes widened, eyebrows lifted, mouth ajar; see Figure 2 for still frames taken from one of the videos). Ten of the videos featured people familiar to the children and 10 featured unfamiliar people. For the children with ASD, the familiar people were their intervention therapists and centre staff within their childcare playroom, and for the TD children the familiar people also comprised the staff within their childcare playroom. The criterion that was set to ensure the childcare staff was familiar to the child participants was that the children had to be enrolled for a minimum of three months in the childcare facility.
In order to ensure that the fear expressions were of the intended valence and intensity, 10 typically developing adults (4 male, mean age: 25.1) rated the neutral and fear still frames from the videos on valence and intensity using the nine-point Likert rating scales from the International Affective Picture System, Self-assessment Manikin (SAM; ).
Three videos of familiar people (for each group) and three of unfamiliar people were selected on the basis on the mean SAM scores of valence (neutral range: 4.5 to 5.5, fear range: 1.4 to 2.7) and arousal/intensity (fear range: 5.5 to 7.6). There was a significant difference between valence ratings for neutral vs. fear (P s < .001), indicating that fear expressions were significantly more negative than neutral expressions. Inter-class correlations for scores were high (Cronbach’s alpha > .71) for each stimuli type (neutral, fear).
As different colours emit different levels of luminosity, the selected videos were first converted to grey scale so that pupil size would not be affected. Also, as the videos were not the same across all participants, the videos were matched on luminosity by analysis of the first still frame of the videos (per familiarity condition and group) using Adobe Photoshop 8.0 (Adobe Systems, San Jose, CA, USA). There were no significant differences in luminosity of familiar and unfamiliar stimuli, and between the stimuli for each group (all P > .55). A scrambled image was created from the neutral still frame for each video (and was also matched on luminosity to this still frame), which served as a buffer for the pupillary light reflex, to ensure that changes in pupil size captured during the presentation of the neutral expression were not due to pre-stimulus to stimulus luminosity changes (see Figure 2). Using iMovie HD 6.0.3 (Apple Computer Inc., Cupertino, CA, USA), the videos were adjusted so that the neutral and fearful expressions were each shown for 4 s in each video (that is, to standardise the presentation duration of expressions across the videos), and also so that the changes in pupil size could be captured to an unchanging stimulus, as subtle expression changes over time (for example, in duration of the genuine fearful expression) could account for the fluctuations in pupil size over time.
Everyday empathic behaviour questionnaire
The Empathy Questionnaire (EmQue)  was used to measure everyday empathic behaviour in the children. This parent-report questionnaire measures three traits of empathy observable in young children: 1) emotion contagion, 2) attention to others’ feelings, and 3) prosocial actions. Parents rate each item on a three-point Likert scale (0 = never, 1 = sometimes, and 2 = often), according to how applicable the behaviour has been to their child over the past two months.
Testing took place in a well-lit room of the childcare centre (from which the children were recruited), which had no external light. Ambient luminosity was checked before the start of each testing session using a handheld photometer (model PLMX, Quantam Instruments, Bartlett, IL, USA) and was the same for all participants. After written consent was obtained from the parent, s/he completed the EmQue. The participant was seated in a comfortable chair (see Figure 1), approximately 60 cm (36.46° visual angle) from the eye-tracking monitor. The experimenter first calibrated the child’s eye movements with the built-in five-point Tobii Studio calibration procedure, in which the children had to track a moving dot across the screen with their eyes. Following this, each child passively viewed the videos (with the order of the familiar vs. unfamiliar videos counterbalanced within each participant group), which were interspersed between the presentation of ‘filler’ stimuli (child-friendly pictures and videos) to maintain attention . Filler stimuli were linked to a button-press so that the time that these stimuli appeared on screen could be adapted flexibly for each child. Each trial consisted of a scrambled image (1 s), a neutral expression (4 s), a fearful expression (4 s), and time in-between these expressions, which varied from ‘actor’ to ‘actor’ (M = 2.167 s, SD = 0.600 s). Thus, each trial was a mean of 11.167 s. With six trials per participant (three trials for the familiar condition, three trials for the unfamiliar condition), the total experiment time was 67.002 s (that is, 6 × 11.167), or 1.12 minutes + the time for filler stimuli to be shown (which, as mentioned above, differed from child to child).
Pupil data, preprocessed by the Tobii system to be free of movement-artefacts (see Apparatus section), were further processed with a custom-built LabVIEW 2010 (National Instruments, Austin, TX, USA) algorithm (Beaton, 2012, unpublished). First, samples for which only one eye was tracked were eliminated (to minimize pupil size miscalculation due to head angle or ambient light exposure). Where both eyes were tracked, a mean pupil diameter across eyes was computed. Second, to cut out extreme sample-to-sample changes in pupil diameter due to partial lid closures (common in samples either side of missing data due to blinks), samples outside 2 × standard deviation of the mean rate of change (calculated for each participant) were removed. Third, gaps in data, due to blinks, were only linearly interpolated between stable data points (traces), to a maximum of 350 ms [83, 84]. A trace was deemed stable if there were a minimum of 50% of the samples in 2 × total length of the gap, pre- and post-gap. This method allowed for a differential threshold for interpolation, based on gap length and the reliability of the pre-/post-gap data. In the fourth step, pupil data that were recorded whilst the participant was looking outside of the AOI of the face area were excluded to ensure only pupillary response to the face was captured.
Visual attention data (fixation counts) were extracted from Tobii Studio using a fixation filter (I-VT), using the default pre-sets (maximum gap length: 75 ms, window length: 20 ms, velocity threshold: 30 degrees per second, maximum time between fixations: 75 ms, maximum angle between fixations: 0.5 degrees), with the exception that the minimum fixation duration was set to 100 ms. This minimum fixation duration was chosen as eye-tracking data of 100 ms or more are not only more reliable than data tracked for shorter durations , but are also considered to be a reliable index of what elements in a scene are actually captured and processed .
Finally, to compute a standardised peak pupillary response per 100 ms (since eye-tracking data are arguably not stable when recorded for less than 100 ms ), the following formula was used:
where a = peak amplitude of pupillary response (greatest percentage change in pupil diameter from neutral to fear), b = mean pupil diameter during each consecutive 100 ms of the fear expressions (40 × 100 ms = 4 s total) and c = mean pupil diameter during the neutral expressions. Latency of peak amplitude was therefore measured per 100 ms. Thus, the percentage change from neutral to fear was calculated for every 100 ms, and the peak was recorded as a. For example, if a for one participant was 7% on one of the conditions, and this happened in the 15th block of 100 ms (that is, at 1,500 ms), then this was the latency that was recorded.
Data were first analysed for skewness, kurtosis and outliers. Data were normally distributed; therefore, parametric tests were used in all analyses. For brevity, peak amplitude of pupillary response to fear expressed by familiar, and unfamiliar people, will be referred to as ‘peak amplitude to familiar fear’ and ‘peak amplitude to unfamiliar fear’, respectively, and latency of peak amplitude will be referred to as ‘peak latency’.
The relationship between cognitive ability and peak amplitude/peak latency was examined to determine whether it was necessary to control for the difference in cognitive ability between the two groups (see Table 1). The MSEL standard score (Early Learning Composite) was not related to the dependent variables in either group: peak amplitude, peak latency, fixation counts, or the EmQue scores (P range = .11 to .97). Thus all analyses were conducted without covarying the MSEL standard score (n.b., the results from covarying the MSEL standard score are given in the Endnotes for comparison).
Baseline pupil size
We also examined whether the groups were different on their resting-state pupil size (baseline pupil size whilst at rest). No group differences were found (and these results are published in a separate article ).
To determine whether the groups differed on their visual attention to the faces, a four-way ANOVA (two Groups × two Familiarity levels × two Emotions × two Face areas) was conducted on the fixation counts (100 ms visual attention). The main effect of Familiarity was significant, F(1,40) = 8.86, P = .005, η2 = .18, as was the main effect of AOI, F(1,40) = 9.67, P = .003, η2 = .20. The main effects of Group and Emotion were also significant, F(1,40) = 9.31, P = .004, η2 = .19, and F(1,40) = 4.59, P = .04, η2 = .10, respectively, which were driven by the significant Group × Emotion interaction, F(1,40) = 6.23, P = .01, η2 = .14. Pairwise comparisons showed that there was no difference between the groups on fixation counts to the faces expressing fear (P = .12, η2 = .06), but the TD group looked more to the neutral expressions than did the ASD group (P < .001, η2 = .31). Further, although the TD group did not differentiate their visual attention between neutral and fear, the ASD looked longer at the fearful expressions compared to the neutral expressions (P = .002, η2 = .22). a No other interaction effects were significant. Means are displayed in Figure 3 (for comparison, significant independent samples t-tests are also marked here). To minimise potential effects of group differences in visual attention, fixation count was covaried in subsequent analyses, using a composite score of fixation counts to the face area across all conditions. The total number of fixation counts to the whole Face AOI across experimental conditions (familiarity, emotion) for the groups (averaged across trials) was M = 44.19 (4.419 secs), SD = 20.70 for the ASD group and M = 58.95 (5.895 secs), SD = 23.98 for the TD group.
To determine whether the groups differed on reactivity to fear in familiar and unfamiliar people, a two-way ANCOVA (two Groups × two Familiarity levels) was conducted on the peak amplitude (change from neutral to fear expression), controlling for visual attention (fixation counts) to the stimuli. b Percentage change, from the neutral to fearful expression, over time is pictured in Figure 4. The main effect of Familiarity was not significant, F(1,39) = 1.80, P = .19, η2 = .04, but there was a main effect of Group, F(1,39) = 6.64, P = .01, η2 = .15, which was driven by the significant Group × Familiarity interaction, F(1,39) = 6.25, P = .02, η2 = .14. The effect of the visual attention covariate was not significant, F(1,39) = 0.26, P = .61, η2 = .007, therefore, the unadjusted mean scores are shown in Figure 5. Pairwise comparisons showed that there was no difference between the groups on peak amplitude to familiar fear (P = .67, η2 = .005), but the ASD group had reduced peak amplitude to unfamiliar fear (P = .005, η2 = .18) compared to the TD group, who had a greater peak amplitude to unfamiliar fear than to familiar fear (P = .002, η2 = .22); the ASD group did not differentiate between familiarity conditions (P = .78, η2 = .002). c
To determine whether the groups differed in peak latency, a two-way ANCOVA (two Groups × two Familiarity levels), again controlling for visual attention, was performed on peak latency (latency to peak amplitude change from neutral to fear expression). As is evident in Figure 6, there was a significant main effect of Group, F(1,39) = 14.53, P < .001, η2 = .27, but no main effect of Familiarity, F(1,39) = .34, P = .57, η2 = .009, nor a Group × Familiarity interaction, F(1,39) < .001, P = .998, η2 < .001, indicating that the children with ASD showed a longer response latency, compared to the TD group, across the familiarity conditions. The effect of the visual attention covariate was not significant F(1,39) = 0.88, P = .36, η2 < .02. d
Everyday empathic behaviour
To determine whether the groups differed in everyday empathic behaviour, t- tests were computed on the difference between the scores for each group on the EmQue sub-scales, and the EmQue total score. As can be seen in Table 2, children in the ASD group scored significantly lower on the EmQue total score and on the Attention to Others’ Feeling and Prosocial Behaviour EmQue sub-scales. Although the t-test did not differentiate the groups on the EmQue Emotional Contagion sub-scale, the ASD group had lower scores, and there was a medium effect size of the difference between the groups .
Associations with visual attention
To determine whether emotional reactivity was associated with visual attention, Pearson correlations were computed between fixation counts to the eye, mouth and face areas (eye + mouth AOI) and peak amplitude/peak latency (within each familiarity condition). As apparent in Table 3, in the ASD group, peak amplitude to familiar fear was positively related to fixation counts to the fearful familiar face (r = .51; P = .02), which was driven by fixation counts to the eye region of familiar faces (r = .64; P = .002). In the TD group, however, peak amplitude to familiar fear was positively related to fixation counts to the mouth region of familiar faces (r = .44; P = .045). Moreover, in the TD group, an association was also found between peak latency to familiar fear and fixation counts to fearful familiar faces (r = .43; P = .051), which appeared to be driven by fixation counts to the mouth region of familiar faces (r = .38; P = .09). No other correlations between fixations counts and peak amplitude/peak latency for either group were significant (all P s = .14 to .998).
Associations with empathic behaviour
To explore the relationships between emotional reactivity and everyday empathic behaviour, we computed Pearson correlations between the emotion variables (peak amplitude, peak latency) for each condition and EmQue scores. These correlations, both with and without partialling out the effect of cognitive ability (MSEL standard score) are shown in Table 4. The overall pattern of correlations is not affected by partialling out the effect of cognitive ability.
In the ASD group, the Prosocial Behaviour sub-scale of the EmQue was negatively related with peak latency to unfamiliar fear (r = -.55, P = .01), suggesting that the children with ASD who react more quickly to the fearful expressions of unfamiliar people, are more pro-social. In the TD group, the Attention to Others’ Feelings sub-scale was negatively related to peak amplitude to unfamiliar fear (r = -.44, P = .045), indicating that the TD children who responded less to the fearful expressions of unfamiliar people are reported as being more attentive to others’ feelings.
Associations with autistic symptoms
To determine whether autistic symptoms were related to pupillary reactivity, Pearson correlations between ADOS algorithm scores and peak amplitude/latency were computed for the ASD group. The Communication Algorithm and the Play Algorithm of the ADOS were both moderately negatively associated with peak amplitude of response to familiar fear (r = -.42, P = .06, and r = -.39, P = .08, respectively), but not with peak amplitude to unfamiliar fear (P s > .35). The Social Algorithm and the Restrictive and Repetitive Behaviours Algorithm were not related to any of these dependent variables (all P s > .18).
The main aim of the current study was to establish whether children with ASD react differentially to emotion in familiar vs. unfamiliar people, and whether they differ from typically developing children in their reactivity. In terms of amplitude of emotional response, as expected, the children with ASD reacted normatively to the fearful expressions of familiar people, which is consistent with previous findings on brain activity to familiar neutral faces in ASD [36–38]. However, the children with ASD were found to have reduced pupillary responses to the fearful expressions of unfamiliar people, relative to the typically developing children, which is also consistent with numerous previous reports mentioned above . This pattern of findings was independent of visual attention (group differences were based on emotion, not familiarity) or cognitive factors, indicating a difference in emotional reactivity to unfamiliar people per se. Thus, the data indicate that the often-reported abnormalities in emotional responses in this population may be particular to the emotions of unfamiliar people. It may be that for the children with ASD, familiarity with a person is necessary for an emotional response, which is not the pattern seen in typical development. These findings suggest that the neural architecture for emotion processing may be functional in ASD, but may require bootstrapping from circuits involved with the processing of familiar persons. For instance, it may be that the extraction of emotional information from faces, or the motivational drive to do so, is generally disrupted in ASD, but that this disruption may not apply to familiar people, that is, individuals with ASD might be more motivated to extract this information from people they know. This may be based not only on their affiliative bonds with familiar others, but also, perhaps as a consequence of, the more frequent emotional learning opportunities that come with familiar others. Thus, it may be that the emotional learning that derives from familiar people may not generalize to the emotions of unfamiliar people. Indeed, this interpretation is consistent with the often-reported difficulty in ASD with the generalization of skills across contexts (for example, ). Whereas in typical development this explicit-level reasoning does not seem related to emotional reactivity (as it seems to be based on implicit circuits), in ASD, emotional reactivity may rely on explicit emotion processing strategies [4, 90, 91]. Thus, it may be that explicit processing of the personal relevance of others’ emotions may help to bootstrap underpowered emotional brain circuits in individuals with ASD.
Many studies have identified reduced amygdala activation in individuals with ASD during the processing of emotions [90, 92, 93], and it is well established that the amygdala is a key structure in fear responses [94–96]. Both neuroanatomical and neuroimaging data suggest that pupillary responses are functionally linked to the amygdala [97–101]. Thus, the pupillary results presented in this study are consistent with the findings of Pierce and colleagues [36–38], who found a normative amygdala response in individuals with ASD to familiar, but not unfamiliar (neutral) faces. Together, these results may suggest that when individuals with ASD process the fearful expressions of familiar persons, this processing is at least partially mediated by the amygdala. However, the fearful expressions of unfamiliar people do not seem to engage the amygdala in the same way in these individuals. As pupillary responses are also mediated by the locus coeruleus [102–104], these results are also consistent with previous literature indicating abnormalities in the locus coeruleus-noradrenergic brain system which underlies physiological responses to stress in individuals with ASD [105, 106].
The findings relating to visual attention showed that compared to the TD children, the children with ASD had reduced visual attention to the neutral, but not the fearful expressions. Further, whereas the TD group did not differentiate between neutral and fearful expressions in their visual attention, the children with ASD did, with more visual attention towards the fearful expressions compared to the neutral expressions. This result seems to suggest that the visual attention of children with ASD is not ‘captured’ by neutrally expressive faces, as it is in typical development, but emotionally expressive faces help to close this attention gap between the groups. This pattern of results was also found in an eye-tracking study by Vivanti and colleagues , and is consistent with many studies showing less attention to (neutral) faces in ASD [108, 109].
Interestingly, the visual attention of the children with ASD to the eye region of fearful familiar faces was related to their pupillary response amplitude to these expressions. As this relationship was not found in both familiarity conditions, nor with both emotions (that is, neutral, fear), there does not appear to be an overall hyper-arousal to the eye region as suggested by some scholars [39, 110]. Moreover, for the fearful expressions of familiar people, the peak amplitude and number of fixations to the eye region were normative in the ASD group, suggesting that this relationship is mediated by more ‘normative’ scanning patterns, that is, the children with ASD did look at the eye region and, as a consequence, had normative reactivity to fearful expressions of familiar people. However, attention was not associated with the reduced response to emotion in unfamiliar people in the ASD group, and domain-general factors other than attention, such as motivation or perception, as mentioned above, are likely to play a role .
Although the amplitude of the pupillary response to fearful expressions of familiar people was similar across groups, the children with ASD showed longer latency responses in both familiarity conditions. Thus, children with ASD seem to have a general slowing in emotional responses, which is consistent with research showing longer latencies in emotion recognition, facial reactions and ERPs to emotions [50, 48, 51], but not with initial findings of response latency to familiar person stimuli . Thus, regardless of whether the fearful expression was by familiar or unfamiliar people, the data suggest that children with ASD have longer latency emotional responses. This finding is consistent with self-reports of individuals with ASD, one person describing that “… there are the times when it all feels like an intricate dance, and I’m a step out of synch with everyone else around me” . Some scholars have even suggested that emotional communication difficulties in ASD, along with other symptoms of this disorder, stem from a general problem with temporo-spatial processing (for review, see ). Others have suggested that temporal processing delays in ASD are related to less strengthened long-range connections between sub-cortical and cortical areas . Indeed, some functional connectivity studies in ASD have documented less coupling between the amygdala and the superior temporal sulcus, pre-frontal cortex, temporal lobe, premotor cortex and inferior frontal gyrus, and between the amygdala and fusiform via the primary visual cortex, during emotion processing [114–116]. Moreover, some evidence suggests that abnormalities in synaptic homeostasis are a risk factor for ASD . Thus, it is possible that our finding of a general delay in emotional responsivity in the ASD group may be reflective of delays or abnormalities in neural connectivity in this population. In the context of a fast-paced social interaction, slow emotional responses are likely to impact upon communication and social-reciprocity for children with ASD, and their construction of meaning of inter-personal communicative exchanges would consequently be disrupted.
The latency of emotional response amongst the children with ASD, particularly to unfamiliar people, appears to play an important role in their everyday emotional behaviour, as it was found that those children whose parents rated them as more prosocial have faster emotional responses. Thus, acting prosocially is related to the speed of reacting emotionally, which is consistent with previous reports of a relationship between ERP latency to emotional expressions with empathic behaviour  and emotion recognition .
Emotional reactivity also seems to have an association with ASD symptoms, with larger amplitude responses to fearful expressions of familiar people being related to fewer communication and play deficits. An important area for future research would be to examine the inter-relationship between emotional responses to familiar others and communication/play in children with ASD over the first years of life. One may posit that a greater response to the emotions of familiar others is a protective factor for the communication and play deficits associated with ASD. Given the interplay of emotion and social factors, that are both affected in ASD, a longitudinal study is necessary to establish the causal directions between such factors. By examining children in the first and second year of life, it could be established whether there are any critical periods for social communicative development which are related to response to emotion in familiar people.
Some limitations in the current study should be noted. Firstly, while the inclusion of an age-matched typically developing group was very useful to understand normative reactivity, the two groups were not matched on cognitive ability. The inclusion of a chronological and mental age-matched group would be ideal, and further research should incorporate such a control group. However, it should be noted that the dependent variables were not related to cognitive ability and even when cognitive ability was controlled, the pattern of results for each analysis remained largely unchanged (see Endnotes).
Secondly, following the recommendations of Nakagawa and Perneger [118, 119], due to our small sample sizes, we did not correct for multiple comparisons as traditional methods tend to be overly conservative, and we wanted to avoid inflating the probability of Type-II errors. Nevertheless, this must be taken into account when considering the results from the current study.
Thirdly, although research has indicated that pupil size is related to emotional arousal, for example,  (that is, more sympathetic ANS activity) in typically developing adults, more research is needed to establish whether the same physiological processes mediate emotional responses in children (with and without autism), as pupil dilation may also be related to less parasympathetic ANS activity in response to emotions in these populations.
Lastly, the analyses presented above were based on relatively small amounts of data (an average of less than two seconds in each condition, for each group, across only three trials). To avoid this issue, future research should include more trials of each familiarity condition; in the current study this was limited by the availability of familiar people to the children in both groups who made easily recognisable fearful facial expressions. Nevertheless, previous research suggests that conscious perception of emotional facial expressions is quite rapid (from 100 to 150 ms; ), thus the current results may not be affected.
Overall, the findings suggest that emotional reactivity in children with ASD to fearful expressions of familiar people is similar in magnitude, but slower than typically developing children, and this delayed response appears to be related to their prosocial behaviour. On the contrary, reactivity to fear expressed by unfamiliar people was abnormal in the ASD group in terms of both magnitude and latency. This pattern of results suggests that emotion processing difficulties in ASD appears not be an absolute impairment, but rather one that may be mediated by familiarity.
aWhen also controlling for cognitive ability, the only significant effect was that of Group, F(1,39) = 4.34, P = .044, η2 = .10. However, the cognitive ability covariate was not significant F(1,39) = 0.16, P = .69, η2 = .004.
bTo aid with interpretation of the pupillary change score data, the mean absolute pupil sizes on each of the two familiarity conditions for neutral and fear are also reported below (Fam = familiar condition, Unfam = unfamiliar condition) (Figure 7).
cWhen also controlling for cognitive ability the same overall pattern of results emerges. Pairwise comparisons show that the Group × Familiarity interaction, F(1,38) = 4.10, P = .05, η2 = .10, is again driven by no group difference on peak amplitude to familiar fear (P = .48, η2 = .01) but a reduced peak amplitude to unfamiliar fear in the ASD group compared to the TD group (P = .04, η2 = .11); in addition, there is a greater peak amplitude response to unfamiliar compared to familiar fear, which again can be seen in the TD group (P = .005, η2 = .19), but not in the ASD group (P = .78, η2 = .002). The effect of the cognitive ability covariate was not significant F(1,38) = 0.004, P = .95, η2 < .001.
dWhen also controlling for cognitive ability, again, the same pattern of results emerges; the only significant effect was that of Group, F(1,38) = 6.56, P = .02, η2 = .15. The cognitive ability covariate was not significant F(1,38) = 0.19, P = .66, η2 = .005.
eWritten consent was obtained from the people featured in Figures 2 and 3 for the publication of their images.
Autism diagnostic observation schedule
Autonomic nervous system
Area of interest
Autism spectrum disorder
Mullen scales of early learning
Respiratory sinus arrhythmia
Powers N, Trevarthen C: Voices of shared emotion and meaning: young infants and their mothers in Scotland and Japan. Communicative Musicality: Exploring the Basis of Human Companionship. Edited by: Malloch S, Trevarthen C. 2009, Oxford, UK: Oxford University Press, 209-240.
Tomasello M, Carpenter M, Call J, Behne T, Moll H: Understanding and sharing intentions: the origins of cultural cognition. Behav Brain Sci. 2005, 28: 675-691.
American Psychiatric Association [APA]: DSM-5: Diagnostic and Statistical Manual of Mental Disorders. 2013, Arlington, VA: American Psychiatric Publishing, Inc
Nuske HJ, Vivanti G, Dissanayake C: Are emotion impairments unique to, universal, or specific in autism spectrum disorder? A comprehensive review. Cogn Emot. 2013, 27: 1042-1061.
Baron-Cohen S, Wheelwright S, Jolliffe T: Is there a “language of the eyes”? Evidence from normal adults, and adults with autism or Asperger syndrome. Vis Cogn. 1997, 4: 311-331.
Greimel E, Schulte-Rüther M, Kircher T, Kamp-Becker I, Remschmidt H, Fink GR, Herpertz-Dahlmann B, Konrad K: Neural mechanisms of empathy in adolescents with autism spectrum disorder and their fathers. NeuroImage. 2010, 49: 1055-1065.
Blair R: Psychophysiological responsiveness to the distress of others in children with autism. Pers Indiv Differ. 1999, 26: 477-485.
Kuchinke L, Schneider D, Kotz SA, Jacobs AM: Spontaneous but not explicit processing of positive sentences impaired in Asperger’s Syndrome: pupillometric evidence. Neuropsychologia. 2011, 49: 331-338.
Riby DM, Whittle L, Doherty-Sneddon G: Physiological reactivity to faces via live and video-mediated communication in typical and atypical development. J Clin Exp Neuropsychol. 2012, 34: 385-395.
Herrmann E, Keupp S, Hare B, Vaish A, Tomasello M: Direct and indirect reputation formation in nonhuman great apes (Pan paniscus, Pan troglodytes, Gorilla gorilla, Pongo pygmaeus) and human children (Homo sapiens). J Comp Psychol. 2013, 127: 63-75.
Schmidt MF, Rakoczy H, Tomasello M: Young children enforce social norms selectively depending on the violator’s group affiliation. Cognition. 2012, 124: 325-333.
Beaupré MG, Hess U: An ingroup advantage for confidence in emotion recognition judgments: the moderating effect of familiarity with the expressions of outgroup members. Pers Soc Psychol Bull. 2006, 32: 16-26.
Elfenbein HA, Ambady N: When familiarity breeds accuracy: cultural exposure and facial emotion recognition. J Pers Soc Psychol. 2003, 85: 276-290.
Huynh CM, Vicente GI, Peissig JJ: The effects of familiarity on genuine emotion recognition. J Vis. 2010, 10: 628-628.
Kahana-Kalman R, Walker-Andrews AS: The role of person familiarity in young infants’ perception of emotional expressions. Child Dev. 2001, 72: 352-369.
MacDonald NE, Silverman IW: Smiling and laughter in infants as a function of level of arousal and cognitive evaluation. Dev Psychol. 1978, 14: 235-241.
Montague DP, Walker–Andrews AS: Mothers, fathers, and infants: the role of person familiarity and parental involvement in infants’ perception of emotion expressions. Child Dev. 2002, 73: 1339-1352.
Stinson L, Ickes W: Empathic accuracy in the interactions of male friends versus male strangers. J Pers Soc Psychol. 1992, 62: 787-797.
Walker-Andrews AS, Krogh-Jespersen S, Mayhew EMY, Coffield CN: Young infants’ generalization of emotional expressions: effects of familiarity. Emotion. 2011, 11: 842-851.
Minagawa-Kawai Y, Matsuoka S, Dan I, Naoi N, Nakamura K, Kojima S: Prefrontal activation associated with social attachment: facial-emotion recognition in mothers and infants. Cereb Cortex. 2009, 19: 284-
Preston SD, De Waal F: Empathy: its ultimate and proximate bases. Behav Brain Sci. 2002, 25: 1-20.
Hudry K, Slaughter V: Agent familiarity and emotional context influence the everyday empathic responding of young children with autism. Res Autism Spectr Disord. 2009, 3: 74-85.
Fox SE, Wagner JB, Shrock CL, Tager-Flusberg H, Nelson CA: Neural processing of facial identity and emotion in infants at high-risk for autism spectrum disorders. Front Hum Neurosci. 2013, 7: 89-
Gobbini MI, Haxby JV: Neural systems for recognition of familiar faces. Neuropsychologia. 2007, 45: 32-41.
Natu V, O’Toole AJ: The neural processing of familiar and unfamiliar faces: a review and synopsis. Br J Psychol. 2011, 102: 726-747.
Bushnell IW, Sai F, Mullin JT: Neonatal recognition of the mother’s face. Br J Dev Psychol. 1989, 7: 3-15.
Field TM, Cohen D, Garcia R, Greenberg R: Mother-stranger face discrimination by the newborn. Infant Behav Dev. 1984, 7: 19-25.
Walton GE, Bower NJ, Bower TG: Recognition of familiar faces by newborns. Infant Behav Dev. 1992, 15: 265-269.
Nakato E, Otsuka Y, Kanazawa S, Yamaguchi MK, Honda Y, Kakigi R: I know this face: neural activity during mother’s face perception in 7-to 8-month-old infants as investigated by near-infrared spectroscopy. Early Hum Dev. 2011, 87: 1-7.
De Haan M, Nelson CA: Recognition of the mother. Child Dev. 1997, 68: 187-210.
De Haan M, Nelson CA: Brain activity differentiates face and object processing in 6-month-old infants. Dev Psychol. 1999, 35: 1113-
Carver LJ, Dawson G, Panagiotides H, Meltzoff AN, McPartland J, Gray J, Munson J: Age-related differences in neural correlates of face recognition during the toddler and preschool years. Dev Psychobiol. 2003, 42: 148-159.
Dawson G, Carver L, Meltzoff AN, Panagiotides H, McPartland J, Webb SJ: Neural correlates of face and object recognition in young children with autism spectrum disorder, developmental delay, and typical development. Child Dev. 2002, 73: 700-717.
Todd RM, Lewis MD, Meusel L-A, Zelazo PD: The time course of social-emotional processing in early childhood: ERP responses to facial affect and personal familiarity in a Go-Nogo task. Neuropsychologia. 2008, 46: 595-613.
Moulson MC, Westerlund A, Fox NA, Zeanah CH, Nelson CA: The effects of early experience on face recognition: an event-related potential study of Institutionalized Children in Romania. Child Dev. 2009, 80: 1039-1056.
Aylward E, Bernier R, Field A, Grimme A, Dawson G: Normal activation of fusiform gyrus in adolescents and adults with autism during viewing of familiar, but not unfamiliar, faces. STAART/CPEA (Studies to Advance Autism Research and Treatment/Collaborative Programs for Excellence in Autism) NIH Network Meeting. 2004, 17: 20-
Pierce K, Haist F, Sedaghat F, Courchesne E: The brain response to personally familiar faces in autism: findings of fusiform activity and beyond. Brain. 2004, 127: 2703-
Pierce K, Redcay E: Fusiform function in children with an autism spectrum disorder is a matter of “who”. Biol Psychiatry. 2008, 64: 552-560.
Kylliäinen A, Wallace S, Coutanche MN, Leppänen JM, Cusack J, Bailey AJ, Hietanen JK: Affective–motivational brain responses to direct gaze in children with autism spectrum disorder. J Child Psychol Psychiatry. 2012, 53: 790-797.
Capps L, Sigman M, Mundy P: Attachment security in children with autism. Dev Psychopathol. 1994, 6: 249-249.
Dissanayake C, Crossley SA: Proximity and sociable behaviours in autism: evidence for attachment. J Child Psychol Psychiatry. 1996, 37: 149-156.
Sigman M, Ungerer JA: Attachment behaviors in autistic children. J Autism Dev Disord. 1984, 14: 231-244.
Gallo DP: Other important factors to take into consideration. Diagnosing Autism Spectrum Disorders: A Lifespan Perspective. 2010, 105-115.
Kasari C, Sigman M, Yirmiya N: Focused and social attention of autistic children in interactions with familiar and unfamiliar adults: a comparison of autistic, mentally retarded, and normal children. Dev Psychopathol. 1993, 5: 403-414.
Nadel J, Croué S, Mattlinger M-J, Canet P, Hudelot C, Lécuyer C, Martini M: Do children with autism have expectancies about the social behaviour of unfamiliar people? A pilot study using the still face paradigm. Autism. 2000, 4: 133-145.
Stern RM, Ray WJ, Quigley KS: Psychophysiological Recording. 2001, New York, NY: Oxford University Press
Webb SJ, Dawson G, Bernier R, Panagiotides H: ERP evidence of atypical face processing in young children with autism. J Autism Dev Disord. 2006, 36: 881-890.
Korpilahti P, Jansson-Verkasalo E, Mattila M-L, Kuusikko S, Suominen K, Rytky S, Pauls DL, Moilanen I: Processing of affective speech prosody is impaired in Asperger syndrome. J Autism Dev Disord. 2007, 37: 1539-1549.
Akechi H, Senju A, Kikuchi Y, Tojo Y, Osanai H, Hasegawa T: Does gaze direction modulate facial expression processing in children with autism spectrum disorder?. Child Dev. 2009, 80: 1134-1146.
Bal E, Harden E, Lamb D, Van Hecke AV, Denver JW, Porges SW: Emotion recognition in children with autism spectrum disorders: relations to eye gaze and autonomic state. J Autism Dev Disord. 2010, 40: 358-370.
Oberman LM, Winkielman P, Ramachandran VS: Slow echo: facial EMG evidence for the delay of spontaneous, but not voluntary, emotional mimicry in children with autism spectrum disorders. Dev Sci. 2009, 12: 510-520.
Dawson G, Webb SJ, Carver L, Panagiotides H, McPartland J: Young children with autism show atypical brain responses to fearful versus neutral facial expressions of emotion. Dev Sci. 2004, 7: 340-359.
Lerner MD, McPartland JC, Morris JP: Multimodal emotion processing in autism spectrum disorders: an event-related potential study. Dev Cogn Neurosci. 2013, 3: 11-21.
Key AP, Stone WL: Processing of novel and familiar faces in infants at average and high risk for autism. Dev Cogn Neurosci. 2012, 2: 244-255.
Bradley MM, Miccoli L, Escrig MA, Lang PJ: The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology. 2008, 45: 602-607.
Partala T, Surakka V: Pupil size variation as an indication of affective processing. Int J Hum-Comput Stud. 2003, 59: 185-198.
Marco EJ, Hinkley LB, Hill SS, Nagarajan SS: Sensory processing in autism: a review of neurophysiologic findings. Pediatr Res. 2011, 69: 48-54.
Patriquin MA, Scarpa A, Friedman BH, Porges SW: Respiratory sinus arrhythmia: a marker for positive social functioning and receptive language skills in children with autism spectrum disorders. Dev Psychobiol. 2013, 55: 101-112.
Tyszka JM, Kennedy DP, Paul LK, Adolphs R: Largely typical patterns of resting-state functional connectivity in high-functioning adults with autism. Cereb Cortex. 2013, [Epub ahead of print]
Wagner JB, Hirsch SB, Vogel-Farley VK, Redcay E, Nelson CA: Eye-tracking, autonomic, and electrophysiological correlates of emotional face processing in adolescents with autism spectrum disorder. J Autism Dev Disord. 2013, 43: 188-199.
Falck-Ytter T: Face inversion effects in autism: a combined looking time and pupillometric study. Autism Res. 2008, 1: 297-306.
Sepeta L, Tsuchiya N, Davies MS, Sigman M, Bookheimer SY, Dapretto M: Abnormal social reward processing in autism as indexed by pupillary responses to happy faces. J Neurodev Disord. 2012, 4: 17-
Anderson C, Colombo J, Shaddy DJ: Visual scanning and pupillary responses in young children with autism spectrum disorder. J Clin Exp Neuropsychol. 2006, 28: 1238-1256.
Dalton KM, Nacewicz BM, Johnstone T, Schaefer HS, Gernsbacher MA, Goldsmith HH, Alexander AL, Davidson RJ: Gaze fixation and the neural circuitry of face processing in autism. Nat Neurosci. 2005, 8: 519-526.
Pelphrey KA, Sasson NJ, Reznick JS, Paul G, Goldman BD, Piven J: Visual scanning of faces in autism. J Autism Dev Disord. 2002, 32: 249-261.
Klin A, Jones W, Schultz R, Volkmar F, Cohen D: Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002, 59: 809-816.
Trepagnier C, Sebrechts MM, Peterson R: Atypical face gaze in autism. Cyberpsychol Behav. 2002, 5: 213-217.
Sterling L, Dawson G, Webb S, Murias M, Munson J, Panagiotides H, Aylward E: The role of face familiarity in eye tracking of faces by individuals with autism spectrum disorders. J Autism Dev Disord. 2008, 38: 1666-1675.
Adolphs R, Tranel D, Damasio H, Damasio A: Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala. Nature. 1994, 372: 669-672.
Ekman P, Levenson RW, Friesen WV: Autonomic nervous system activity distinguishes among emotions. Science. 1983, 221: 1208-1210.
Howard MA, Cowell PE, Boucher J, Broks P, Mayes A, Farrant A, Roberts N: Convergent neuroanatomical and behavioural evidence of an amygdala hypothesis of autism. Neuroreport. 2000, 11: 2931-
Ogai M, Matsumoto H, Suzuki K, Ozawa F, Fukuda R, Uchiyama I, Suckling J, Isoda H, Mori N, Takei N: fMRI study of recognition of facial expressions in high-functioning autistic patients. Neuroreport. 2003, 14: 559-
Ashwin C, Baron-Cohen S, Wheelwright S, O’Riordan M, Bullmore E: Differential activation of the amygdala and the “social brain” during fearful face-processing in Asperger syndrome. Neuropsychologia. 2007, 45: 2-14.
Ashwin C, Chapman E, Colle L, Baron-Cohen S: Impaired recognition of negative basic emotions in autism: a test of the amygdala theory. Soc Neurosci. 2006, 1: 349-363.
Mullen EM: Mullen Scales of Early Learning. 1995, Circle Pines, MN: American Guidance Service
Dykens EM, Lense M: Intellectual disabilities and autism spectrum disorder: a cautionary note. Autism Spectrum Disorders. Edited by: Amaral D, Dawson G, Geschwind DH. 2011, Oxford, UK: Oxford University Press
Joseph RM: The significance of IQ and differential cognitive abilities for understanding ASD. The Neuropsychology of Autism. Edited by: Fein DA. 2011, Oxford, UK: Oxford University Press, 281-294.
Minshew NJ, Goldstein G, Siegel DJ: Speech and language in high-functioning autistic individuals. Neuropsychology. 1995, 9: 255-261.
Lord C, Rutter M, DiLavore PC, Risi S: Autism diagnostic observation schedule-WPS (ADOS-WPS). 1999, Los Angeles, CA: Western Psychological Services
Lang PJ: Self-assessment manikin. 1980, Gainesville, FL: The Center for Research in Psychophysiology, University of Florida
Rieffe C, Ketelaar L, Wiefferink CH: Assessing empathy in young children: construction and validation of an Empathy Questionnaire (EmQue). Personal Individ Differ. 2010, 49: 362-367.
Janisse MP: Pupillometry: the Psychology of the Pupillary Response. 1977, Washington, DC: Hemisphere Publishing Corporation
Chau M, Betke M: Real Time Eye Tracking and Blink Detection with USB Cameras. 2005, Boston, MA: Boston University Computer Science Department
Martineau J, Hernandez N, Hiebel L, Roché L, Metzger A, Bonnet-Brilhault F: Can pupil size and pupil responses during visual scanning contribute to the diagnosis of autism spectrum disorder in children?. J Psychiatr Res. 2011, 45: 1077-1082.
Komogortsev OV, Gobert DV, Jayarathna S, Gowda SM: Standardization of automated analyses of oculomotor fixation and saccadic behaviors. IEEE Trans Biomed Eng. 2010, 57: 2635-2645.
Poole A, Ball LJ: Eye tracking in human-computer interaction and usability research: current status and future prospects. Encyclopedia of Human Computer Interactions. Edited by: Ghaoui C. 2006, Hershey, PA: Idea Group, 211-219.
Nuske HJ, Vivanti G, Dissanayake C: Brief report: evidence for normative resting-state physiology in autism. J Autism Dev Disord. 2014, [Epub ahead of print]
Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Routledge Academic: Abington, UK
Hume K, Plavnick J, Odom SL: Promoting task accuracy and independence in students with autism across educational setting through the use of individual work systems. J Autism Dev Disord. 2012, 42: 2084-2099.
Critchley HD, Daly EM, Bullmore ET, Williams SC, Van Amelsvoort T, Robertson DM, Rowe A, Phillips M, McAlonan G, Howlin P, Murphy DG: The functional neuroanatomy of social behaviour: changes in cerebral blood flow when people with autistic disorder process facial expressions. Brain. 2000, 123: 2203-2212.
Winkielman P, McIntosh DN, Oberman L: Embodied and disembodied emotion processing: learning from and about typical and autistic individuals. Emot Rev. 2009, 1: 178-190.
Baron-Cohen S, Ring HA, Wheelwright S, Bullmore ET, Brammer MJ, Simmons A, Williams SC: Social intelligence in the normal and autistic brain: an fMRI study. Eur J Neurosci. 1999, 11: 1891-1898.
Corbett BA, Carmean V, Ravizza S, Wendelken C, Henry ML, Carter C, Rivera SM: A functional and structural study of emotion and face processing in children with autism. Psychiatry Res. 2009, 173: 196-205.
Le Doux JE: The Emotional Brain. 1996, New York: Simon and Schuster
Adolphs R, Tranel D, Damasio H, Damasio AR: Fear and the human amygdala. J Neurosci. 1995, 15: 5879-5891.
Davis M: The role of the amygdala in fear and anxiety. Annu Rev Neurosci. 1992, 15: 353-375.
Applegate CD, Kapp BS, Underwood MD, McNall CL: Autonomic and somatomotor effects of amygdala central N. stimulation in awake rabbits. Physiol Behav. 1983, 31: 353-360.
Graur S, Siegle G: Pupillary motility: bringing neuroscience to the psychiatry clinic of the future. Curr Neurol Neurosci Rep. 2013, 13: 365-
Urry HL, van Reekum CM, Johnstone T, Kalin NH, Thurow ME, Schaefer HS, Jackson CA, Frye CJ, Greischar LL, Alexander AL, Davidson RJ: Amygdala and ventromedial prefrontal cortex are inversely coupled during regulation of negative affect and predict the diurnal pattern of cortisol secretion among older adults. J Neurosci. 2006, 26: 4415-4425.
Ursin H, Kaada BR: Functional localization within the amygdaloid complex in the cat. Electroencephalogr Clin Neurophysiol. 1960, 12: 1-20.
Zbrozyna AW: Progress in Brain Research: The Rhinencephalon and Related Structures. Edited by: Bargmann W, Schade JP. 1963, New York, NY: Elsevier, 50-70. The anatomical basis of the patterns of autonomic and behavioural response effected via the amygdala,Volume 3.
Beatty J, Lucero-Wagoner B: The Pupillary System. Handbook of Psychophysiology. Edited by: Cacioppo JT, Tassinary LG, Berntson GG. 2000, Cambridge University Press: New York, NY, 142-162. 2
Loewenfeld IE, Lowenstein O: The Pupil: Anatomy, Physiology, and Clinical Applications. 1993, Ames, IA: Iowa State University Press Iowa
Rajkowski J, Kubiak P, Aston-Jones G: Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention. Soc Neurosci Abstr. 1993, 19: 974-
Mehler MF, Purpura DP: Autism, fever, epigenetics and the locus coeruleus. Brain Res Rev. 2009, 59: 388-392.
Takeuchi Y: Noradrenergic system. Encyclopedia of Autism Spectrum Disorders. 2013, New York, NY: Springer Publishing, 2053-2058.
Vivanti G, McCormick C, Young GS, Abucayan F, Hatt N, Nadig A, Ozonoff S, Rogers SJ: Intact and impaired mechanisms of action understanding in autism. Dev Psychol. 2011, 47: 841-856.
Jones W, Carr K, Klin A: Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. Arch Gen Psychiatry. 2008, 65: 946-
Falck-Ytter T, Bölte S, Gredebäck G: Eye tracking in early autism research. J Neurodev Disord. 2013, 5: 28-
Joseph RM, Ehrman K, McNally R, Keehn B: Affective response to eye contact and face recognition ability in children with ASD. J Int Neuropsychol Soc. 2008, 14: 947-955.
Matyjasik R: 2009, Retrieved from http://jerobison.blogspot.com/2009/07/wanting-to-be-accepted-as-i-am.html
Gepner B, Féron F: Autism: a world changing too fast for a mis-wired brain?. Neurosci Biobehav Rev. 2009, 33: 1227-1242.
Rippon G, Brock J, Brown C, Boucher J: Disordered connectivity in the autistic brain: challenges for the “new psychophysiology”. Int J Psychophysiol. 2007, 63: 164-172.
Grèzes J, Wicker B, Berthoz S, de Gelder B: A failure to grasp the affective meaning of actions in autism spectrum disorder subjects. Neuropsychologia. 2009, 47: 1816-1825.
Monk C: Neural circuitry of emotional face processing in autism spectrum disorders. J Psychiatry Neurosci. 2010, 35: 105-114.
Wicker B, Fonlupt P, Hubert B, Tardif C, Gepner B, Deruelle C: Abnormal cerebral effective connectivity during explicit emotional processing in adults with autism spectrum disorder. Soc Cogn Affect Neurosci. 2008, 3: 135-143.
Bourgeron T: A synaptic trek to autism. Curr Opin Neurobiol. 2009, 19: 231-234.
Perneger TV: What’s wrong with Bonferroni adjustments. BMJ. 1998, 316: 1236-
Nakagawa S: A farewell to Bonferroni: the problems of low statistical power and publication bias. Behav Ecol. 2004, 15: 1044-1045.
Esteves F, Öhman A: Masking the face: recognition of emotional facial expressions as a function of the parameters of backward masking. Scand J Psychol. 1993, 34: 1-18.
First and foremost, the authors would like to thank the families who took part in this study. The authors are also extremely grateful to Kavi Jayasinghe for his invaluable help with testing, to the wonderful staff at the La Trobe University Children’s Centre and Victorian Autism Specific Early Learning and Care Centre (especially Jenny Reynolds, Ed Duncan, Jess Feary, Kristy Capes, Dianna Pell, Shannon Upson, Sue Schoene, Danni Dart and Sanji Ahsan), and to Russell Beaton for his ingenious work on programming for data reduction.
The authors declare that they have no competing interests.
HN, GV and CD conceived of the study and design. HN conducted the research testing, arranged for the pupillary data reduction and analysed the data with guidance from GV and CD. HN and GV were involved in the interpretation of the data. HN drafted the manuscript, and GV and CD revised it critically, giving important intellectual content. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Nuske, H.J., Vivanti, G. & Dissanayake, C. Reactivity to fearful expressions of familiar and unfamiliar people in children with autism: an eye-tracking pupillometry study. J Neurodevelop Disord 6, 14 (2014). https://doi.org/10.1186/1866-1955-6-14
- Physiological reactivity
- Response latency