Abstract
This study used eye-tracking to examine whether extraneous illustration details—a common design in beginning reader storybooks—promote attentional competition and hinder learning. The study used a within-subject design with first- and second-grade children. Children (n = 60) read a story in a commercially available Standard condition and in a Streamlined condition, in which extraneous illustrations were removed while an eye-tracker recorded children’s gaze shifts away from the text, fixations to extraneous illustrations, and fixations to relevant illustrations. Extraneous illustrations promoted attentional competition and hindered reading comprehension: children made more gaze shifts away from text in the Standard compared to the Streamlined condition, and reading comprehension was significantly higher in the Streamlined condition compared to the Standard condition. Importantly, fixations toward extraneous details accounted for the unique variance in reading comprehension controlling for reading proficiency and attending to relevant illustrations. Furthermore, a follow-up control experiment (n = 60) revealed that these effects did not solely stem from enhanced text saliency in the Streamlined condition and reproduced the finding of a negative relationship between fixations to extraneous details and reading comprehension. This study provides evidence that the design of reading materials can be optimized to promote literacy development in young children.
Similar content being viewed by others
Introduction
Learning to read is a crucially important skill because reading provides a gateway for learning within and outside of school. However, many children struggle to acquire the fundamental skill of learning to read and one-third of U.S. elementary school students are not reading at grade level1. Many factors contribute to children’s difficulty in learning to read, including (but not limited) to: neurodevelopmental disorders, lagging pre-reading skills (e.g., phonological awareness), and vulnerabilities in general cognitive functioning2,3,4. This study focuses on one potential factor that has received relatively little attention in the literature, namely the design of reading materials for beginning readers.
The typical design of books for beginning readers often includes engaging, colorful, detailed illustrations. There are a number of reasons for including illustrations in books for beginning readers such as defining the setting and characters, contributing to text coherence, reinforcing the text, providing additional information, and motivating the reader5,6. Yet, attention is a competitive process and only a subset of information can be selected for processing and represented in visual working memory7,8,9. In beginning readers, for whom reading has not yet become an automatized skill, engaging illustrations may compete for attention with text. If illustrations and text indeed compete for children’s attention, then the inclusion of extraneous illustrations may undermine children’s reading comprehension. Looking away from the text at illustrations may result in the encoding of irrelevant details into a working memory which may ultimately disrupt text coherence. It may be difficult for beginning readers to build a strong understanding of the story if they attend to extraneous illustrations while reading. Furthermore, attention regulation skills are still developing during the time when children begin formal reading instruction10,11,12; therefore, it is important to evaluate the possibility that unnecessary embellishments to educational materials intended to engage children might do so at the cost of disrupting attention and learning13,14,15,16. This possibility is particularly important to evaluate in light of the evidence that individual differences in selective attention are related to individual differences in reading skills17,18,19,20. Entertaining visuals in children’s educational materials have enormous potential to engage children—but these additional visuals might be counterproductive if they are unrelated to the story text as they may distract children from the primary task (i.e., decoding the words and making meaning from the text).
Extraneous details—also known as seductive details—are often included to increase motivation and foster situational interest21. There is a substantial body of research on the detrimental effects of extraneous details in educational materials with adult populations. The inclusion of extraneous details has been found to hinder the ability to recall important ideas and comprehension of material in scientific texts22, in lectures23, and in online lessons24. The Cognitive Load Theory suggests that unnecessary or extraneous material reduces the number of cognitive resources available for the target task and decreases performance and learning outcomes25,26,27,28. Multimedia design principles based on the Cognitive Load Theory suggest that when learners have to divide attention between images and text (Split-Attention Principle) and process irrelevant information (Coherence Principle) comprehension is significantly reduced29,30. In contrast to the large body of research on the design of educational materials for adult learners who are reading-to-learn, relatively few studies have examined this issue in children who are learning-to-read.
There is evidence that specific attributes of picture books influence the experiences of shared book reading for pre-reading children31,32. For example, Flack and Horst31 found in shared reading contexts with pre-readers that the presence of multiple illustrations per page was detrimental for children’s word learning31. A handful of studies with beginning readers suggests that presenting text without illustrations results in faster reading time and higher accuracy in elementary school students33,34,35. Evidence on the effects of illustrations on reading comprehension is mixed. Some studies suggest beneficial effects of including illustrations in text for beginning readers. For example, Rusted and Coltheart36 constructed prose passages describing novel creatures and asked 9 to 13-year-old children to read the passages either accompanied by a simple line drawing of a novel creature or without the drawing36. The results indicated that including simple line drawings with the passages improved recall of passage details in both good and poor readers. Hannus and Hyönä37 also reported positive effects of black-and-white line drawings on 4th-grade students’ comprehension of passages in a biology textbook (compared to a no-illustration condition); although, this effect was observed for students who scored high on a separately administered test of non-verbal intelligence and not for students who scored low on this test37. Other studies point to the detrimental effects of illustrations in beginning reader materials, particularly for struggling readers and children with learning disabilities. Rose38 conducted one of the few studies that used ecologically valid materials designed for independent reading practice and found the comprehension scores of students with learning disabilities were significantly higher for non-illustrated than for illustrated passages38. Coldstein and Underwood39 reviewed different styles of illustrations in reading materials for beginning readers and noted, “Clearly a variety of assumptions have been made by designers of reading scheme, but studies of the processes involved in learning to read have shed very little light on the role of illustration,” (p. 9)39. Nearly four decades later, we still know relatively little about the role of illustrations in reading materials for beginning readers and a number of questions remain unresolved.
First, several researchers have suggested that pictures may distract children from printed text38,39,40. Some researchers have further proposed that when text is accompanied by illustrations, working memory resources are devoted to processing pictures; thus, less resources are left for processing written text24,34. Yet, there is no direct evidence that beginning readers are distracted by illustrations, or that children attend less to the text in the presence of illustrations. Eye-tracking studies of shared story-book reading in pre-reading children suggest that pre-reading children overwhelmingly attend to images and only minimally attend to text41,42, whereas eye-tracking evidence from studies with older children who are reading-to-learn suggests that by fourth-grade children overwhelmingly attend to text and only minimally to illustrations37. However, no prior studies used eye tracking to examine the effect of illustrations on reading performance in beginning readers. Beginning readers are in a transition period: during primary school years children still experience social reading contexts such as a shared book reading with a teacher or caregiver, but beginning readers are also increasingly expected to read independently. The present work is aimed at understanding how best to support young readers’ during this transition period as they become independent fluent readers. Second, most prior studies focused on decoding—children’s ability to read words quickly and accurately—but few studies examined the effects of illustrations on reading comprehension. It is possible the detrimental effect of illustrations on decoding may be offset by the beneficial effects of illustrations on reading comprehension36. Indeed, instructing children to refer to illustrations to aid comprehension as well as decoding is a common instructional strategy in elementary school40,43. Alternatively, it is possible that by interfering with decoding, illustrations may also interfere with reading comprehension, as Torcasio and Sweller34 suggested, and as Rose38 observed in students with learning disabilities34,38. Lastly, prior research has investigated illustrations in materials for beginning readers in a binary fashion: illustrations were either present or absent. Perhaps the putative negative effects of illustrations on children’s reading performance can be minimized simply by removing extraneous illustrations, rather than by completely removing illustrations from beginning reader books.
This study aimed to address the limitations above. We examined the effects of extraneous illustrations on attention and reading comprehension in 1st- and 2nd-grade students (n = 60) using a commercially available book designed for independent reading practice in 1st grade. Half of the book was presented to children in a commercially available “Standard” condition, and half of the book was presented to children in a “Streamlined” condition in which extraneous illustrations were removed (schematic depiction of reading materials in each condition is shown in Fig. 1). The order of conditions was counterbalanced across participants and presented to children on a computer screen while an SMI RED250 mobile eye tracker recorded children’s eye gaze patterns. The primary measures of children’s attention during reading were gaze shifts away from text and fixations to extraneous details. A calibration study with adult fluent readers was conducted to methodically determine which illustrations were extraneous (see Method). Comprehension questions provided by the book publisher were administered to assess reading comprehension and were linked to the content presented on specific pages, making it possible to clearly distinguish events from the first or second half of the book (see “Methods” for sample questions). To control for reading level, reading accuracy was assessed using a Running Record44, which measures the percentage of words children decode accurately aloud. An independent assessment of reading proficiency—Word Recognition in Isolation test (WRI)45—was also administered.
Based on the theoretical framework of attention as a competitive process7,8,9, we expected that if text and illustrations compete for children’s attention, there should be a higher rate of gaze shifts away from the text in the Standard condition compared to the Streamlined condition. In line with the prediction of the Cognitive Load Theory30,34, we hypothesized that encoding extraneous illustrations in the Standard condition would negatively affect children’s reading comprehension compared to the Streamlined condition. To rule out the possibility the observed effects in the Streamlined condition stemmed from enhancing text saliency, we conducted a follow-up control experiment with another sample of 1st and 2nd-grade students (n = 60) implementing a Featureless Background condition (see Fig. 1 for a schematic depiction of reading materials in this condition).
Results
Reading level
Children were beginning readers as evidenced by their performance on the WRI, the independent measure of children’s reading proficiency (M = 68.87, SD = 18.89). The selected book was an appropriate difficulty level for independent reading based on children’s mean performance on the Running Record (M = 96.56%; SD = 4.15%). The manipulation to the book condition did not influence children’s decoding accuracy (Standard: M = 95.79%; SD = 4.13%; Streamlined: M = 95.78%; SD = 4.16%), paired-sample t(59) = 0.89, p = 0.38; Cohen’s d = 0.12.
Eye-tracking results
Eye-tracking data from 1 participant were not included in the analyses due to a technical failure. There were no significant differences in total looking duration at the book pages in the Standard condition (M = 42,339 ms; SD = 30,459 ms) compared to the Streamlined condition (M = 40,325 ms; SD = 31,856 ms), paired-sample t(58) = 1.09, p = 0.28; Cohen’s d = 0.14.
Gaze shifts
First, to examine the effect of removing extraneous illustrations on attention, we assessed how frequently children looked away from the text in each book condition. To assess possible order effects and grade differences, we conducted a linear mixed-effects model (LMM) on gaze shifts away from the text, with book condition, grade, and order modeled as fixed effects and subject as a random effect. Table 1 shows the estimations of fixed effects and the corresponding 95% confidence intervals (CI). There was a main effect of book condition, F(1, 58) = 40.26; p < 0.0005; Cohen’s d = 0.83. The fixed intercept value of 4.54 represents the mean gaze shifts away from the text while reading in the Streamlined condition. The intercept for gaze shifts away from the text in the Standard condition is 4.54 + 12.31 = 16.85, and this is significantly higher than the mean gaze shifts away from the text while reading in the Streamlined condition (t = 6.35, p < 0.0005, 95% CI for the difference is 8.42 to 16.19 higher). Follow-up pairwise comparisons after Bonferroni corrections revealed that on average, children looked away from the text 12.31 (SE = 1.94) more times per page in the Standard condition compared to the Streamlined condition. There was one extreme outlier (i.e., average gaze shifts that deviated >3 SD away from the group mean) in the Standard condition. With the removal of this outlier, there was still evidence of a main effect of book condition on gaze shifts away from the text, F = 39.53; p < 0.0005; Cohen’s d = 0.89. There was no significant main effect of grade with alpha set at 0.05, F(1, 56) = 3.78, p = 0.057; Cohen’s d = 0.42. However, the effect size is medium, indicating a trend of first-grade children looking away from the text while reading more than second-grade children: the intercept for gaze shifts away from the text for first-grade children is 4.54 + 6.99 = 11.53, and this is moderately higher than the mean gaze shifts away from the text for second-grade children (t = 1.95, p = 0.057, 95% CI for the difference is −0.21 to 14.21 higher). There was no main effect of order, F(1, 56) = 1.91, p = 0.173; Cohen’s d = 0.29, and no significant interactions between any of these factors and gaze shifts away from the text (all ps > 0.17; see Table S5 in the online Supplementary Material for LMM analysis with the interaction terms). Taken together, these results support the prediction that children look away from the text at a higher rate while reading the story in the Standard condition than in the Streamlined condition (see Fig. 2 for paired box plot).
Reading comprehension
To investigate our primary hypothesis—that removing extraneous details would improve reading comprehension—we assessed how well children could answer questions related to the content of the story they read in each book condition. To assess possible order effects and grade differences, we conducted a LMM on reading comprehension, with book condition, grade, and order modeled as fixed effects and subject as a random effect. Table 1 shows the estimations of fixed effects and the corresponding 95% CIs. There was a main effect of book condition, F(1, 59) = 65.80; p < 0.0005; Cohen’s d = 1.05. The fixed intercept value of 79.69 represents the mean comprehension scores (in %) for the Streamlined condition. The intercept for comprehension scores in the Standard Condition is 79.69−32.86 = 46.83, and this is significantly lower than comprehension scores in the Streamlined condition (t = −8.11, p < 0.0005, 95% CI for the difference is 24.75–40.96% lower). Follow-up pairwise comparisons after Bonferroni corrections revealed that on average, children scored 32.86% (SE = 4.05) higher on the comprehension assessment in the Streamlined condition compared to the Standard condition. There was one outlier with a comprehension score of 28.57% in the Streamlined condition. With the removal of this outlier, there was still evidence of a main effect of book condition on comprehension, F = 69.91; p < 0.0005; Cohen’s d = 1.05. There was no main effect of order, F(1, 57) = 1.16, p = 0.287; Cohen’s d = 0.16, or grade, F(1, 57) = 0.71, p = 0.402; Cohen’s d = 0.12, and no significant interactions between any of these factors and comprehension (all ps > 0.28; see Table S5 in the online Supplementary Material for LMM analysis with the interaction terms). These findings support the prediction that reading comprehension scores would be higher in the Streamlined condition than in the Standard condition (see Fig. 3 for paired box plot).
Association between eye gaze patterns and reading comprehension
We then examined the association between mean gaze shifts away from the text and fixations to extraneous details while reading and reading comprehension performance. It is plausible children looked away from the text more in the Standard condition compared to the Streamlined condition because children may attempt to use the illustrations as a strategy to help determine the meaning of unknown words. However, increased gaze shifts away from the text, r(57) = −0.62, 95% CI [−0.75, −0.43], p < 0.0005, and higher fixations to extraneous details r(57) = −0.42, 95% CI [−0.61, −0.18], p < 0.0005, were negatively associated with children’s comprehension scores in the Standard condition (see Fig. 4). In other words, the associations between reading comprehension scores with children’s eye gaze patterns indicate that not only are gaze shifts away from the text negatively associated with children’s reading comprehension performance, but children who often fixate on extraneous illustrations while reading have lower reading comprehension scores.
Next, we investigated whether reading in the Streamlined condition is especially useful for children with less developed attention regulation. For this analysis, a comprehension difference score for each child was calculated by subtracting the Standard condition comprehension score from the Streamlined condition score, such that higher and positive difference scores indexed greater gains in reading comprehension. Comprehension difference scores ranged from −57.14 to 85.71%, with a mean of 32.86% (SD = 31.38%). Higher gaze shifts away from the text r(57) = 0.63, 95% CI [0.45, 0.80], p < 0.0001 and higher fixations to extraneous illustrations, r(57) = 0.61, 95% CI [0.42, 0.75], p < 0.0005 were positively associated with how much children’s comprehension improved when reading in the Streamlined condition (see Fig. 5). Specifically, children who were more prone to look away from the text and who tended to fixate on extraneous illustrations while reading showed greater gains in comprehension when reading in the Streamlined condition.
To examine the extent to which fixations to extraneous details uniquely predicted how much children’s comprehension improved reading in the Streamlined condition, a multiple regression analysis was conducted that included extraneous illustration fixations, relevant illustration fixations, and WRI reading proficiency scores as predictors of children’s comprehension difference scores (see Table 2). The additive model accounted for 42.93% of the variability in comprehension difference scores (F = 13.79, df = 3, 55, p < 0.0001). The only significant predictor of comprehension difference scores was fixations to extraneous details (β = 0.95, t = 2.78, p = 0.007, 95% CI [0.27, 1.63]).
Follow-up control experiment
We conducted a follow-up experiment with another sample of 1st and 2nd-grade students (n = 60) to examine the possibility that the results above may be due to making the text more discriminable against the background, rather than due to the removal of extraneous illustrations. Towards this goal, we created a new condition: a Featureless Background condition, in which the text was placed on a white background but no other changes were made to the illustrations (see Fig. 1). We then compared children’s gaze shifts and reading comprehension in the Standard condition to the Featureless Background condition, using the same within-subjects design and procedure as Experiment 1 (see “Methods”). The results of the control experiment revealed a main effect of grade on gaze shifts away from the text, F(1, 57) = 8.44; p = 0.005; Cohen’s d = 0.71. The fixed intercept value of 16.95 represents the mean gaze shifts away from the text while reading in the Featureless Background condition. The intercept for gaze shifts away from the text for first-grade children is 16.95 + 11.15 = 28.10, and this is significantly higher than the mean gaze shifts away from the text for second-grade children (t = 2.91, p = 0.005, 95% CI for the difference is 3.47–18.84 higher). These findings reproduce a similar trend from Experiment 1 of first-grade children looking away from the text more frequently than second-grade children. There was no main effect of book condition (Cohen’s d = 0.07) nor order (Cohen’s d = 0.03) on mean gaze shifts away from text and reading comprehension scores (all Fs < 1.4, all ps > 0.24), ruling out the possibility that the observed effects in the Streamlined condition stemmed from enhancing text salience (see Table S7 and Table S8 in the online Supplementary Material for LMM analyses with and without the interaction terms). The control experiment replicated the following findings of the main experiment: lower reading comprehension scores were associated with higher tendency to look away from the text (r(58) = −0.51, 95% CI [−0.67, −0.30], p < 0.0005) and higher fixations to extraneous details (r(58) = −0.48, 95% CI [−0.65, −0.26], p < 0.0005). The results of the control experiment provide evidence that the effects of the Streamlined condition were not solely attributed to making the text more discriminable against the background. Results of the control experiment also replicate findings of the main experiment of the negative association between children’s eye-gaze patterns and reading comprehension. Full details of the implementation, method, and results from the control experiment are reported in the Supplementary Materials (pp. 10–19).
Discussion
The reported results provide evidence that excluding extraneous illustrations from reading materials for beginning readers can enhance children’s attention to the text and improve reading comprehension. These findings are strengthened further by the results of the follow-up control experiment, which provided evidence that the benefits of removing extraneous illustrations for attention and reading comprehension were unlikely to be driven by greater text discriminability. Nearly all children exhibited fewer gaze shifts away from the text and obtained higher comprehension scores when reading in the Streamlined condition compared to the commercially available Standard condition. Furthermore, children who frequently shifted their gaze away from the text and fixated on extraneous details while reading in the Standard condition (presumably, due to less developed attentional control) exhibited the greatest gains in comprehension from reading in the Streamlined condition. Importantly, the regression model revealed that the associations between children’s eye-gaze patterns and comprehension were not entirely due to variance shared with overall reading proficiency or the ability to match words with referents: fixations to extraneous illustrations was the only significant predictor of gains in reading comprehension, while reading proficiency (WRI scores) and fixations to relevant illustrations were not.
In the Standard condition, children made frequent gaze shifts away from the text to the illustrations. Frequent switching between two different tasks—reading the text to understand the story on one hand and exploring engaging illustrations on the other hand—might place too much extraneous load on young children’s working memory resulting in decreased reading comprehension46. Because illustrations matched the story text in the Streamlined condition (i.e., illustrations reinforced the text without extraneous load), children did not have an opportunity to encode illustration details that were irrelevant to the text. Instead, the relevant illustrations may have helped children integrate nonverbal information and text to develop a better representation of the story (for relevant findings with proficient readers see refs. 47,48). Future research is needed to test this possibility by comparing beginning readers’ comprehension in a book that contains only relevant illustrations and no illustrations, a possibility we are currently exploring.
The inclusion of only relevant illustrations may be particularly beneficial for children who frequently look away from the text because these children’s ability to selectively attend to relevant information while suppressing irrelevant, extraneous information is less efficient. Prior findings suggest that children’s attentional control and ability to focus in preschool and first grade are significant predictors of reading achievement years later in fourth grade and even into adulthood at age 2149,50. These results point to the importance of taking attentional control—a foundational component linked to school readiness and reading achievement—into account when designing educational materials.
One limitation to this study is that the reading comprehension assessment primarily focused on the recall of key story events, and as such assessed both understanding and memory of the story. In future research, it would be important to incorporate multiple assessments of comprehension, including assessments that have lower memory demands. Another limitation is that this study did not include an independent measure of attention. Future studies should include independent measures of attention to examine whether modifying aspects of the book design is generally beneficial for beginning readers or whether this instructional support is particularly promising for specific populations of children.
In summary, the results of this study show that extraneous illustrations details increase gaze shifts away from text and decrease reading comprehension in beginning readers. Furthermore, higher fixations to extraneous illustrations during reading were associated with lower reading comprehension scores. It is important to note that we are not advocating for the removal of illustrations from books, but rather encouraging consideration of whether and how the design of instructional reading materials for beginning readers can be optimized by taking into account children’s developing attention regulation skills. In addition, the motivational and engaging aspects of illustrations in books for beginning readers should not be ignored: it is well-known that children like pictures. Alice, the beloved character of Charles Dodgson’s story Alice’s Adventures in Wonderland51, famously wondered “what is the use of a book … without pictures?” In the present study the effect of removing extraneous illustrations on children’s engagement was not measured due to the nature of the within-subject design. However, children’s total looking duration and looking duration to pictures in the Streamlined and Standard conditions were approximately equal. Nevertheless, it remains to be explored in future research, whether removing extraneous illustration details may affect children’s motivation.
The nature of illustrations that accompany text may have important implications for attention and learning not just for students who are reading-to-learn but also for children who are learning-to-read. The findings presented here highlight the opportunity to improve the design of educational materials for beginning readers by limiting extraneous illustrations in order to better support children’s developing attentional regulation and reading comprehension. These findings suggest that enhancements to instructional reading materials should serve a clear purpose to engage the child with the story content while ensuring they do not interfere with performance and learning. The consideration of the potential costs of adding extraneous illustrations may be especially important for children with less developed attention regulation.
Methods
Participants
Sixty-six participants were recruited; however, only children who exhibited a minimum level of decoding proficiency on an independent measure of reading fluency (i.e., passed Level 1 on the Word Recognition in Isolation measure described below) continued with the study. Children who did not show the minimum level of reading proficiency to continue in the study, read a simpler book with the experimenter. The final sample consisted of 60 children (Mage = 7.56 years, SD = 7 months; 27 females, 24 males, and 9 children whose sex was not reported) in Grade 1 (n = 30) and Grade 2 (n = 30). See Table S2 in the online Supplementary Material for mean age and sex of participants by grade level. Primary school children were targeted for the present study as young children were hypothesized to be particularly susceptible to attentional competition between text and engaging illustrations due to the combination of their immature attention regulation system and developing decoding skills. Participants were recruited from schools in and around a Mid-Atlantic city in the United States. The race and ethnicity information for the sample reported by the parents was as follows: 41.7% White, 40.0% African American or Black, 10.0% Multi-Racial, 1.7% reported as Other, and 6.7% unreported. The experimental protocol was approved by the Carnegie Mellon University Institutional Review Board (protocol STUDY2017_00000301). Signed consent was obtained from the parents of participants. Children were tested individually by hypothesis-blind trained research assistants and children were given a small prize for their participation (e.g., a bouncy ball or marble maze toy).
Design, materials, and procedure
To maintain a high level of ecological validity, children read a commercially available book entitled Good Job Dennis from the “Hooked on Phonics®” curriculum for first grade (“Hooked on Phonics®” is a trademark of Sandviks HOP, Inc. This publication is not sponsored or endorsed by Sandviks HOP, Inc.). Detailed descriptions of the materials (including minor modifications to the book to equate the number of words across conditions), instructions, and procedure are provided in the Supplementary Materials. A brief overview is provided below. See Table S4 and Table S6 in the Online Supplementary Material for descriptive statistics on the reading and eye-tracking outcome measures by book condition.
Preliminary study: the classification of extraneous illustration details
A calibration study with adults (n = 15) was conducted to determine which illustrations were relevant and which were extraneous. Participants were presented with the book in the Standard layout and were given instructions to outline the details in the illustrations they believed were relevant to the story. The illustration details that participants reached over 90% agreement on were considered relevant illustrations and retained in the Streamlined condition, whereas the other illustration details were deemed extraneous illustrations and excluded.
The book condition was manipulated within-subjects: half of the book was presented to children in a commercially available “Standard” condition, and in the other half of the book the extraneous illustrations were removed (“Streamlined” condition). Minor modifications were made to the text to ensure each half of the book matched in length (see the online Supplementary Material for detailed explanation). The final version of the book used in this study contained a total of 12 pages (six double-page spreads), resulting in 6 pages (three double-page spreads) per condition. The average number of words per double-page spread was 43.0 in the first half of the book and 42.3 in the second half of the book. The book was presented on a laptop computer. Reading was self-paced, and participants advanced to the next screen by pressing a button on the keyboard. After reading the story, children’s reading comprehension was assessed. Note that children were informed that they would be asked a few questions about the story. Each testing session was videotaped with a Logitech C920 HD Pro Webcam. Testing sessions mimicked a guided-reading instructional session that children typically encounter when reading with a teacher. Thus, the experimenter scaffolded children’s decoding. For instance, when children made a decoding error or skipped a word, the experimenter prompted the child to try again and when necessary helped the child sound out the word. All prompts were recorded. These scaffolds were implemented to align with current literacy instruction practices and served to minimize children’s frustration.
Measures
Eye-tracking measures
An SMI RED250 mobile eye tracker52 was used to measure children’s eye movements while reading. On each page of the book, we created areas of interest (AOIs) for text, illustrations, and white space. Relevant illustration AOIs were designated as the illustration details retained for the Streamlined condition (mean area covered by relevant illustrations was M = 686,807 pixels), while extraneous illustration AOIs were designated as the details omitted in the Streamlined condition (mean area covered by extraneous illustrations was M = 622,332 pixels; a schematic depiction of this classification is shown in Fig. 6; see Table S1 in the online Supplementary Material for total pixels per page, by AOI). SMI BeGaze Eyetracking Analysis Software was then used to calculate average gaze shifts away from the text, average fixations to extraneous illustrations, and average fixations to relevant illustrations.
Word recognition in isolation test (WRI)
The WRI—adapted from Morris45—was administered to children prior to reading the story. The WRI measures children’s ability to recognize and decode individual words. The measure consists of a series of word lists that are graded in difficulty. Scores were calculated as the number of words read accurately in 90 s out of 100 total possible words. The WRI has been shown to be a strong predictor of contextual and oral reading levels53,54.
Reading accuracy
While children read the book aloud, the experimenter manually recorded the child’s decoding accuracy for each word in the story using a running record44. The experimenter also recorded any prompts that were administered. For each condition, decoding accuracy was calculated as the percentage of correct responses.
Reading comprehension
Reading comprehension is a complex process that has been notoriously challenging to assess55,56. Asking open-ended recall questions about a story (e.g., asking individuals to recall the characters, settings, character goals and solutions from the narrative) is one of the most common approaches to reading comprehension assessments with young children57,58,59. Furthermore, early childhood educators also use open-ended recall questions as the primary instructional strategy for reading comprehension in school settings60. One limitation of this assessment and similar measures is that they assess both children’s understanding of the events described in the text and their memory of the events; nevertheless, open-ended recall questions are considered one of the most appropriate assessments of reading comprehension with elementary school children57. Following this common practice, we chose to assess children’s reading comprehension using the open-ended questions provided by the book publisher labeled for educators, parents, and children as “reading comprehension questions.” Although these questions probe both children’s understanding and memory of the story, for brevity and following the convention in the literature, we refer to this outcome measure as a ‘reading comprehension’ assessment in this manuscript.
The commercially available book used in this study incorporated six suggested questions to assess children’s reading comprehension. To preserve ecological validity, we used the comprehension questions suggested by the publisher with minor modifications that ensured the questions were linked to the content presented on specific pages, making it possible to clearly distinguish events from the first or second half of the book (see the online Supplementary Material for the comprehension assessment modifications). There were three questions for each half of the book (two 2-point questions, and one 3-point question). A total of 14 points were possible, 7 points per condition. For example, in the first half of the book the job of the main character, Dennis, is described; these story details are not part of the content in the second half of the book. For the 2-point story question, children were asked, “What is Dennis’ job?” Children received full credit if they identified that Dennis directs traffic and helps children cross the street, 1 point for a partial answer (e.g., he helps children), and 0 points if they failed to recall Dennis’ job or provided an incorrect response. In the second half of the book, various animals escape from a pet shop including cats, dogs, birds, rabbits, and frogs; these story details are not part of the content in the first half of the book. For the 3-point question, children were asked, “What animals get out of the pet shop?” Children received full credit if they correctly identified all of the animals that escaped, 2 points if they identified at least 3 animals, 1 point if they identified only 2 animals, and 0 points if they failed to recall the animals that escaped or provided an incorrect response. Reading comprehension was measured as the percentage of correct responses (out of 7 possible points in each condition). The story questions were scored twice by hypothesis-blind research assistants who were also blind to the participants’ condition assignment. Inter-rater reliability using Cohen’s kappa61 was 0.85, indicating substantial coder consistency.
Children were also asked to orally recount the story as an additional measure of reading comprehension. The retelling measure was administered before the comprehension questions. Overall, children struggled with retelling the story, consistent with findings reported in prior literature suggesting that even on-grade readers tend to retell few main ideas and text details without question prompts62. Due to concerns about the overall low level of performance on the retelling measure, we report the details on the retelling measure administration, scoring, and results in the Supplementary Materials (pp. 20–22).
Statistical analyses
A LMM was applied with maximum likelihood method to determine the main effects of condition (Standard or Streamlined), grade, and condition order on gaze shifts away from the text and comprehension scores. A random intercept model was applied. The effect of condition was treated as a repeated measure with “Unstructured” as the repeated covariance type. Neither the condition × grade interaction nor the condition × order interaction was found to be significant during the model selection process. Therefore, no interaction terms were included in the final LMM analyses63. Follow-up pairwise comparison with Bonferroni confidence interval adjustment was used to compare mean gaze shifts away from the text and comprehension scores between conditions. Differences of means and 95% CIs were determined using the LMMs. Effect sizes were determined using Cohen’s d and calculated using mean differences from the mixed model, the standard deviation of the means, and the correlation between the two conditions for the within-subjects variables:
and calculated using mean differences from the mixed model, the standard deviation of the means, and the sample sizes for the between-subjects variables64:
Based on the Fisher r-to-z transformation, 95% CIs for Pearson Correlation Coefficients were calculated utilizing the Pearson product-moment correlation coefficient observed within the sample and the number of paired observations of the sample65. Alpha was set at 0.05 for all statistical tests. All tests for these and other analyses were two-tailed. All statistical analyses were conducted in IBM SPSS Statistics V26.
Reporting summary
Further information on experimental design is available in the Nature Research Reporting Summary linked to this article.
Data availability
The data reported and sample videos of children’s eye gaze patterns during reading are accessible in the Open Science Framework repository66, https://doi.org/10.17605/OSF.IO/FRGW8, https://osf.io/frgw8/?view_only=42259f9134024b54bd5adae2da7f9c2a.
Code availability
We used SPSS (v.26) to perform the analyses. The scripts used to analyze these data can be found in the Open Science Framework repository66, https://osf.io/frgw8/?view_only=42259f9134024b54bd5adae2da7f9c2a.
References
McFarland, J. et al. The Condition of Education 2017 (NCES 2017- 144). National Center for Education Statistics. https://nces.ed.gov/programs/coe/ (2017).
Dykman, R. A. & Ackerman, P. T. Attention deficit disorder and specific reading disability: separate but often overlapping disorders. J. Learn. Disabilities 24, 96–103 (1991).
Jacobson, L. A. et al. Working memory influences processing speed and reading fluency in ADHD. Child Neuropsychol. 17, 209–224 (2011).
Melby-Lervåg, M., Lyster, S. A. & Hulme, C. Phonological skills and their role in learning to read: a meta-analytic review. Psychol. Bull. 138, 322–352 (2012).
Carney, R. N. & Levin, J. R. Pictorial illustrations still improve students’ learning from text. Educ. Psychol. Rev. 14, 5–26 (2002).
Fang, Z. A review of research on teacher beliefs and practices. Educ. Res. 38, 47–65 (1996).
Bundesen, C. & Habekost, T. Principles of Visual Attention: Linking Mind and Brain (Oxford University Press, 2008).
Desimone, R. & Duncan, J. Neural mechanisms of selective visual attention. Annu. Rev. Neurosci. 18, 193–222 (1995).
Kastner, S. & Ungerleider, L. Mechanisms of visual attention in the human cortex. Annu. Rev. Neurosci. 23, 315–341 (2000).
Diamond, A. Executive functions. Annu. Rev. Psychol. 64, 135–168 (2013).
Fisher, A. V. & Kloos, H. In Executive Function in Preschool-age Children: Integrating Measurement, Neurodevelopment, and Translational Research (eds. Griffin, J. A., McCardle, P. & Freund, L. S.) 215–237 (American Psychological Association, 2016).
Posner, M. I., Rothbart, M. K. & Rueda, M. R. In The Oxford Handbook of Attention (eds. Nobre, A. C. & Kastner, S.) 541–569 (Oxford University Press, 2014).
Kaminski, J. A. & Sloutsky, V. M. Extraneous perceptual information interferes with children’s acquisition of mathematical knowledge. J. Educ. Psychol. 105, 351–363 (2013).
Parish‐Morris, J., Mahajan, N., Hirsh‐Pasek, K., Golinkoff, R. M. & Collins, M. F. Once upon a time: parent–child dialogue and storybook reading in the electronic era. Mind, Brain, Educ. 7, 200–211 (2013).
Petersen, L. A. & McNeil, N. M. Effects of perceptually rich manipulatives on preschoolers’ counting performance: established knowledge counts. Child Dev. 84, 1020–1033 (2013).
Tare, M., Chiong, C., Ganea, P. & DeLoache, J. Less is More: How manipulative features affect children’s learning from picture books. J. Appl. Dev. Psychol. 31, 395–400 (2010).
Casco, C., Tressoldi, P. E. & Dellantonio, A. Visual selective attention and reading efficiency are related in children. Cortex 34, 531–546 (1998).
Conners, F. A. Attentional control and the simple view of reading. Read. Writ. 22, 591–613 (2009).
Franceschini, S., Gori, S., Ruffino, M., Pedrolli, K. & Facoetti, A. A causal link between visual spatial attention and reading acquisition. Curr. Biol. 22, 814–819 (2012).
Gianvecchio, L. & French, L. Sustained attention, inattention, receptive language, and story interruptions in preschool Head Start story time. J. Appl. Dev. Psychol. 23, 393–407 (2002).
Harp, S. F. & Mayer, R. E. How seductive details do their damage: A theory of cognitive interest in science learning. J. Educ. Psychol. 90, 414 (1998).
Lehman, S., Schraw, G., McCrudden, M. T. & Hartley, K. Processing and recall of seductive details in scientific text. Contemp. Educ. Psychol. 32, 569–587 (2007).
Harp, S. F. & Maslich, A. A. The consequences of including seductive details during lecture. Teach. Psychol. 32, 100–103 (2005).
Sanchez, C. A. & Wiley, J. An examination of the seductive details effect in terms of working memory capacity. Mem. Cognition 34, 344–355 (2006).
Kirschner, P. A. Cognitive load theory: implications of cognitive load theory on the design of learning. Learn. Instr. 12, 1–10 (2002).
McCrudden, M. T. & Corkill, A. J. Verbal ability and the processing of scientific text with seductive detail sentences. Read. Psychol. 31, 282–300 (2010).
Park, B., Moreno, R., Seufert, T. & Brünken, R. Does cognitive load moderate the seductive details effect? A multimedia study. Computers Hum. Behav. 27, 5–10 (2011).
Sweller, J. In The Cambridge Handbook of Multimedia Learning (ed Mayer, R.) 19–30 (Cambridge University Press, 2005).
Clark, R. C. & Mayer, R. E. e-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning. 3rd edn. (Pfeiffer, 2012).
Fenesi, B., Kramer, E. & Kim, J. A. Split-attention and coherence principles in multimedia instruction can rescue performance for learners with lower working memory capacity. Appl. Cogn. Psychol. 30, 691–699 (2016).
Flack, Z. M. & Horst, J. S. Two sides to every story: children learn words better from one storybook page at a time. Infant Child Dev. 27, 1–12 (2018).
Strouse, G. A., Nyhout, A. & Ganea, P. A. The role of book features in young children’s transfer of information from picture books to real-world contexts. Front. Psychol. https://doi.org/10.3389/fpsyg.2018.00050 (2018).
Rice, D. R., Doan, R. L. & Brown, S. J. The effects of pictures on reading comprehension, speed and interest of second grade students. Read. Improvement 18, 308 (1981).
Torcasio, S. & Sweller, J. The use of illustrations when learning to read: a cognitive load theory approach. Appl. Cogn. Psychol. 24, 659–672 (2010).
Willows, D. M. A picture is not always worth a thousand words: Pictures as distractors in reading. J. Educ. Psychol. 70, 255–262 (1978).
Rusted, J. & Coltheart, V. The effect of pictures on the retention of novel words and prose passages. J. Exp. Child Psychol. 28, 516–524 (1979).
Hannus, M. & Hyönä, J. Utilization of illustrations during learning of science textbook passages among low- and high-ability children. Contemp. Educ. Psychol. 24, 95–123 (1999).
Rose, T. L. Effects of illustrations on reading comprehension. J. Learn. Disabilities 19, 542–544 (1986).
Coldstein, R. & Underwood, G. The influence of pictures on the derivation of meaning from children’s reading materials. J. Res. Read. 4, 6–16 (1981).
Samuels, S. J. Effects of pictures on learning to read, comprehension and attitudes. Rev. Educ. Res. 40, 397–407 (1970).
Evans, M. A. & Saint-Aubin, J. What children are looking at during shared storybook reading: evidence from eye movement monitoring. Psychol. Sci. https://doi.org/10.1111/j.1467-9280.2005.01636.x (2005).
Justice, L. M., Skibbe, L., Canning, A. & Lankford, C. Pre-schoolers, print and storybooks: An observational study using eye movement analysis. J. Res. Read. https://doi.org/10.1111/j.1467-9817.2005.00267.x (2005).
Bos, C., Mather, N., Dickson, S., Podhajski, B. & Chard, D. Perceptions and knowledge of preservice and inservice educators about early reading instruction. Ann. Dyslexia 51, 97–120 (2001).
Clay, M. M. The Early Detection of Reading Difficulties (Heinemann, 1985).
Morris, D. Diagnosis and Correction of Reading Problems (Guilford Publications, 2013).
Mayer, R. E. & Moreno, R. Nine ways to reduce cognitive load in multimedia learning. Educ. Psychologist 38, 43–52 (2003).
Butcher, K. R. Learning from text with diagrams: promoting mental model development and inference generation. J. Educ. Psychol. 98, 182–197 (2006).
Mason, L., Pluchino, P., Tornatora, M. C. & Ariasi, N. An eye-tracking study of learning from science text with concrete and abstract illustrations. J. Exp. Educ. 81, 356–384 (2013).
Alexander, K. L., Entwisle, D. R. & Dauber, S. L. First‐grade classroom behavior: its short‐ and long‐term consequences for school performance. Child Dev. 64, 801–814 (1993).
McClelland, M. M., Acock, A. C., Piccinin, A., Rhea, S. A. & Stallings, M. C. Relations between preschool attention span-persistence and age 25 educational outcomes. Early Child. Res. Q. 28, 314–324 (2013).
Carroll, L. Alice’s Adventures in Wonderland (Broadview Press, 1865).
SensoMotoric Instruments, SMI (RED250). [Screen-based Eye Tracker]. https://www.mindmetriks.com/red250mobile (2016).
Frye, E. M. & Gosky, R. Rapid word recognition as a measure of word-level automaticity and its relation to other measures of reading. Read. Psychol. 33, 350–366 (2012).
Morris, D. et al. Validating craft knowledge: an empirical examination of elementary-grade students’ performance on an informal reading assessment. Elem. Sch. J. 11, 205–233 (2011).
Cutting, L. E. & Scarborough, H. S. Prediction of reading comprehension: relative contributions of word recognition, language proficiency, and other cognitive skills can depend on how comprehension is measured. Sci. Studies Read. https://doi.org/10.1207/s1532799xssr1003_5 (2006).
Keenan, J. M., Betjemann, R. S. & Olson, R. K. Reading comprehension tests vary in the skills they assess: differential dependence on decoding and oral comprehension. Sci. Stud. Read. 12, 281–300 (2008).
Cain, K. & Oakhill, J. Profiles of children with specific reading comprehension difficulties. Br. J. Educ. Psychol. 76, 683–696 (2006).
Kendeou, P., Van den Broek, P., White, M. J. & Lynch, J. S. Predicting reading comprehension in early elementary school: the independent contributions of oral language and decoding skills. J. Educ. Psychol. 101, 765 (2009).
Paris, A. H. & Paris, S. G. Assessing narrative comprehension in young children. Read. Res. Q. 38, 36–76 (2003).
Walsh, R. L. & Hodge, K. A. Are we asking the right questions? An analysis of research on the effect of teachers’ questioning on children’s language during shared book reading with young children. J. Early Child. Lit. 18, 264–294 (2018).
Cohen, J. A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20, 37–46 (1960).
Nilsson, N. L. A critical analysis of eight informal reading inventories. Read. Teach. 61, 526–536 (2008).
Seltman, H. J. Mixed Models A flexible approach to correlated data. Exp. Design Analysis 357–377 (2018).
Faul, F., Erdfelder, E., Lang, A. G. & Buchner, A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175–191 (2007).
Lowry, R. VassarStats: Website for statistical calculation. [Statistical computing software]. http://vassarstats.net/rho.html (2020).
Eng, C., Godwin, K. E. & Fisher, A. V. Keep It Simple: Streamlining Book Illustrations Improves Attention and Comprehension in Beginning Readers. Open Science Framework, [Open source web application for researchers to document, share, and register research materials and data]. https://doi.org/10.17605/OSF.IO/FRGW8 (2020).
Team, R. R: A language and environment for statistical computing (Version 3.4.2). [Statistical computing and graphics software]. https://www.r-project.org/ (2017).
Acknowledgements
This work was supported in part by a National Science Foundation award (BCS-1730060) to A.V.F and K.E.G. and by the Institute of Education Sciences, U.S. Department of Education, through grant R305B150008 to Carnegie Mellon University. The opinions expressed are those of the authors and do not represent the views of the Institute or the U.S. Department of Education. We thank Kristen Boyle, Melissa Pocsai, and Oceann Stanley for assistance with data collection; Xavier Artache, Marie Shaw, Emery Noll, and Kristy Zhang for assistance with the systematic design of the storybook pages and AOIs; Priscilla Medor, Amy Lin, Rebeka Almasi, Hyunji Do, Graciela Garcia, Sara Jahanian, Elaine (Zhuyi) Xu, Smriti Chauhan, Isabel Rozario, and Matt King for assistance with coding data; and Dr. Howard Seltman, Junyi Zhang, Rebecca Gu, and Dejia Su for assisting with the eye-tracking data preprocessing and analyses; and Maanasi Bulusu with assistance in the design of the schematic illustrations. We are grateful to the children, parents, and educators who made this project possible.
Author information
Authors and Affiliations
Contributions
C.M.E. contributed to the design and implementation of the experiments and data analyses; K.E.G and A.V.F. contributed to study conceptualization and supervised the work. All authors contributed to the conception of the work, interpretation of the data, drafting and revising the work, approval of the completed version, and accountability for all aspects of the integrity of the work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Eng, C.M., Godwin, K.E. & Fisher, A.V. Keep it simple: streamlining book illustrations improves attention and comprehension in beginning readers. npj Sci. Learn. 5, 14 (2020). https://doi.org/10.1038/s41539-020-00073-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41539-020-00073-5