Young learners’ processing of multimodal input and its impact on reading comprehension: an eye-tracking study

Thumbnail
View/Open
Issue date
2020
Author
Pellicer-Sánchez, Ana
Tragant Mestres, Elsa
Conklin, Kathy
Rodgers, Michael
Serrano, Raquel
Llanes, Àngels
Suggested citation
Pellicer-Sánchez, Ana; Tragant Mestres, Elsa; Conklin, Kathy; Rodgers, Michael; Serrano, Raquel; Llanes, Àngels; . (2020) . Young learners’ processing of multimodal input and its impact on reading comprehension: an eye-tracking study. Studies in Second Language Acquisition, 2020, vol. 22, núm. 1, p. 1-22. https://doi.org/10.1017/S0272263120000091.
Impact

Google Scholar logo  Google Scholar
Share
Export to Mendeley
Metadata
Show full item record
Abstract
Theories of multimedia learning suggest that learners can form better referential connections when verbal and visual materials are presented simultaneously. Furthermore, the addition of auditory input in reading-while-listening conditions benefits performance on a variety of linguistic tasks. However, little research has been conducted on the processing of multimedia input (written text and images) with and without accompanying audio. Eye movements were recorded during young L2 learners’ (N = 30) processing of a multimedia story text in reading-only and reading-while-listening conditions to investigate looking patterns and their relationship with comprehension using a multiple-choice comprehension test. Analysis of the eye-movement data showed that the presence of audio in reading-while-listening conditions allowed learners to look at the image more often. Processing time on text was related to lower levels of comprehension, whereas processing time on images was positively related to comprehension.
URI
http://hdl.handle.net/10459.1/69007
DOI
https://doi.org/10.1017/S0272263120000091
Is part of
Studies in Second Language Acquisition, 2020, vol. 22, núm. 1, p. 1-22
Collections