Reading while listening: why audio plus text helps you learn

Read a page silently in a language you’re learning and you face two hidden problems. You don’t know how many of the words sound, so you may be learning them wrong in your head. And nothing keeps you moving: you can stare at a sentence for as long as you like.

Listen to the same page without the text and you get the opposite problem. The words run together, you can’t tell where one ends and the next begins, and a sentence is gone before you’ve understood it.

Reading while listening, following a text while hearing it read aloud, solves both. The text shows you what the words are, and the audio shows you how they sound and keeps you going. It’s a simple idea with a growing body of research behind it.

What reading while listening is

Reading while listening means your eyes follow the written text as a recording of the same text plays. Ideally you can see exactly which word is being spoken, either because you follow closely or because the text is highlighted as it’s read.

It’s different from listening to an audiobook while you cook, which is listening practice, and from reading with background audio you aren’t following, which is just distraction. The point is that eyes and ears are on the same words at the same moment.

What the research says

Most studies of reading while listening involve learners of English, often in schools and universities in Asia, reading graded readers or short texts. Here are some of the clearest findings.

Better comprehension than listening alone. Chang (2009, “Gains to L2 listeners from reading while listening vs. listening only in comprehending short stories”) had 84 college students hear two stories, one while reading along and one by listening only. Scores were modestly higher, about 10%, when they could read along. The bigger difference was in how it felt: students strongly preferred reading along, found it easier and more interesting, and said they paid better attention.

At least as much vocabulary as reading alone, and far more than listening alone. Brown, Waring and Donkaewbua (2008, “Incidental vocabulary acquisition from reading, reading-while-listening, and listening to stories”) had Japanese university students meet made-up target words in three graded readers: one read silently, one read while listening, one only listened to. Reading and reading while listening produced similar gains, and both clearly beat listening alone. Recalling meanings was the hard part in every mode: after three months, students could translate only about one of the 28 target words. Asked which mode they preferred, 72% chose reading while listening, and none chose listening alone.

More vocabulary from repeated reading with audio. Webb and Chang (2012, “Vocabulary learning through assisted and unassisted repeated reading”) followed 82 Taiwanese students aged 15 and 16 who read short texts several times, either on their own or while listening to a recording. Both groups learned new words, and the group reading with audio learned significantly more.

Faster reading. Chang and Millett (2015, “Improving reading rates and comprehension through audio-assisted extensive reading for beginner learners”) reported that beginner learners in Taiwan who read graded readers with audio improved their reading rate and comprehension more than learners who read the same books silently. The authors credited the audio with setting a steady pace.

Real gains over a long program. Webb and Chang (2015, “Second language vocabulary learning through extensive reading with audio support: How do frequency and distribution of occurrence affect learning?”) tested 61 Taiwanese learners who read and listened to ten graded readers. They learned a substantial share of the target words they hadn’t known, and kept much of that three months later. Interestingly, how often a word appeared in the books didn’t significantly predict whether it was learned.

None of this makes audio a magic ingredient. A large review of incidental vocabulary learning by Webb, Uchihara and Yanagisawa (2023, “How effective is second language incidental vocabulary learning? A meta-analysis”) found broadly similar learning from reading, listening and reading while listening, though it could include only two studies of reading while listening. Effects vary between studies and learners, and the usual conditions still apply: the text needs to be at the right level, and you learn more from more reading. What the research does show consistently is that reading while listening helps comprehension compared with listening alone, works at least as well as reading alone, and is what most learners prefer, which matters when the goal is to keep reading for months.

Why it helps

There are several reasons why hearing and seeing the same words can support each other.

Sound and spelling get connected

In many languages, spelling is an imperfect guide to sound. Read silently and you’ll invent pronunciations; hear the words as you read them and you’ll correct those inventions before they settle.

• French: in Les enfants ont eu peur (“the children were frightened”), you hear a z sound linking les and enfants and a t linking ont and eu, while most final letters stay silent.
• Spanish: in Hoy he hablado con Hugo (“Today I talked to Hugo”), every h is silent.
• German: st and sp at the start of a word sound like sht and shp: Straße, Sport, Stadt.
• Russian: что (“what”) is pronounced shto, and unstressed vowels shift, so молоко (milk) sounds roughly like malakó.
• English: in I read it yesterday, read rhymes with red; in I read every day, it rhymes with reed. Only the context, or a voice, tells you which.

Word boundaries become visible

In speech, words blur together. Listening to a new language often feels like hearing one long word. When you read along, the text shows you where each word starts and ends, and over time your ear learns to find the boundaries on its own. That’s one reason reading while listening can make later listening without text easier.

The audio keeps you moving

A narrator doesn’t stop to agonize over a word. Reading along pulls you through the text at a steady pace, which builds reading speed and stops you rereading every sentence. You’ll miss the occasional word, and that’s fine: the next sentence often fills it in.

Voice carries meaning

Intonation shows where a sentence divides, which word matters most and whether a line is a question, a joke or a threat. In a narrated novel, different voices for different characters also tell you who is speaking, which helps in long stretches of dialogue.

It’s easier, so you read more

Many learners find that two channels are less tiring than one, as the students in Chang’s study did. When reading feels easier, you read more, and how much you read matters a great deal. See extensive reading.

Four ways to read while listening

There’s no single right method. Choose based on your level and what you want to practice.

1. Read along from the start

Best for: beginners, new scripts, the first chapters of a new book.

Play the audio and follow the words, ideally with highlighting. Don’t stop. When the chapter ends, go back to anything you missed. This is the gentlest way in, and it’s especially useful when you’re still learning a script; see how to learn a new alphabet by reading.

2. Read first, then listen

Best for: intermediate learners.

Read a section on your own at your own pace. Then play the audio and follow the text again. The second pass checks your understanding and your pronunciation, and shows you where your inner voice got a word wrong.

3. Listen first, then read

Best for: upper-intermediate learners who want to train their listening.

Listen to a section without the text and notice how much you understand. Then read along with the audio to fill in the gaps. Over time, the gaps shrink.

4. Listen again, without the text

Best for: consolidation, at any level.

Replay a chapter you’ve already read while you walk, commute or cook. Because you know the story and most of the words, you’ll follow far more than you would with new material. It’s one of the easiest ways to add listening time to your day.

For difficult passages at any level, slow down to one sentence at a time: read it, hear it, check its meaning, move on.

Common problems, and what to do

“The audio is too fast.” Read the section first, then listen. Use sentence-by-sentence practice for the hardest parts. If it’s still too fast, the text is probably above your level; an easier edition will teach you more. See how to choose your reading level.

“I stop looking at the text.” That’s listening, which is useful too, but it isn’t reading while listening. Word-by-word highlighting makes it much easier to keep your eyes in the right place.

“I want to stop and look things up.” Keep going on the first pass and note the word. Look it up afterwards, then read the passage again.

“I follow the audio but don’t understand much.” Then the words are passing by without meaning. Drop a level, or read the section on its own first.

How Lexo helps

Lexo is an iPhone and iPad app that makes reading while listening easy:

• Every book is narrated, with different voices for different characters, and the text highlights word by word as it’s read.
• Every word can be played on its own. Tap any word to hear it with natural pronunciation, see what it means in that sentence, and see the whole sentence translated.
• Sentence by sentence. A focused mode shows one sentence at a time with its audio and translation.
• Offline. Books download to your device, so you can read and listen without a connection.

The books are classic novels, rewritten at CEFR levels A2 to C2 in about 80 languages, and in most of those languages they’re fully narrated. A few languages, including Esperanto, Irish, Ukrainian, Urdu, Welsh, Yoruba and Zulu, have text and glosses now, with narration coming later.

Lexo is in beta and launching on the App Store soon. Get notified at launch.