The McGurk Effect: When Seeing Changes Hearing

I tend to take my ears at their word. And yet they sometimes let my eyes lead them, without my noticing. That's exactly what the McGurk effect is about: an illusion discovered by accident nearly fifty years ago, and one that still trips up just about everyone, myself included.

A discovery born from a technical hiccup

In 1976, at the University of Surrey in Guildford, England, psychologist Harry McGurk and his colleague John MacDonald were studying how vision and hearing coordinate in very young infants. For their experiments, they asked a technician to lay a soundtrack over footage of a face. On one video, the lips articulate "ga." Over the top, they dubbed the sound "ba." On playback, both researchers heard... "da." Not the recorded sound, and not the visible syllable: a third one, out of nowhere.

The story is sometimes told with a technician getting chewed out for the "mistake." MacDonald has since set the record straight: there was nothing wrong with the tape. The decisive move was to listen with the eyes closed, then open. Eyes closed, you clearly hear "ba." Eyes open, "da" comes back. The illusion didn't come from the editing, but from perception itself.

When the brain settles the dispute between eye and ear

The result appeared on the last day of December 1976 in the journal Nature, under a title that has stuck: "Hearing Lips and Seeing Voices." The paper would go on to be cited thousands of times. Its idea is simple and dizzying: we don't just listen to speech, we watch it too.

Why "da"? The "b" is easy to see, since the lips close. The "g" forms at the back of the mouth, out of sight. Faced with two pieces of information that contradict each other, the brain doesn't pick a side: it looks for a compromise, and "d" sits right between the two, articulated behind the teeth. Rather than choose, it builds an in-between answer.

An illusion that resists everything

The most unsettling part is how sturdy it is. The effect works across many languages, in infants, even when the face and the voice don't share the same gender, and it holds up when you know full well what's going on. The specialists who have studied it for decades still get fooled. Close your eyes and the sound becomes itself again; open them and the illusion takes over once more.

It's a cousin of phenomena I've explored before, like the way the brain anticipates sound before it even arrives, or the way silence itself is something we actively perceive. The lesson is always the same: perceiving isn't passive recording, it's reconstruction. Our senses are in constant conversation, much as they are in sound synesthesia.

Try it yourself

The best thing is to experience it firsthand.

Watch the lips, then close your eyes: the sound doesn't change, but your perception flips.

So which sound do you hear when you watch the video, and which one do you hear with your eyes closed? Let me know in the comments.