How our skin helps us to listen
What part of the body do you listen with? The ear is the obvious answer, but it’s only part of the story – your skin is also involved. When we listen to someone else speaking, our brain combines the sounds that our ears pick up with the sight of the speaker’s lips and face, and subtle changes in air movements over our skin. Only by melding our senses of hearing, vision and touch do we get a full impression of what we’re listening to.
When we speak, many of the sounds we make (such as the English “p” or “t”) involve small puffs of air. These are known as “aspirations”. We can’t hear them, but they can greatly affect the sounds we perceive. For example, syllables like “ba” and “da” are simply versions of “pa” and “ta” without the aspirated puffs.
If you looked at the airflow produced by a puff, you’d see a distinctive pattern – a burst of high pressure at the start, followed by a short round of turbulence. This pressure signature is readily detected by our skin, and it can be easily faked by clever researchers like Bryan Gick and Donald Derrick from the University of British Columbia.
Gick and Derrick used an air compressor to blow small puffs of air, like those made during aspirated speech, onto the skin of blindfolded volunteers. At the same time, they heard recordings of different syllables – either “pa”, “ba”, “ta” or “da” – all of which had been standardised so they lasted the same time, were equally loud, and had the same frequency.
Gick and Derrick found that the fake puffs of air could fool the volunteers into “hearing” a different syllable to the one that was actually played. They were more likely to mishear “ba” as “pa”, and to think that a “da” was a “ta”. They were also more likely to correctly identify “pa” and “ta” sounds when they were paired with the inaudible puffs.
This deceptively simple experiment shows that our brain considers the tactile information picked up from our skin when it deciphers the sounds we’re listening to. Even parts of our body that are relatively insensitive to touch can provide valuable clues. Gick and Derrick found that their fake air puffs worked if they were blown onto the sensitive skin on the back of the hand, which often pick up air currents that we ourselves create when we speak. But the trick also worked on the back of the neck, which is much less sensitive and unaffected by our own spoken breaths.
While many studies have shown that we hear speech more accurately when it’s paired with visual info from a speaker’s face, this study clearly shows that touch is important too. In some ways, the integration of hearing and touch isn’t surprising – both senses involve detecting the movement of molecules vibrating in the world around us. Gick and Derrick suggest that their result might prove useful in designing aids for people who are hard of hearing.
Reference: Nature doi:10.1038/nature08572
More on perception:
- Infants match human words to human faces and monkey calls to monkey faces (but not quacks to duck faces)
- Brain treats tools as temporary body parts
- How wearing a cast affects sense of touch and brain activity
- Autistic children are less sensitive to the movements of living things
- Blind man navigates obstacle course perfectly with no visual awareness
Go Further
Animals
- Soy, skim … spider. Are any of these technically milk?Soy, skim … spider. Are any of these technically milk?
- This pristine piece of the Amazon shows nature’s resilienceThis pristine piece of the Amazon shows nature’s resilience
- Octopuses have a lot of secrets. Can you guess 8 of them?
- Animals
- Feature
Octopuses have a lot of secrets. Can you guess 8 of them? - This biologist and her rescue dog help protect bears in the AndesThis biologist and her rescue dog help protect bears in the Andes
Environment
- This pristine piece of the Amazon shows nature’s resilienceThis pristine piece of the Amazon shows nature’s resilience
- Listen to 30 years of climate change transformed into haunting musicListen to 30 years of climate change transformed into haunting music
- This ancient society tried to stop El Niño—with child sacrificeThis ancient society tried to stop El Niño—with child sacrifice
- U.S. plans to clean its drinking water. What does that mean?U.S. plans to clean its drinking water. What does that mean?
- Food systems: supporting the triangle of food security, Video Story
- Paid Content
Food systems: supporting the triangle of food security
History & Culture
- Heard of Zoroastrianism? The religion still has fervent followersHeard of Zoroastrianism? The religion still has fervent followers
- Strange clues in a Maya temple reveal a fiery political dramaStrange clues in a Maya temple reveal a fiery political drama
- How technology is revealing secrets in these ancient scrollsHow technology is revealing secrets in these ancient scrolls
- Pilgrimages aren’t just spiritual anymore. They’re a workout.Pilgrimages aren’t just spiritual anymore. They’re a workout.
- This ancient society tried to stop El Niño—with child sacrificeThis ancient society tried to stop El Niño—with child sacrifice
Science
- Soy, skim … spider. Are any of these technically milk?Soy, skim … spider. Are any of these technically milk?
- Can aspirin help protect against colorectal cancers?Can aspirin help protect against colorectal cancers?
- The unexpected health benefits of Ozempic and MounjaroThe unexpected health benefits of Ozempic and Mounjaro
- Do you have an inner monologue? Here’s what it reveals about you.Do you have an inner monologue? Here’s what it reveals about you.
- Jupiter’s volcanic moon Io has been erupting for billions of yearsJupiter’s volcanic moon Io has been erupting for billions of years
Travel
- This chef is taking Indian cuisine in a bold new directionThis chef is taking Indian cuisine in a bold new direction
- On the path of Latin America's greatest wildlife migrationOn the path of Latin America's greatest wildlife migration
- Everything you need to know about Everglades National ParkEverything you need to know about Everglades National Park
- Spend a night at the museum at these 7 spots around the worldSpend a night at the museum at these 7 spots around the world