How our skin helps us to listen
What part of the body do you listen with? The ear is the obvious answer, but it’s only part of the story – your skin is also involved. When we listen to someone else speaking, our brain combines the sounds that our ears pick up with the sight of the speaker’s lips and face, and subtle changes in air movements over our skin. Only by melding our senses of hearing, vision and touch do we get a full impression of what we’re listening to.
When we speak, many of the sounds we make (such as the English “p” or “t”) involve small puffs of air. These are known as “aspirations”. We can’t hear them, but they can greatly affect the sounds we perceive. For example, syllables like “ba” and “da” are simply versions of “pa” and “ta” without the aspirated puffs.
If you looked at the airflow produced by a puff, you’d see a distinctive pattern – a burst of high pressure at the start, followed by a short round of turbulence. This pressure signature is readily detected by our skin, and it can be easily faked by clever researchers like Bryan Gick and Donald Derrick from the University of British Columbia.
Gick and Derrick used an air compressor to blow small puffs of air, like those made during aspirated speech, onto the skin of blindfolded volunteers. At the same time, they heard recordings of different syllables – either “pa”, “ba”, “ta” or “da” – all of which had been standardised so they lasted the same time, were equally loud, and had the same frequency.
Gick and Derrick found that the fake puffs of air could fool the volunteers into “hearing” a different syllable to the one that was actually played. They were more likely to mishear “ba” as “pa”, and to think that a “da” was a “ta”. They were also more likely to correctly identify “pa” and “ta” sounds when they were paired with the inaudible puffs.
This deceptively simple experiment shows that our brain considers the tactile information picked up from our skin when it deciphers the sounds we’re listening to. Even parts of our body that are relatively insensitive to touch can provide valuable clues. Gick and Derrick found that their fake air puffs worked if they were blown onto the sensitive skin on the back of the hand, which often pick up air currents that we ourselves create when we speak. But the trick also worked on the back of the neck, which is much less sensitive and unaffected by our own spoken breaths.
While many studies have shown that we hear speech more accurately when it’s paired with visual info from a speaker’s face, this study clearly shows that touch is important too. In some ways, the integration of hearing and touch isn’t surprising – both senses involve detecting the movement of molecules vibrating in the world around us. Gick and Derrick suggest that their result might prove useful in designing aids for people who are hard of hearing.
Reference: Nature doi:10.1038/nature08572
More on perception:
- Infants match human words to human faces and monkey calls to monkey faces (but not quacks to duck faces)
- Brain treats tools as temporary body parts
- How wearing a cast affects sense of touch and brain activity
- Autistic children are less sensitive to the movements of living things
- Blind man navigates obstacle course perfectly with no visual awareness
Go Further
Animals
- Octopuses have a lot of secrets. Can you guess 8 of them?
- Animals
- Feature
Octopuses have a lot of secrets. Can you guess 8 of them? - This biologist and her rescue dog help protect bears in the AndesThis biologist and her rescue dog help protect bears in the Andes
- An octopus invited this writer into her tank—and her secret worldAn octopus invited this writer into her tank—and her secret world
- Peace-loving bonobos are more aggressive than we thoughtPeace-loving bonobos are more aggressive than we thought
Environment
- This ancient society tried to stop El Niño—with child sacrificeThis ancient society tried to stop El Niño—with child sacrifice
- U.S. plans to clean its drinking water. What does that mean?U.S. plans to clean its drinking water. What does that mean?
- Food systems: supporting the triangle of food security, Video Story
- Paid Content
Food systems: supporting the triangle of food security - Will we ever solve the mystery of the Mima mounds?Will we ever solve the mystery of the Mima mounds?
- Are synthetic diamonds really better for the planet?Are synthetic diamonds really better for the planet?
- This year's cherry blossom peak bloom was a warning signThis year's cherry blossom peak bloom was a warning sign
History & Culture
- Strange clues in a Maya temple reveal a fiery political dramaStrange clues in a Maya temple reveal a fiery political drama
- How technology is revealing secrets in these ancient scrollsHow technology is revealing secrets in these ancient scrolls
- Pilgrimages aren’t just spiritual anymore. They’re a workout.Pilgrimages aren’t just spiritual anymore. They’re a workout.
- This ancient society tried to stop El Niño—with child sacrificeThis ancient society tried to stop El Niño—with child sacrifice
- This ancient cure was just revived in a lab. Does it work?This ancient cure was just revived in a lab. Does it work?
- See how ancient Indigenous artists left their markSee how ancient Indigenous artists left their mark
Science
- Jupiter’s volcanic moon Io has been erupting for billions of yearsJupiter’s volcanic moon Io has been erupting for billions of years
- This 80-foot-long sea monster was the killer whale of its timeThis 80-foot-long sea monster was the killer whale of its time
- Every 80 years, this star appears in the sky—and it’s almost timeEvery 80 years, this star appears in the sky—and it’s almost time
- How do you create your own ‘Blue Zone’? Here are 6 tipsHow do you create your own ‘Blue Zone’? Here are 6 tips
- Why outdoor adventure is important for women as they ageWhy outdoor adventure is important for women as they age
Travel
- This royal city lies in the shadow of Kuala LumpurThis royal city lies in the shadow of Kuala Lumpur
- This author tells the story of crypto-trading Mongolian nomadsThis author tells the story of crypto-trading Mongolian nomads
- Slow-roasted meats and fluffy dumplings in the Czech capitalSlow-roasted meats and fluffy dumplings in the Czech capital