How our skin helps us to listen
What part of the body do you listen with? The ear is the obvious answer, but it’s only part of the story – your skin is also involved. When we listen to someone else speaking, our brain combines the sounds that our ears pick up with the sight of the speaker’s lips and face, and subtle changes in air movements over our skin. Only by melding our senses of hearing, vision and touch do we get a full impression of what we’re listening to.
When we speak, many of the sounds we make (such as the English “p” or “t”) involve small puffs of air. These are known as “aspirations”. We can’t hear them, but they can greatly affect the sounds we perceive. For example, syllables like “ba” and “da” are simply versions of “pa” and “ta” without the aspirated puffs.
If you looked at the airflow produced by a puff, you’d see a distinctive pattern – a burst of high pressure at the start, followed by a short round of turbulence. This pressure signature is readily detected by our skin, and it can be easily faked by clever researchers like Bryan Gick and Donald Derrick from the University of British Columbia.
Gick and Derrick used an air compressor to blow small puffs of air, like those made during aspirated speech, onto the skin of blindfolded volunteers. At the same time, they heard recordings of different syllables – either “pa”, “ba”, “ta” or “da” – all of which had been standardised so they lasted the same time, were equally loud, and had the same frequency.
Gick and Derrick found that the fake puffs of air could fool the volunteers into “hearing” a different syllable to the one that was actually played. They were more likely to mishear “ba” as “pa”, and to think that a “da” was a “ta”. They were also more likely to correctly identify “pa” and “ta” sounds when they were paired with the inaudible puffs.
This deceptively simple experiment shows that our brain considers the tactile information picked up from our skin when it deciphers the sounds we’re listening to. Even parts of our body that are relatively insensitive to touch can provide valuable clues. Gick and Derrick found that their fake air puffs worked if they were blown onto the sensitive skin on the back of the hand, which often pick up air currents that we ourselves create when we speak. But the trick also worked on the back of the neck, which is much less sensitive and unaffected by our own spoken breaths.
While many studies have shown that we hear speech more accurately when it’s paired with visual info from a speaker’s face, this study clearly shows that touch is important too. In some ways, the integration of hearing and touch isn’t surprising – both senses involve detecting the movement of molecules vibrating in the world around us. Gick and Derrick suggest that their result might prove useful in designing aids for people who are hard of hearing.
Reference: Nature doi:10.1038/nature08572
More on perception:
- Infants match human words to human faces and monkey calls to monkey faces (but not quacks to duck faces)
- Brain treats tools as temporary body parts
- How wearing a cast affects sense of touch and brain activity
- Autistic children are less sensitive to the movements of living things
- Blind man navigates obstacle course perfectly with no visual awareness
Go Further
Animals
- This ‘saber-toothed’ salmon wasn’t quite what we thoughtThis ‘saber-toothed’ salmon wasn’t quite what we thought
- Why this rhino-zebra friendship makes perfect senseWhy this rhino-zebra friendship makes perfect sense
- When did bioluminescence evolve? It’s older than we thought.When did bioluminescence evolve? It’s older than we thought.
- Soy, skim … spider. Are any of these technically milk?Soy, skim … spider. Are any of these technically milk?
- This pristine piece of the Amazon shows nature’s resilienceThis pristine piece of the Amazon shows nature’s resilience
Environment
- This pristine piece of the Amazon shows nature’s resilienceThis pristine piece of the Amazon shows nature’s resilience
- Listen to 30 years of climate change transformed into haunting musicListen to 30 years of climate change transformed into haunting music
- This ancient society tried to stop El Niño—with child sacrificeThis ancient society tried to stop El Niño—with child sacrifice
- U.S. plans to clean its drinking water. What does that mean?U.S. plans to clean its drinking water. What does that mean?
History & Culture
- Séances at the White House? Why these first ladies turned to the occultSéances at the White House? Why these first ladies turned to the occult
- Gambling is everywhere now. When is that a problem?Gambling is everywhere now. When is that a problem?
- Beauty is pain—at least it was in 17th-century SpainBeauty is pain—at least it was in 17th-century Spain
- The real spies who inspired ‘The Ministry of Ungentlemanly Warfare’The real spies who inspired ‘The Ministry of Ungentlemanly Warfare’
- Heard of Zoroastrianism? The religion still has fervent followersHeard of Zoroastrianism? The religion still has fervent followers
Science
- Here's how astronomers found one of the rarest phenomenons in spaceHere's how astronomers found one of the rarest phenomenons in space
- Not an extrovert or introvert? There’s a word for that.Not an extrovert or introvert? There’s a word for that.
- NASA has a plan to clean up space junk—but is going green enough?NASA has a plan to clean up space junk—but is going green enough?
- Soy, skim … spider. Are any of these technically milk?Soy, skim … spider. Are any of these technically milk?
- Can aspirin help protect against colorectal cancers?Can aspirin help protect against colorectal cancers?
Travel
- What it's like to hike the Camino del Mayab in MexicoWhat it's like to hike the Camino del Mayab in Mexico
- Follow in the footsteps of Robin Hood in Sherwood ForestFollow in the footsteps of Robin Hood in Sherwood Forest
- This chef is taking Indian cuisine in a bold new directionThis chef is taking Indian cuisine in a bold new direction
- On the path of Latin America's greatest wildlife migrationOn the path of Latin America's greatest wildlife migration
- Everything you need to know about Everglades National ParkEverything you need to know about Everglades National Park