DonationCoder.com forum
 
Read-only archive. This is a static copy of the DonationCoder.com forum. Reading and searching work as before; logging in, posting and private messages do not.
Archive of 2026-10-21 · About this archive · Main site

Author Topic: Extracting audio from visual information  (Read 4,481 times)

Renegade

  • Tell me something you don't know...
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,291
    • Participated in NANY Challenge Three Times
    • Furry Fandom Badge - Furry Fandom
    • Linux User
Extracting audio from visual information
« on: August 05, 2014, 03:53 AM »
This is pretty cool, but also a bit scary given the current world we live in.

http://newsoffice.mit.edu/2014/algorithm-recovers-speech-from-vibrations-0804

Quote
Researchers at MIT, Microsoft, and Adobe have developed an algorithm that can reconstruct an audio signal by analyzing minute vibrations of objects depicted in video. In one set of experiments, they were able to recover intelligible speech from the vibrations of a potato-chip bag photographed from 15 feet away through soundproof glass.

In other experiments, they extracted useful audio signals from videos of aluminum foil, the surface of a glass of water, and even the leaves of a potted plant. The researchers will present their findings in a paper at this year’s Siggraph, the premier computer graphics conference.

“When sound hits an object, it causes the object to vibrate,” says Abe Davis, a graduate student in electrical engineering and computer science at MIT and first author on the new paper. “The motion of this vibration creates a very subtle visual signal that’s usually invisible to the naked eye. People didn’t realize that this information was there.”

More at the link.

Here's a vid of it:


It reminds me of when I first heard about laser audio surveillance about 20 years ago.

Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

Edvard

  • Coding Snacks Author
  • Charter Honorary Member
  • Joined in 2005
  • ***
  • Posts: 3,027
    • Participated in NANY Challenge Once
    • Coding Snacks
    • Linux User
Re: Extracting audio from visual information
« Reply #1 on: August 05, 2014, 06:37 AM »
Wow.  Van Eck would be proud...  :o
All children left unattended will be given a mocha and a puppy.

Renegade

  • Tell me something you don't know...
  • Charter Member
  • Joined in 2005
  • ***
  • Posts: 13,291
    • Participated in NANY Challenge Three Times
    • Furry Fandom Badge - Furry Fandom
    • Linux User
Re: Extracting audio from visual information
« Reply #2 on: August 05, 2014, 06:49 AM »
Van Eck would be proud...  :o

I heard about that a while back, but never looked into it much. It's pretty wild.

Once you go down the EM rabbit hole, things get very weird, very quickly... The plasma cosmologists have some really disruptive things to say - stuff that shakes the foundations of pretty much all modern science.
Slow Down Music - Where I commit thought crimes...

Freedom is the right to be wrong, not the right to do wrong. - John Diefenbaker

40hz

  • Supporting Member
  • Joined in 2007
  • **
  • Posts: 11,861
Re: Extracting audio from visual information
« Reply #3 on: August 05, 2014, 07:14 PM »
The Butterfly Effect...FEAR IT! :tellme:

Original address: https://www.donationcoder.com/forum/index.php?topic=38618.0