Live Sound Photo

Print not only the image but also the sound contained in a live photo. Any time later, this sound can be extracted and played back !

Similar projects worth following
The goal of this project is to use the back of the photo paper to store the sound included in a Live Photo. Any time later, this sound can be extracted and played back.

See the video in my first Project Log "Demonstration"

The basic idea of this project is to convert  the sound of a Live Photo to a spectrogram.

This spectrogram is printed on the back side of the photo paper.

The spectrogram has two advantages :

  1. it can be converted back to sound.
  2. it can be printed like any other image.

This sound can be extracted any time later to add some life to the photo.

Please see the two video demonstrations for a proof of concept .

  • Software used

    Salah10/14/2017 at 22:40 0 comments

    Maybe the use of other software can add some quality to the process.

    I have used one software (Bitmaps & Waves) and I am not sure if I use this software with the optimal settings.

    I found another software : Praat . It seems powerful but I didn't use it because it is not as straightforward as Bitmaps & Waves

    If you find another software, please let me know.

  • Issue of sound's quality

    Salah10/14/2017 at 22:37 0 comments

    The extracted sounds are not of good quality.

    For now it is OK because it is just a proof of concept.

    It is important to note many things :

    1 - Only a part of the photo surface is used. If we can use all the surface, quality will be better

    2- The spectrogram is greyscale. If we use all the colors available, the sound's quality will be better

     There is already some colored spectrograms used where one color represents the left and other color represents the right part of a stereo sound.

    3- I don't know much about signal processing but I have read the following statement :
    "Using the abs() function on complex data is a lossy operation which throws away any phase information.
    The phase information encodes the waveform shapes and well as the timing of any transients in the FFT window.
    Since that information has been discarded, a magnitude spectrum or spectrogram alone can't be turned back into audio that sounds like the original speech.
    But if you keep the full complex results of the FFT, then a complex IFFT might be used in some sort of resynthesis process."

    Source :

    If that is the case, the solution would be to print the amplitude and the phase spectrograms at the same time : The amplitude in green color for example and the phase in red color, the blue color will be used to add more information to the amplitude spectrogram.

  • More information

    Salah10/14/2017 at 22:26 0 comments

    More information

  • Demonstration

    Salah10/14/2017 at 22:19 0 comments

    This video demonstrates the possibility of recording sound on a photo paper.

View all 4 project logs

Enjoy this project?



Similar Projects

Does this project spark your interest?

Become a member to follow this project and never miss any updates