Audio Artifacts
Designing with AI across sound, image and space.
2024 · Experience design · Sound design · AI · Installation
- source sounds
- 3
- source sounds
- AI and audio tools
- 6
- AI and audio tools
- immersive installation
- 1
- immersive installation
/images/audio-artifacts/cover.jpgthe story
We collaborated with AI to imagine ‘audio artifacts’, translating sounds into images and images back into sound, to speculate on new ways of designing a space.
problem
Our human senses limit how we connect sound, image and touch. What could design find if sound led the process?
my role
Co-designer
what I did
Recorded and generated sounds, turned them into spectrograms and images, reimagined a room with AI, trained a model on the room’s own sounds, and staged it as an installation.
result
An immersive projection and soundscape, with a reimagined Room 402 built from its own sounds.
details
- tools
- Adobe Audition · AudioGen · Midjourney · Heroku · ImageBind · RAVE
- methods
- Sound recording · spectrogram analysis · multimodal AI · model training · projection installation
01Question
What if sound led the design?
Audio Artifacts explores how haptics, sound and visuals become entangled when we think and work with AI across senses, uncovering connections our own perception can’t.
02Sound to image
The sun, a song and a blend
A recording of the sun and an AI sound made from a human description of a song became spectrograms, then a blended spectrogram, a blended sound and a soundscape image.
- Record
- Describe
- Generate
- Spectrogram
- Blend
- Image
/images/audio-artifacts/01.jpg03Image to space
Room 402, reimagined
An ‘audio object’ reimagined the room’s window, pin-up wall and door. A model trained on those objects’ sounds produced a soundscape in the style of Room 402.
/images/audio-artifacts/02.jpg/images/audio-artifacts/03.jpg04Experience
An installation you can hear
The results came together as a projection and soundscape filling the room.
/images/audio-artifacts/04.jpgimpact
- DesignersA sound-first way to imagine space with AIInstallation
what I learned
- Leading with sound reveals connections images alone miss.
- AI is most useful as a collaborator across senses.
tools
- Adobe Audition
- AudioGen
- Midjourney
- ImageBind
- RAVE
- Projection