Audio Artifacts

Designing with AI across sound, image and space.

2024 · Experience design · Sound design · AI · Installation

source sounds
3
source sounds
AI and audio tools
6
AI and audio tools
immersive installation
1
immersive installation

the story

We collaborated with AI to imagine ‘audio artifacts’, translating sounds into images and images back into sound, to speculate on new ways of designing a space.

problem

Our human senses limit how we connect sound, image and touch. What could design find if sound led the process?

my role

Co-designer

what I did

Recorded and generated sounds, turned them into spectrograms and images, reimagined a room with AI, trained a model on the room’s own sounds, and staged it as an installation.

result

An immersive projection and soundscape, with a reimagined Room 402 built from its own sounds.

details
tools
Adobe Audition · AudioGen · Midjourney · Heroku · ImageBind · RAVE
methods
Sound recording · spectrogram analysis · multimodal AI · model training · projection installation

01Question

What if sound led the design?

Audio Artifacts explores how haptics, sound and visuals become entangled when we think and work with AI across senses, uncovering connections our own perception can’t.

02Sound to image

The sun, a song and a blend

A recording of the sun and an AI sound made from a human description of a song became spectrograms, then a blended spectrogram, a blended sound and a soundscape image.

  1. Record
  2. Describe
  3. Generate
  4. Spectrogram
  5. Blend
  6. Image
From sound to image

03Image to space

Room 402, reimagined

An ‘audio object’ reimagined the room’s window, pin-up wall and door. A model trained on those objects’ sounds produced a soundscape in the style of Room 402.

Reimagined room objects
Room 402, reimagined

04Experience

An installation you can hear

The results came together as a projection and soundscape filling the room.

The installation

impact

  • DesignersA sound-first way to imagine space with AIInstallation

what I learned

  • Leading with sound reveals connections images alone miss.
  • AI is most useful as a collaborator across senses.

tools

  • Adobe Audition
  • AudioGen
  • Midjourney
  • ImageBind
  • RAVE
  • Projection

Xiluva Mbungela · designer + researcher · 2026

Every text colour on my site meets WCAG AA.

edit