AI for the people making music

The creative value of a generated idea becomes clearer when you try to change it. Why keeping what you like matters to Maru’s AI research.

By Maru editorial team3 min read
  • ai
  • music
  • creativity
  • maru

A generated loop catches your ear. The snare arrives a little late, and that gives the groove its character. But the kick is too busy for your bass line. You want to keep the thing that surprised you and change the thing that gets in the way.

That second decision is where a music tool starts to reveal its creative value. Generating another loop might offer a fresh idea, but it could also lose the detail you wanted to develop.

At Maru, this is a question behind our AI research: how can generation leave more of those decisions in the musician's hands?

Keep the part that made you listen

Imagine working with that loop as MIDI, the note instructions an instrument plays. You can remove a kick, move an accent, or hear the same rhythm on another kit. The late snare survives because you can reach it independently.

A generated recording offers different possibilities. You might cut out a fragment, repeat it, stretch it, or build a new part around its texture. Its sound may be exactly what inspired you, even if you cannot separate every note inside it.

The form of the result changes what you can do next. Our Learn guide to audio generation explores those differences and ways to develop the material. A tool's ability to make something convincing is only one part of the choice; consider which details it leaves available to you.

Our hackathon experiments with a loop generator and morphing beatbox explored that space. We build tools and integrate different approaches to generation, with the aim of giving people material they can keep developing. The drum-kit research asks another part of the question: how do generated sounds work together when you arrange them?

A variation should give you a choice

Suppose you want the hats to leave more room in the verse. A variation that also changes the snare, harmony, and tempo makes you reconsider several decisions at once. You may find something wonderful, but it is harder to hear whether the change you asked for helped.

There is room for both exploration and precision. Early in a track, an unexpected result can suggest the whole direction. Later, you may want a small change that respects what you have already written. We want to investigate ways of guiding generation that support both moments.

Our take: judge a generative music tool by how it handles an idea you want to keep. Can you develop it, compare a variation, and return to the version that interested you? Those interactions matter as much as the first result.

The people behind the sound

Creative freedom also depends on respect for the people whose work makes a tool possible. The AI for Music principles call for authorization and recognition for human-made work, transparency, and participation by creators in development. We support these principles.

For Maru, that means examining the source material and permissions behind the models we use, explaining relevant limits, and involving artists in decisions about tools intended for them. Our Sparklizer collaboration, developed around Jazz Calls Home's vocal chain, shows how an artist's practice can give a tool its purpose.

The next time a generated phrase interests you, name the detail you want to preserve. Then try one change around it. Whether that detail survives tells you something about how much room the tool gives you to make the idea your own.