New: the Lumen ebook, the history and tools of AI in one bookDiscover it →

Voice, audio and music with AI

Transcribing meetings, giving a text a voice, dubbing a video, building an agent that answers the phone, composing a soundtrack. Tools, methods and the consent rules not to forget.

Mattia PanattaUpdated 13 October 202610 minBeginner
A smart speaker switched on next to a smartphone
Photo: Bence Boros · Unsplash

In short

  • Transcription is the most useful and underrated use: meetings, interviews and lectures become searchable, summarisable text.
  • Text-to-speech is now almost indistinguishable from a human voice: ElevenLabs is the benchmark.
  • Voice agents answer the phone, book, route calls. Useful, but they must be designed carefully.
  • Cloning a voice requires the person’s consent, and realistic generated audio must be disclosed.

From voice to text: transcription

Automatic transcription is now high quality, with speaker recognition and punctuation. You’ll find it:

  • in video-call apps (Meet, Teams, Zoom) and phone recorders;
  • in assistants: upload an audio file to ChatGPT, Claude or Gemini and ask for a transcript and summary;
  • in dedicated tools for long work (podcasts, interviews, hearings).

The value isn’t the text itself, but what you do with it next.

From minutes to action list

From the attached meeting transcript prepare:

  1. a 10-line summary;
  2. decisions made;
  3. actions to take, in a table: what, who, by when (if no deadline was stated, write “to be defined”);
  4. open questions. Don’t invent names or dates that don’t appear in the transcript.

Tell people before recording

Recording and transcribing a meeting with outside people requires informing them (and, where required, their consent). Transcripts contain personal data: treat them as such.

From text to voice: speech synthesis

With ElevenLabs (and similar tools) you paste a text and pick a voice: in seconds you get natural audio, with believable intonation and pauses. Typical uses:

  • audio versions of articles and newsletters (accessibility, listening on the go);
  • voice-over for videos, online courses, tutorials;
  • dubbing: the same video in several languages, keeping a voice similar to the original;
  • messages for switchboards and hold lines.

Practical tips: write for the ear (short sentences, no long lists), specify pronunciation of acronyms and foreign names, always listen to the whole file before publishing.

Cloning a voice: possible, but not casually

A few minutes of recording are enough to create a very faithful copy of a voice. It’s useful (a professional who “records” videos without reading them all) and dangerous (scams with cloned voices of relatives and executives are rising).

Minimum rules:

  • only your own voice, or that of someone who gave explicit, documented consent;
  • serious platforms ask for verification: it’s a safeguard, not a nuisance;
  • if you publish realistic generated audio, disclose it (AI Act, Art. 50);
  • in Italy, Law 132/2025 punishes spreading AI-falsified content that causes harm.

Voice agents: AI on the phone

A voice agent combines transcription, a language model and speech synthesis in real time: it understands what you say, decides what to reply, speaks. It can answer FAQs, book appointments, route calls, collect request details. Platforms like ElevenLabs offer no-code configurable agents; other companies, like Sesame, are experimenting with voice agents that use tools and computers to complete tasks.

To do it well:

  1. the agent must say upfront it’s an AI (transparency duty);
  2. it must be able to hand over to a person at any time;
  3. limit it to clear tasks, with a controlled knowledge base (see the RAG guide);
  4. record conversations and spot-check them, respecting privacy.

Music: Suno and songs on demand

With Suno you describe a track (“upbeat jingle for a bakery, acoustic guitar, 30 seconds, lyrics about the morning smell”) and get a complete song, with vocals and instruments. With Suno Studio you can edit sections, swap instruments, extend or shorten.

It works well for jingles, video backgrounds, musical prototypes, games. But beware:

  • commercial-use rights depend on your plan and can change: read them before using a track for a client;
  • professional musicians use these tools mostly to explore ideas, not as the final product;
  • don’t ask for tracks “in the exact style of” a living artist by name: besides legal issues, the result is almost always worse than describing the style.

In practice

  • Start with meeting transcription: the most immediate time saver.
  • For voice-over, try speech synthesis on a short video and compare with your own voice.
  • For voice agents and clones, start from the rules (transparency, consent, human handover), then the technology.
  • For music, read your plan’s terms before any commercial use.

Sources

Informational content, current as of the date shown. Prices, models and rules change often: always check official sources. Written with the support of AI tools and reviewed by the author.

The Lumen ebook

All of AI, in one book.

History, inner workings, tools and future of AI, explained with the lights on. For those who want to really understand, from start to finish, and keep it at hand.

Next guide →Local AI: open models on your own computerWhen it makes sense to run a model on your own computer or company servers, what hardware you need, which models to pick in 2026, and how to start in ten minutes with LM Studio or Ollama.