Gen AI — Audio Generation

OpenAI TTS

response = client.audio.speech.create(
    model="tts-1",
    voice="alloy",
    input="Hello! Welcome to our AI tutorial."
)

response.stream_to_file("output.mp3")

Voices

Available voices: alloy, echo, fable, onyx, nova, shimmer

for voice in ["alloy", "echo", "fable", "onyx", "nova", "shimmer"]:
    response = client.audio.speech.create(
        model="tts-1",
        voice=voice,
        input=f"This is the {voice} voice."
    )
    response.stream_to_file(f"{voice}.mp3")

Whisper (Speech to Text)

audio_file = open("audio.mp3", "rb")
transcript = client.audio.transcriptions.create(
    model="whisper-1",
    file=audio_file
)
print(transcript.text)

Translation

audio_file = open("spanish.mp3", "rb")
translation = client.audio.translations.create(
    model="whisper-1",
    file=audio_file
)
print(translation.text)  # English translation

ElevenLabs

import elevenlabs

elevenlabs.set_api_key("your-key")

audio = elevenlabs.generate(
    text="Hello! This is a natural sounding voice.",
    voice="Rachel"
)

elevenlabs.save(audio, "output.mp3")

Mini Practice

1. Generate speech with different voices
2. Transcribe audio with Whisper
3. Compare TTS providers
4. Build a voice assistant

Up Next

Continue with Video Generation - AI video creation.