TTS (Text To Speech) API - NvrTtsEsEs

The Text-to-Speech (TTS) API endpoint allows you to obtain speech synthesis from raw text.

Introduction

Text-to-Speech (TTS) is a subfield of Artificial Intelligence (AI) that converts written text into spoken words. This TTS API operates as a two-stage pipeline, with a first model generating a mel spectrogram, then a second model using this mel spectrogram to generate speech. This speech synthesis system enables you to synthesize natural speech from raw transcriptions without any additional information.

AI Endpoints makes it easy, with ready-to-use inference APIs. Discover how to use them:

Model concept and configuration

These TTS models were developed by NVIDIA. The TTS AI Endpoint takes text as input and returns audio stream or audio buffer, along with additional optional metadata.

Model configuration:

• Transcription mode: offline
• Language Support: en-US, es-ES, de-DE, it-IT (please choose the corresponding endpoint - e.g. nvr-tts-en-us)
• Input type: Raw text
• Voice name: This parameter specifies the voice to use for speech synthesis, allowing selection of speaker gender and emotional styles. Available options vary depending on the model language; some languages offer both male and female voices, while others may have only one gender available, and emotional variations (such as neutral, calm, or happy) are limited to certain languages. Voices are prefixed with the language code (e.g., English-US). The suffix "-1" (e.g., Female-1 or Male-1) indicates the base voice, which has natural characteristics like timbre and accent, without any specific emotional modification. The available voice names are as follows: Detailed breakdown of available voice names: English-US.Female-1, English-US.Male-1, English-US.Female-Calm, English-US.Female-Neutral, English-US.Female-Happy, English-US.Female-Angry, English-US.Female-Fearful, English-US.Female-Sad, English-US.Male-Calm, English-US.Male-Neutral, English-US.Male-Happy, English-US.Male-Angry, Spanish-ES-Female-1, Spanish-ES-Male-1, German-DE-Male-1, Italian-IT-Female-1, Italian-IT-Male-1.
• Sample Rate: usually 22 000 Hz or 44 000 Hz

How to?

The TTS endpoint offers you a wide range of transcription options. Learn how to use them with the following example:

With a simple HTTP client (requests)

First install the requests library:

Next, export your access token to the OVH_AI_ENDPOINTS_ACCESS_TOKEN environment variable:

If you do not have an access token key yet, follow the instructions in the AI Endpoints – Getting Started.

Finally, run the following Python code:

Returning the following result:

You are now able to play and use your generated audio file.

With the gRPC RIVA client

Install RIVA client and audio libraries:

This use case deals with a basic example that returns the audio speech generated by the model:

Model rate limit

When using AI Endpoints, the following rate limits apply:

• Anonymous: 2 requests per minute, per IP and per model.
• Authenticated with an API access key: 400 requests per minute, per Public Cloud project and per model.

If you exceed this limit, a 429 error code will be returned.

If you require higher usage, please get in touch with us to discuss increasing your rate limits.

References

For more information about the TTS model features, please refer to RIVA TTS documentation.

Going Further

For a broader overview of AI Endpoints, explore the full AI Endpoints Documentation.

Reach out to our support team or join the OVHcloud Discord #ai-endpoints channel to share your questions, feedback, and suggestions for improving the service, to the team and the community.