voices.md

copyright	lastupdated	subcollection
years 2015, 2023	2023-04-29	text-to-speech

{{site.data.keyword.attribute-definition-list}}

Languages and voices

{: #voices}

The {{site.data.keyword.texttospeechfull}} service supports a variety of languages, voices, and dialects. For different languages, the service offers female voices, male voices, or both. Each voice uses appropriate cadence and intonation for its dialect. {: shortdesc}

All of the service's voices use neural voice technology. Neural voice technology uses multiple Deep Neural Networks (DNNs) to predict the acoustic (spectral) features of the speech. The DNNs are trained on natural human speech and generate the resulting audio from the predicted acoustic features. During synthesis, the DNNs predict the pitch and phoneme duration (prosody), spectral structure, and waveform of the speech. Neural voices produce speech that is crisp and clear, with a very natural-sounding, smooth, and consistent audio quality.

Supported languages and voices

{: #language-voices}

The service offers two types of voices with different qualities and capabilities:

• Expressive neural voices offer natural-sounding speech that is exceptionally clear and crisp. Their pronunciation and inflections are natural and conversational, and the resulting speech offers extremely smooth transitions between words. They also support the use of additional features that are not available with enhanced neural voices. For a list of all expressive voices, see Expressive neural voices.
• Enhanced neural voices achieve a high degree of natural-sounding speech and support most service features. For a list of all enhanced neural voices, see Enhanced neural voices.

The following pages provide more information about the voices and their technology:

• For a blog that introduces the expressive voices, see Is your conversational AI setting the right tone?{: external}.
• For more information about the service's neural voice technology, see The science behind the service.

Language support by type of voice

{: #language-voices-by-type}

Table 1 shows the service's support for languages by type of voice. The following topics list the available languages and voices for each voice type.

Language	Expressive neural voices	Enhanced neural voices
Dutch \n (Netherlands)		✔
English \n (United Kingdom)	✔	✔
English \n (Australian)	✔
English \n (United States)	✔	✔
French \n (Canadian)		✔
French \n (France)		✔
German		✔
Italian		✔
Japanese		✔
Korean		✔
Portuguese \n (Brazilian)		✔
Spanish \n (Castilian)		✔
Spanish \n (Latin American)	✔	✔
Spanish \n (South American)		✔
{: caption="Language support by type of voice"}

Expressive neural voices

{: #language-voices-expressive}

Table 2 lists and provides audio samples for all available expressive neural voices. The Availability column indicates whether each voice is generally available (GA) for production use or beta. The column also indicates whether each voice is available for [IBM Cloud]{: tag-ibm-cloud}, [IBM Cloud Pak for Data]{: tag-cp4d}, or both (no product version is cited).

• Expressive neural voices support additional features that are not available with other types of voices. These features include additional speaking styles, automatic emphasis of interjections, and emphasis of specified words. For more information, see Modifying speech synthesis with expressive neural voices.
• When used with the SSML <prosody> element, expressive voices support only percentage values for the rate and pitch attributes. For more information, see The <prosody> element.

Expressive neural voices determine sentiment from context and automatically use the proper intonation to suit the text. To produce the most natural-sounding prosody, expressive neural voices need to consider the context of all words and phrases of a sentence. Expressive voices are therefore more compute-intensive and have slightly higher latency than other types of voices. The initial response for a synthesis request that uses an expressive voice might take a fraction of a second longer (for example, a few hundred milliseconds) to arrive. The total response time for the request to complete is also longer.

To minimize the latency and response time for an expressive voice, use shorter sentences wherever possible. {: tip}

Language	Availability	Voice / Gender	Audio sample
English \n (Australian)	GA	en-AU_HeidiExpressive \n Female	{: audio controls}
	GA	en-AU_JackExpressive \n Male	{: audio controls}
English \n (United States)	GA	en-US_AllisonExpressive \n Female	{: audio controls}
	GA	en-US_EmmaExpressive \n Female	{: audio controls}
	GA	en-US_LisaExpressive \n Female	{: audio controls}
	GA	en-US_MichaelExpressive \n Male	{: audio controls}
English \n (United Kingdom)	GA	en-GB_GeorgeExpressive \n Male	{: audio controls}
Spanish \n (Latin American)	GA	es-LA_DanielaExpressive \n Female	{: audio controls}
{: caption="Expressive neural languages and voices"}

Enhanced neural voices

{: #language-voices-enhanced-neural}

Table 3 lists and provides audio samples for all available enhanced neural voices. The Availability column indicates whether each voice is generally available (GA) for production use or beta. The column also indicates whether each voice is available for [IBM Cloud]{: tag-ibm-cloud}, [IBM Cloud Pak for Data]{: tag-cp4d}, or both (no product version is cited).

Language	Availability	Voice / Gender	Audio sample
Dutch \n (Netherlands)	Beta	nl-NL_MerelV3Voice \n Female	{: audio controls}
English \n (United Kingdom)	GA	en-GB_CharlotteV3Voice \n Female	{: audio controls}
	GA	en-GB_JamesV3Voice \n Male	{: audio controls}
	GA	en-GB_KateV3Voice \n Female	{: audio controls}
English \n (United States)	GA	en-US_AllisonV3Voice \n Female	{: audio controls}
	GA	en-US_EmilyV3Voice \n Female	{: audio controls}
	GA	en-US_HenryV3Voice \n Male	{: audio controls}
	GA	en-US_KevinV3Voice \n Male	{: audio controls}
	GA	en-US_LisaV3Voice \n Female	{: audio controls}
	GA	en-US_MichaelV3Voice \n Male	{: audio controls}
	GA	en-US_OliviaV3Voice \n Female	{: audio controls}
French \n (Canadian)	GA	fr-CA_LouiseV3Voice \n Female	{: audio controls}
French \n (France)	GA	fr-FR_NicolasV3Voice \n Male	{: audio controls}
	GA	fr-FR_ReneeV3Voice \n Female	{: audio controls}
German	GA	de-DE_BirgitV3Voice \n Female	{: audio controls}
	GA	de-DE_DieterV3Voice \n Male	{: audio controls}
	GA	de-DE_ErikaV3Voice \n Female	{: audio controls}
Italian	GA	it-IT_FrancescaV3Voice \n Female	{: audio controls}
Japanese	GA	ja-JP_EmiV3Voice \n Female	{: audio controls}
Korean	GA	ko-KR_JinV3Voice \n Female	{: audio controls}
Portuguese \n (Brazilian)	GA	pt-BR_IsabelaV3Voice \n Female	{: audio controls}
Spanish \n (Castilian)	GA	es-ES_EnriqueV3Voice \n Male	{: audio controls}
	GA	es-ES_LauraV3Voice \n Female	{: audio controls}
Spanish \n (Latin American)	GA	es-LA_SofiaV3Voice \n Female	{: audio controls}
Spanish \n (North American)	GA	es-US_SofiaV3Voice \n Female	{: audio controls}
{: caption="Enhanced neural languages and voices"}

The Spanish Latin American and North American Sofia voices are essentially the same voice. The most significant difference concerns how the two voices interpret a $ (dollar sign). The Latin American version uses the term pesos; the North American version uses the term dólares. Other minor differences might also exist between the two voices. {: note}

Creating a custom model

{: #customize-model}

When you synthesize text, the service applies language-dependent pronunciation rules to convert the ordinary spelling of each word to a phonetic spelling. The service's pronunciation rules work well for common words, but they can yield imperfect results for unusual words, such as terms with foreign origins, personal names, and abbreviations or acronyms. If your application's lexicon includes such words, you can use the customization interface to specify how the service pronounces them.

A custom model is a dictionary of words and their translations. You create a custom model for a specific language, not for a specific voice. So a custom model can be used with any voice for its specified language. For example, a custom model that you create for the en-US language can be used with any US English voice. It cannot, however, be used with an en-GB or en-AU voice.

Customization is available for all languages. All voices support the use of both standard International Phonetic Alphabet (IPA) and {{site.data.keyword.IBM_notm}} Symbolic Phonetic Representation (SPR) phonetic symbols for word customization. For more information, see Understanding customization.

Creating a custom voice

{: #customize-voice}

[IBM Cloud]{: tag-ibm-cloud}

Premium customers can work with {{site.data.keyword.IBM_notm}} to train a new custom voice for their specific use case and target market. Creating a custom voice is different from customizing one of the service's existing voices. A custom voice is a unique new voice that is based on audio training data that the customer provides. {{site.data.keyword.IBM_notm}} can train a custom voice with as little as one hour of training data.

To request a custom voice or for more information, complete and submit this {{site.data.keyword.IBM_notm}} Request Form{: external}.