Voice Settings
Overview
In voice settings, you can configure settings related to AI character voice synthesis. You can select various voice synthesis engines and adjust voice quality and parameters.
# Voice synthesis engine to use
# voicevox, koeiromap, google, stylebertvits2, aivis_speech,
# gsvitts, elevenlabs, openai, azure, nijivoice
NEXT_PUBLIC_SELECT_VOICE=voicevoxNote
If Realtime API mode or Audio mode is enabled, voice settings will not be used.
Selecting a Voice Synthesis Engine
Select the voice synthesis engine used by the AI character. The following engines are supported:
- VOICEVOX: High-quality voice synthesis engine specialized for Japanese
- Koeiromap: Voice synthesis engine for Japanese with rich emotional expression
- Google Text-to-Speech: Google Cloud Text-to-Speech service supporting multiple languages
- Style-Bert-VITS2: High-quality voice synthesis engine with style control (supports Japanese, English, Chinese)
- AivisSpeech: Japanese voice synthesis engine that makes Style-Bert-VITS2 models easy to use
- GSVI TTS: Customizable voice synthesis engine
- ElevenLabs: High-quality voice synthesis service supporting multiple languages
- OpenAI TTS: OpenAI's voice synthesis service supporting multiple languages
- Azure TTS: Microsoft Azure's multilingual voice synthesis service
- Nijivoice: Japanese voice synthesis service with over 100 voices available
VOICEVOX
# Server URL
VOICEVOX_SERVER_URL=http://localhost:50021
# Speaker ID
NEXT_PUBLIC_VOICEVOX_SPEAKER=46
# Speed
NEXT_PUBLIC_VOICEVOX_SPEED=1.0
# Pitch
NEXT_PUBLIC_VOICEVOX_PITCH=0.0
# Intonation
NEXT_PUBLIC_VOICEVOX_INTONATION=1.0VOICEVOX is a high-quality voice synthesis engine specialized for Japanese.
Server URL
Set the URL to access the VOICEVOX Engine API. The standard URL for running VOICEVOX locally is http://localhost:50021.
Speaker Selection
Select from speakers available in VOICEVOX. You can test play the selected speaker's voice with the "Test Voice" button.
Voice Parameter Adjustment
- Speed: Adjustable in the range of 0.5 to 2.0 (higher values make it speak faster)
- Pitch: Adjustable in the range of -0.15 to 0.15 (higher values make the voice higher)
- Intonation: Adjustable in the range of 0.0 to 2.0 (higher values strengthen intonation)
Koeiromap
# API Key
NEXT_PUBLIC_KOEIROMAP_KEY=Koeiromap is a voice synthesis engine for Japanese with rich emotional expression. It has now been renamed to Koemotion.
API Key
Set the API key to use the Koeiromap API. API keys can be obtained from Koemotion.
Presets and Adjustments
- Presets: You can select from presets such as "Cute", "Energetic", "Cool", and "Deep"
- X-axis: Adjust voice quality in the range of -10 to 10
- Y-axis: Adjust voice quality in the range of -10 to 10
Google Text-to-Speech
# Path to JSON file for authentication
GOOGLE_APPLICATION_CREDENTIALS="./credentials.json"
# API Key
GOOGLE_TTS_KEY=""
# Language/Model Settings
NEXT_PUBLIC_GOOGLE_TTS_TYPE=Google Cloud Text-to-Speech is a voice synthesis service supporting multiple languages.
Settings
- Language Selection: Set the language/voice model to use
- Authentication: Requires an API key or authentication JSON file (credentials.json)
For detailed voice models, refer to the Google Cloud Official Documentation.
ElevenLabs
# API Key
ELEVENLABS_API_KEY=""
# Voice ID
ELEVENLABS_VOICE_ID=""ElevenLabs is a high-quality voice synthesis service supporting multiple languages.
API Key
Set the API key to use the ElevenLabs API.
Voice ID
Set the ID of the voice to use (can be checked from the ElevenLabs API)
OpenAI TTS
# API Key
OPENAI_TTS_KEY=""
# Voice Type
NEXT_PUBLIC_OPENAI_TTS_VOICE=shimmer
# Model
NEXT_PUBLIC_OPENAI_TTS_MODEL=tts-1
# Speed
NEXT_PUBLIC_OPENAI_TTS_SPEED=1.0A multilingual voice synthesis service provided by OpenAI.
API Key
Set the API key to use the OpenAI API.
Voice Parameter Adjustment
- Voice Type: Select from alloy, echo, fable, onyx, nova, shimmer
- Model: Select from tts-1 (standard) or tts-1-hd (high quality)
- Speed: Adjustable in the range of 0.25 to 4.0
Azure OpenAPI TTS
# API Key
AZURE_TTS_KEY=""
# Endpoint
AZURE_TTS_ENDPOINT=""
# Voice Type
NEXT_PUBLIC_OPENAI_TTS_VOICE=shimmer
# Speed
NEXT_PUBLIC_OPENAI_TTS_SPEED=1.0A multilingual voice synthesis service provided by Microsoft Azure.
API Key
Set the Azure TTS API key.
Endpoint
Set the Azure TTS endpoint URL.
Voice Parameter Adjustment
- Voice Type: Select the voice type to use
- Speed: Adjustable in the range of 0.25 to 4.0
