> ## Documentation Index
> Fetch the complete documentation index at: https://docs.retellai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Orchestration Overview

> How Retell orchestrates speech-to-text, large language models, and text-to-speech into a single low-latency voice AI stack tuned for real phone call conditions.

Retell provides a sophisticated voice AI orchestration layer that seamlessly integrates frontier audio technologies to create natural, responsive voice interactions **optimized for phone call conditions**.

## Building Blocks

Traditional voice AI systems consist of three core components:

1. Speech-to-Text (STT): Converts spoken words into written text
2. Large Language Model (LLM): Processes and generates contextual responses
3. Text-to-Speech (TTS): Converts text responses into natural speech

Recently, Speech-to-Speech (S2S) models have emerged as a new building block in the voice AI stack. Specifically, they are capable of understanding audio input and generating audio output without needing the step of generating text first. The [GPT Live voice model](https://docs.retellai.com/build/gpt-live.md) combines this with a backend text LLM, so a single-prompt agent keeps S2S responsiveness while still running its prompt, tools, and knowledge base.

However, simply utilizing these building blocks often results in high-latency, unnatural interactions, easily interrupted by background noise, and lacks critical capabilities.

## Our Orchestration Solution

Retell's orchestration layer solves the challenges in optimizing real-time operations, managing scalable infrastructure, and ensuring human-like conversations. It organizes and connects the following systems:

* **Audio Models**
  * Helps manage and scale building blocks mentioned in the previous section, with no need to worry about rate limits and latency
  * Multiple choices of models and providers to meet different use cases
  * Advanced status check and automatic fallback mechanisms to ensure minimal disruption to calls
  * Unified configuration options, providing flexibility with ease of use
  * Security and compliance propagated down to every underlying provider

* **Noise Management**
  * Advanced streaming background noise filtering
  * Echo cancellation

* **Intelligent Endpointing & Turn-taking**
  * Precise detection of speech completion
  * Context-aware turn-taking with configurable thresholds

* **Dynamic Interruption Handling**
  * Graceful handling of mid-conversation interruptions
  * Adaptive response timing based on user speech patterns
  * Configurable interruption sensitivity levels

* **Reminders & Backchanneling**
  * Reminders for when the user is not responding
  * Backchanneling to keep the conversation engaging and natural

* **Background Sound**
  * Background sound to create a more natural calling experience

* **Telephony Features**
  * Telephony features like voicemail detection, call transfer, and press digits (DTMF), integrated seamlessly via function calling

* **End-call Criteria**
  * End-call as a function call, or end when the user is not responding
  * Maximum call time to ensure no outstanding charges


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.