The caller switched languages and suddenly heard a different person
Our voice agent changed its voice mid-conversation and misread a noisy “hello” as French. Here's how we locked one voice per call and set country language rules.
Contents
The pain
Our voice agent was calling companies in several markets. It had language presets for English, Arabic, Spanish and Russian, and each preset came with its own voice.
That worked fine as long as the call stayed in one language. But the moment a prospect switched from English to Spanish, the platform swapped in the Spanish preset's voice. To the caller, it sounded like someone else had picked up the line. On Oct 4, 2026 the business owner put it simply: the voice changes when the language changes, so let's have one voice.
The second problem showed up on Oct 7, 2026, with two complaints in one hour. A Dubai buyer answered with “Ouais. Allô?” and the agent switched to French. The buyer had to ask, “Can you speak in English?” Another buyer asked, “Can you speak English? You speak Arabic?” The agent replied in English, “I can speak both.” The buyer then said twice that his English was weak and he spoke Arabic.
Both calls burned their opening seconds just figuring out the language.
Why it happened
- The voice belonged to the language, not the call. When the language switched automatically, the platform pulled that language's preset voice.
- The regional rule had gaps. For the UAE, only Spanish was ruled out. Nothing covered French, line noise, or a request for Arabic.
- Auto-detection listened to everything. A short “Allô” on a noisy line read as French speech.
- A polite question instead of action. When asked “do you speak Arabic?”, the agent offered a choice when the caller had already made one.
What we did, step by step
- One voice per call. The voice is picked once, at the start, based on the prospect's country and language: one voice for English calls to the UAE, an Arabic voice for calls that open in Arabic, a Spanish voice for calls in Spanish. It stays until the call ends. We stripped voices out of the language presets entirely; they now hold only the language and the opening line.
- Same rule on every channel. Outbound phone calls, follow-up calls after a quote, and outbound and inbound WhatsApp calls all follow it. If an inbound caller can't be identified, the agent uses English and the default voice.
- Tested before rollout. On a throwaway agent we set a female base voice, locked a male voice on top, and switched the language to Spanish. After the switch, the locked voice kept playing: 137–168 Hz pitch versus 205–208 Hz on the control run. Then we deleted the test agent.
- A guard in deployment. The agent config check now fails if a preset gets its own voice again, so nobody can bring the old setup back by accident.
- A language rule for the UAE. Since Oct 7, 2026, the agent speaks only English or Arabic in the UAE. “Ouais,” “Allô” and the like count as line noise, not a reason to switch. If the caller asks about Arabic or says their English is weak, the agent switches to Arabic right away: no “which do you prefer,” and no finishing the sentence in English first.
- Locking the language. We later turned off auto-detection on the UAE agent. The language is set at the start from the country and the prospect's record, and the switch to Arabic follows the regional rule instead of the model's guess.
- A routing test. An automated test checks that the UAE rule includes both restrictions and the Arabic switch.
The result
- The voice stays the same from hello to goodbye. The caller talks to one “person.”
- In the UAE, the agent no longer drifts into French on line noise, and nobody has to ask for Arabic twice.
- During one review on Oct 7 we suspected an Arabic switch was a mistake. We checked: the agent had followed the new rule exactly, so we dropped the idea of rewriting the opening line.
In fairness, we didn't count “calls that opened with a language mix-up” before and after. The complaint log has no new complaints of this type since the fix.
How it works for Polyglot clients from day one
- The agent's voice is locked for the whole call, even if the prospect changes languages.
- Each country gets a list of allowed languages. Line noise doesn't trigger a switch.
- If a prospect asks for a language, the agent switches right away. No “what works best for you?”
- More on calling in Arabic and Spanish: AI outbound calls in Arabic and Spanish.
FAQ
Can the agent speak a language that isn't on the country's list?
Not if your agent's settings rule it out. For the UAE we allowed English and Arabic. Each country gets its own list.
Does the voice stay the same when switching to Arabic?
The voice is chosen at the start. If the call opens in Arabic, it starts with an Arabic voice. If it opens in English, the same voice carries on in Arabic.
How did you confirm the voice really stays the same?
We measured pitch on a test agent before and after the language switch and compared it with a control run. The config check also blocks any agent with a voice inside a language preset.