XMS Local Voice Agent — an AI voice assistant running on your own infrastructure.
Handles phone calls in natural language, understands what is said and takes action by connecting to your systems. Speech recognition, response generation and speech synthesis are designed to run on your organization's own servers.
Produto
XMS Local Voice Agent automates repetitive call operations while keeping voice and conversation data processed on infrastructure your organization controls.
Each call is processed in three layers: speech understanding (STT), dialogue and action management (LLM), and voice response (TTS). An orchestration layer coordinates turn-taking, stops the agent when the caller interrupts, handles system results and hands off to a human operator.
The reference architecture combines Netgsm 0850/SIP Trunk, an Asterisk PBX, LiveKit real-time audio and local STT, LLM and TTS services. Access to internal systems goes only through tools and APIs with defined permissions.
In the hospital reference design, department/doctor lookup, available slots, permitted appointment actions after identity verification and operator handoff run through controlled HIS APIs. The initial target is four concurrent calls; capacity and latency are validated with load tests in the pilot.
XMS Local Voice Agent
Handles phone calls in natural language, understands what is said and takes action by connecting to your systems. Speech recognition, response generation and speech synthesis are designed to run on your organization's own servers.
Funcionalidades
- On-premise processing with local STT, LLM and TTS
- PBX integration via SIP Trunk, Asterisk and LiveKit
- Inbound and outbound call flows with barge-in support
- Human operator handoff and fallback routing
- Permissioned API access to HIS, CRM and ERP
- Configurable data retention and access policies
Benefícios
- Teams focus on higher-value work as repetitive calls are automated
- Less dependency on external services thanks to local AI layers
- Data access, retention and permissions managed by your organization
- Consistent service built on your own knowledge and workflows
Casos de uso
- Hospitals and healthcare providers (appointments, information, routing)
- Banks and financial institutions (call answering, confirmation calls)
- Insurers (first notice of loss intake, policy information)
- Public sector, energy and telecom (citizen/subscriber information, fault routing)