Imagine calling your AI bot like a human.
You’re driving, hands busy — and you simply call your OpenClaw bot to: Check how your coding agent is doing Ask it to remember something important Get a quick digest of recent updates or logs Sounds futuristic?
It’s already possible.
With ElevenLabs Agents , you can turn your OpenClaw into a fully conversational voice agent , even accessible via a phone call .
Why ElevenLabs + OpenClaw?
OpenClaw already supports: Text-to-Speech (TTS) Speech-to-Text (STT) Tools, memory, and skills But making it truly conversational (turn-taking, voice orchestration, phone calls) takes a lot of effort.
That’s where ElevenLabs Agents shine.
ElevenLabs handles everything related to voice , while OpenClaw remains the brain .
Architecture Overview Who does what?
ElevenLabs Agents Turn-taking in conversations Speech synthesis & recognition Phone number integration Voice orchestration OpenClaw Tools & skills Memory Decision-making Agent intelligence Both systems communicate using the standard OpenAI /chat/completions protocol .
Clean.
Modular.
Powerful.
Prerequisites Before starting, make sure you have: ✅ ElevenLabs account ✅ OpenClaw installed & running ✅ ngrok installed ✅ Twilio account (only if you want phone calls) Step 1: Enable Chat Completions in OpenClaw Open your openclaw.json file and enable the chat completions endpoint: { "gateway": { "http": { "endpoints": { "chatCompletions": { "enabled": true } } } } } This exposes the universal endpoint: /v1/chat/completions ElevenLabs will use this endpoint to talk to your OpenClaw.
Step 2: Expose OpenClaw Using ngrok Run ngrok on your OpenClaw gateway port: ngrok http 18789 (Replace 18789 with your actual gateway port.) ngrok will generate a public URL like: https://your-unique-url.ngrok.io ⚠️ Keep this terminal running — you’ll need this URL later.
Step 3: Configure ElevenLabs Agent Manual Setup (UI-based) Create a new ElevenLabs Agent Under LLM Settings , select Custom LLM Set the URL to: https://your-unique-url.ngrok.io/v1/chat/completions Add your OpenClaw gateway token as an authentication header Now ElevenLabs knows how to talk to your OpenClaw.
Automated Setup (Using API) Instead of doing everything manually, your coding agent can automate this.
Step 1: Create a Secret in ElevenLabs curl -X POST https://api.elevenlabs.io/v1/convai/secrets \ -H "xi-api-key: YOUR_ELEVENLABS_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "type": "new", "name": "openclaw_gateway_token", "value": "YOUR_OPENCLAW_GATEWAY_TOKEN" }' Response example: { "type": "stored", "secret_id": "abc123...", "name": "openclaw_gateway_token" } Save the secret_id .
Step 2: Create the ElevenLabs Agent curl -X POST https://api.elevenlabs.io/v1/convai/agents/create \ -H "xi-api-key: YOUR_ELEVENLABS_API_KEY" \ -H "Content-Type: application/json" \ -d '{ "conversation_config": { "agent": { "language": "en", "prompt": { "llm": "custom-llm", "prompt": "You are a helpful assistant.", "custom_llm": { "url": "https://YOUR_NGROK_URL.ngrok-free.app/v1/chat/completions", "api_key": { "secret_id": "RETURNED_SECRET_ID" } } } } } }' Replace: YOUR_ELEVENLABS_API_KEY YOUR_OPENCLAW_GATEWAY_TOKEN YOUR_NGROK_URL RETURNED_SECRET_ID 🎉 Done!
All conversations now flow through your OpenClaw.
Step 4: Attach a Phone Number (Twilio) This is where it becomes magical.
Buy a phone number from Twilio Open your ElevenLabs Agent settings Go to the Phone section Enter: Twilio Account SID Twilio Auth Token Link your Twilio number to the agent That’s it. 📞 Your OpenClaw now answers phone calls.
Final Result You can now: Call your AI agent like a real person Talk hands-free Use OpenClaw’s memory, tools, and skills via voice Build futuristic AI phone assistants Your Claw just became conversational. 🦞🔥