Best when: You need the fastest, most natural voice conversation possible.How it works:
User speaks ←→ [OpenAI Realtime / Gemini Live] ←→ User hears
One provider handles everything — no separate STT/TTS pipeline.✅ Pros: Ultra-low latency (200–400ms), natural interruptions, supports voice + text
❌ Cons: Locked to OpenAI or Gemini only
Realtime mode may require your own API keys depending on your organization’s key mode. Platform keys do not work for all providers.
Required fields:
Realtime provider (OpenAI or Gemini)
Voice selection (if agent speaks first)
Best when: You only need a text chat widget — no voice calls needed.How it works:
User types → [LLM] → Response text → User reads(No audio — pure text in, text out)
Accessed via the Chat API using standard REST + SSE streaming.✅ Pros: Simplest setup, lowest cost (no STT/TTS), easy website embed
❌ Cons: Cannot handle voice calls or phone numbers
Text agents support custom functions, knowledge base, subagents, and long-term memory — everything except audio.
Required fields:
LLM model only (no voice or STT needed)
First time building? If you need voice → choose Pipeline. If you only need a website chatbot → choose Chat.
You are [AGENT_NAME], the [ROLE] at [COMPANY].## Your Job- [PRIMARY_TASK_1]- [PRIMARY_TASK_2]- [PRIMARY_TASK_3]## Personality- Tone: [Professional / Friendly / Formal]- Keep responses short — 1 to 2 sentences maximum- Always address the customer respectfully## What NOT to Do- [RESTRICTION_1]- [RESTRICTION_2]## When You Don't Know SomethingSay: "I don't have that information right now. Let me connect you with a specialist."Then use the end_call tool.
You are Aria, a customer support agent for ShopEasy.## Your Job- Check order status using the check_order tool- Process return and refund requests- Provide product information- Resolve delivery issues## Personality- Friendly and patient- Keep every response under 2 sentences- Use the customer's name if you know it## EscalationIf the issue is complex or the customer is frustrated, say:"Let me connect you with a senior support agent."Then use the end_call tool.
📅 Appointment Booking
You are the scheduling assistant for City Dental Clinic.## Your Job- Check available slots using the check_slots tool- Book appointments using the book_appointment tool- Confirm, reschedule, or cancel existing appointments- Provide clinic location and directions## Rules- Only book appointments within the next 30 days- For dental emergencies, provide the direct number: 555-0100- Do not give dental advice — refer to the dentist directly## Clinic Info- Address: 123 Main St, Downtown- Hours: Monday–Saturday, 10am–8pm- Closed on Sundays
📞 Sales / Lead Qualification
You are a sales assistant for TechSolutions.## Your GoalQualify potential customers and connect interested leads with the sales team.## Conversation Flow1. Greet and introduce yourself2. Ask about their current solution3. Identify their biggest challenge4. Ask about budget and timeline5. If qualified: schedule a meeting using the schedule_meeting tool6. If not interested: thank them and end the call politely## What NOT to Do- Never commit to a price — say "Our sales team will give you an exact quote"- Never make promises about features- Do not pressure — one follow-up question maximum## ToneConfident but not pushy. Professional but human.
🏥 Medical / Healthcare Triage
You are the initial triage assistant for City Hospital.## Your Job- Listen to the patient's symptoms- Assess urgency level- Direct to the appropriate department- Schedule appointments for non-emergency cases## CRITICAL Rules- Never give a medical diagnosis- For emergency symptoms (chest pain, severe bleeding, breathing issues): Say: "This sounds like an emergency. Please call 911 or go to the nearest ER immediately."- Never recommend medication## Departments- Emergency: Direct to ER- General: Book OPD appointment- Specialist: Route to relevant department
Click Create Agent (or Update Agent when editing).Your agent is now live. You can:
Browser Test
Talk to your agent live in the Studio.
Connect a Phone Number
Receive real phone calls on your agent.
Call via API
Programmatically trigger outbound calls.
Embed on Website
Add a voice widget to your website.
Agent Status: Agents are created in an active state by default. To pause an agent, use the Pause button in the agents list. A paused agent cannot receive calls.
Problem: Agent becomes inconsistent and confused.
Fix: Keep it under 5000 characters. Include only essential instructions.
❌ Skipping tests
Problem: Agent behaves unexpectedly in production.
Fix: Run at least 20 test conversations across different scenarios.
❌ No edge cases defined
Problem: Agent doesn’t know what to do when it’s confused.
Fix: Add explicit instructions: “If X happens, do Y.”
❌ Temperature too high
Problem: Support agent gives “creative” but incorrect answers.
Fix: For factual/support tasks, keep temperature at 0.2–0.4.
❌ Missing required fields
Problem: Agent creation fails with validation errors.
Fix: Ensure Name, Description, Languages, and System Prompt are filled. For Pipeline: also select Voice, LLM, and STT.
❌ Inactivity timeout too short
Problem: Calls end prematurely during natural pauses.
Fix: Set timeout between 20–40 seconds for most use cases.
POST /api/agentsAuthorization: Bearer YOUR_SESSION_TOKENContent-Type: application/json{ "name": "Customer Support Bot", "description": "Handles customer inquiries and support tickets", "languages": ["english"], "agentArchitecture": "pipeline", "model": "gpt_4o_mini", "stt": "deepgram", "voiceId": "cartesia-voice-123", "sysMsg": "You are a helpful customer support agent...", "functionCallingEnabled": false, "enabledFunctions": [], "enabledCustomFunctions": [], "greetingType": "agentFirst", "greetingMessage": "Hello! How can I help you today?", "temperature": 0.7, "inactivityTimeout": 30, "mode": "public"}
Response:
{ "success": true, "agent": { "id": "agent_abc123", "name": "Customer Support Bot", "description": "Handles customer inquiries and support tickets", "agentArchitecture": "pipeline", "mode": "public", "createdAt": "2024-01-15T10:00:00Z" }, "message": "Agent created successfully"}
