voice-agent-builder

voice-agent-builder is a skill for Claude Code, Codex from vignesh2027/Claude-Agentic-Skills2.0-version. It costs 66 tokens per session (940 once invoked), scanned A, original, MIT.

A design guide for building voice-based AI agents that listen to speech, generate replies, and speak back in real time. It also covers phone bots, wake-word detection, conversation flow, interruptions, and streaming.

In plain words
What is it for?
Use it to design speech-to-text and text-to-speech pipelines, real-time voice assistants, Twilio or Vapi phone bots, and wake-word systems.
Why use it?
It brings the separate parts of a voice assistant into one engineering plan, including speech processing, dialogue handling, and telephony connections.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one. Also seen: mentions subagents.

Good fit Use it to design speech-to-text and text-to-speech pipelines, real-time voice assistants, Twilio or Vapi phone bots, and wake-word systems.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add vignesh2027/Claude-Agentic-Skills2.0-version --skill voice-agent-builder
Clone the repo
git clone --depth 1 https://github.com/vignesh2027/Claude-Agentic-Skills2.0-version

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for voice-agent-builder

README.md
[![agentmods](https://agentmods.dev/badge/skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder/github.svg)](https://agentmods.dev/skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder)
Your own site
<a href="https://agentmods.dev/skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder"><img src="https://agentmods.dev/badge/skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for voice-agent-builder

Your own site · 80×15
<a href="https://agentmods.dev/skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder"><img src="https://agentmods.dev/badge/skills/vignesh2027/claude-agentic-skills2.0-version/voice-agent-builder.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 66 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 940 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00066 $0.00940
Opus 5 $0.00033 $0.00470
Sonnet 5 $0.00013 $0.00188
Haiku 4.5 $0.00007 $0.00094

Measured 8d ago against content hash 73a2d38695a7, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-12, from the pricing page.

Security

Grade A, and why

voice-agent-builder scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

voice-agent-builder/SKILL.md · 98 lines

How it starts

The opening of the file, as written. The whole thing — 98 lines — stays where its author put it; the contents beside it link to each section on GitHub.

VoiceAgent Builder

You are VoiceAgent — an expert in designing and building production-grade voice AI systems with sub-300ms latency, natural conversation flow, and robust telephony integration.

Sub-Agents

  • ASREngineer — Speech-to-text pipeline design: Whisper, Deepgram, AssemblyAI, streaming vs batch
  • TTSDesigner — Text-to-speech voice selection, SSML markup, prosody tuning, ElevenLabs/OpenAI TTS
  • DialogueManager — Conversation state machines, turn-taking logic, interruption detection
  • TelephonyIntegrator — Twilio, Vapi, Bland.ai, LiveKit, WebRTC media streams
  • LatencyOptimizer — End-to-end latency profiling and reduction to <300ms P95

Core Architecture

Latency Budget (target <500ms total)

Component Target Max
ASR (first token) 100ms 200ms
LLM first token 150ms 250ms
TTS first audio chunk 80ms 150ms
Network + buffering 50ms 100ms

Stack Selection Matrix

Use Case ASR LLM TTS Telephony
Phone bot (<500ms) Deepgram Nova-2 GPT-4o mini / Claude Haiku ElevenLabs Turbo Twilio / Vapi
High accuracy transcription Whisper large-v3 Claude Sonnet OpenAI TTS HD
Real-time assistant Deepgram streaming Claude Haiku streaming Cartesia Sonic LiveKit
Multilingual IVR Azure Speech GPT-4o Azure Neural TTS Twilio

Core Workflow

  1. Requirements scoping — identify use case (inbound/outbound, languages, concurrent calls)
  2. Architecture design — select ASR/LLM/TTS stack based on latency vs accuracy tradeoff
  3. Streaming pipeline — implement WebSocket/gRPC streaming for each component
  4. Dialogue design — define intents, slots, fallback responses, escalation paths
  5. Interruption handling — implement barge-in detection (VAD with energy threshold >35dB)
  6. Testing — load test at 10× expected concurrency, measure P50/P95/P99 latency

Voice Pipeline Code Pattern

Read the full file on GitHub · 98 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 98 lines · 66 tokens per session scan A 73a2d38695a7

Subscribe to this mod's changes

voice-agent-builder is a skill published in the GitHub repository vignesh2027/Claude-Agentic-Skills2.0-version (4 stars, last pushed 14d ago), licensed MIT. It adds 66 tokens to every session and 940 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.