local-chatbot-multimodal

local-chatbot-multimodal is a skill for Claude Code, Codex from Seeed-Projects/Seeed-Jetson-DevelopTool. It costs 76 tokens per session (1,313 once invoked), scanned B, original, MIT.

A guide for building a voice chatbot that runs locally on an NVIDIA Jetson computer, using speech recognition, a local language model, and spoken replies.

In plain words
What is it for?
Use it to deploy an offline voice assistant in Docker with Ollama and NVIDIA Riva, provided you have JetPack 6.0 or newer, an NGC key, a microphone, and a speaker.
Why use it?
It lets the chatbot listen, generate answers, and speak without sending the conversation to cloud services.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Needs its repository: it runs a file that does not travel with it, so clone the repository first. The line is bash jetson-containers/install.sh.

Good fit Use it to deploy an offline voice assistant in Docker with Ollama and NVIDIA Riva, provided you have JetPack 6.0 or newer, an NGC key, a microphone, and a speaker.

Compare 6 skills from other repositories ↓
Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/Seeed-Projects/Seeed-Jetson-DevelopTool
agentmods
npx agentmods add skills/seeed-projects/seeed-jetson-developtool/local-chatbot-multimodal

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for local-chatbot-multimodal

README.md
[![agentmods](https://agentmods.dev/badge/skills/seeed-projects/seeed-jetson-developtool/local-chatbot-multimodal.svg)](https://agentmods.dev/skills/seeed-projects/seeed-jetson-developtool/local-chatbot-multimodal)
Your own site
<a href="https://agentmods.dev/skills/seeed-projects/seeed-jetson-developtool/local-chatbot-multimodal"><img src="https://agentmods.dev/badge/skills/seeed-projects/seeed-jetson-developtool/local-chatbot-multimodal.svg" alt="Measured on agentmods" height="20"></a>
Per session 76 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,313 The whole file, excluding the scripts and references it only reads on demand.
Security scan B 2 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 7 findings, up to medium

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • medium Rogue Agent · line 68
    Skill establishes unauthorized persistence across sessions via cron jobs, startup scripts, or state files. Session persistence allows an attacker to maintain access beyond the current interaction.
    Fix: Remove any persistence mechanisms (cron jobs, startup scripts, state files). Skills should not maintain state across sessions without explicit user consent.
  • medium Data Exfiltration · line 69
    Data is being sent to an external URL. This could be legitimate telemetry or data exfiltration. Manual review is recommended.
    Fix: Verify the destination URL is trusted and necessary. Remove or replace with documented APIs. Ensure no secrets, tokens, or PII are transmitted.
  • medium Privilege Escalation · line 102
    Commands invoke sudo or root privileges. Verify this elevated access is necessary and justified.
    Fix: Avoid sudo/root unless strictly required. Prefer least-privilege patterns. If elevation is needed, document the justification and scope.
  • medium Privilege Escalation · line 113
    Commands invoke sudo or root privileges. Verify this elevated access is necessary and justified.
    Fix: Avoid sudo/root unless strictly required. Prefer least-privilege patterns. If elevation is needed, document the justification and scope.
  • medium Privilege Escalation · line 119
    Commands invoke sudo or root privileges. Verify this elevated access is necessary and justified.
    Fix: Avoid sudo/root unless strictly required. Prefer least-privilege patterns. If elevation is needed, document the justification and scope.
  • medium Privilege Escalation · line 120
    Commands invoke sudo or root privileges. Verify this elevated access is necessary and justified.
    Fix: Avoid sudo/root unless strictly required. Prefer least-privilege patterns. If elevation is needed, document the justification and scope.
  • medium Privilege Escalation · line 165
    Commands invoke sudo or root privileges. Verify this elevated access is necessary and justified.
    Fix: Avoid sudo/root unless strictly required. Prefer least-privilege patterns. If elevation is needed, document the justification and scope.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00076 $0.01313
Opus 5 $0.00038 $0.00656
Sonnet 5 $0.00015 $0.00263
Haiku 4.5 $0.00008 $0.00131

Measured 8d ago against content hash 0863134855c5, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-07, from the pricing page.

Security

Grade B, and why

local-chatbot-multimodal scanned grade B with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Asks for rootmediumPrivilege escalation

A mod that escalates privileges can change anything on the machine, not only the project.

sudo tee /etc/docker/daemon.json > /dev/null << 'EOF'

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl http://localhost:11434/api/tags
Origin

Copies of this mod

1 near-identical copy found in the catalogue:

seeed_jetson_develop/skills/openclaw/local-chatbot-multimodal/SKILL.md · 172 lines

How it starts

The opening of the file, as written. The whole thing — 172 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Voice-Interactive Chatbot on Jetson (Multimodal)

Deploy a fully local voice chatbot that listens, thinks, and talks back. Combines NVIDIA Riva for speech recognition and synthesis with Ollama for local LLM inference. Everything runs in Docker containers on Jetson — no cloud required.


Execution model

Run one phase at a time. After each phase:

  • Relay all output to the user.
  • If output contains [STOP] → stop, consult the failure decision tree.
  • If output ends with [OK] → tell the user "Phase N complete" and proceed.

Prerequisites

Requirement Detail
Hardware NVIDIA Jetson (AGX Orin recommended for larger models)
JetPack 6.0+
Docker Installed with NVIDIA runtime
NGC Account API key from catalog.ngc.nvidia.com
Audio Microphone and speaker connected to Jetson

Phase 1 — Install Jetson Containers and Ollama (~5 min)

git clone https://github.com/dusty-nv/jetson-containers
bash jetson-containers/install.sh

Run Ollama and pull a model:

jetson-containers run --name ollama $(autotag ollama)

Inside the container:

ollama run llama3.2:1b

Type /bye to exit after confirming the model loads.

Verify from host:

curl http://localhost:11434/api/tags

[OK] when curl returns JSON listing the model. [STOP] if Ollama container fails to start — check Docker and NVIDIA runtime.


Phase 2 — Install and configure NGC CLI (~3 min)

mkdir -p ~/ngc_setup && cd ~/ngc_setup
wget --content-disposition https://api.ngc.nvidia.com/v2/resources/nvidia/ngc-apps/ngc_cli/versions/3.36.0/files/ngccli_arm64.zip
unzip ngccli_arm64.zip
chmod u+x ngc-cli/ngc
echo "export PATH=\"\$PATH:$(pwd)/ngc-cli\"" >> ~/.bash_profile
source ~/.bash_profile
ngc config set

Enter your NGC API key when prompted.

[OK] when ngc config current shows your org/team. [STOP] if API key is rejected — regenerate at catalog.ngc.nvidia.com.


Phase 3 — Install NVIDIA Riva (~15–30 min)

Read the full file on GitHub · 172 lines

Files

What ships with it

2 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 172 lines · 76 tokens per session scan B 0863134855c5

Subscribe to this mod's changes

local-chatbot-multimodal is a skill published in the GitHub repository Seeed-Projects/Seeed-Jetson-DevelopTool (54 stars, last pushed today), licensed MIT. It adds 76 tokens to every session and 1,313 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it B with 2 findings (asks for root, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

spark-environment-setup

Set up a working ML training/inference environment on NVIDIA DGX Spark (GB10, aarch64, CUDA 13). Use when installing PyTorch/Unsloth/TRL/vLLM on DGX Spark, hitting libcudart or wheel-ABI errors on aarch64, or choosing between NGC containers and bare pip installs.

wshobson/agents · 76 tokens

spark-memory-thermal-ops

Manage unified memory and thermals during long-running ML jobs on NVIDIA DGX Spark. Use when planning memory headroom for a training run on GB10, when a job OOMs on unified memory, or when monitoring temperature and power during multi-hour training.

wshobson/agents · 59 tokens

spark-training-gotchas

Preflight and diagnose the ten known failure modes for ML training on NVIDIA DGX Spark. Use when a training run on DGX Spark fails to start, OOMs below the 128GB limit, slows down mid-run, or before any multi-hour training job on GB10.

wshobson/agents · 63 tokens

llama-cpp

Runs LLM inference on CPU, Apple Silicon, and consumer GPUs without NVIDIA hardware. Use for edge deployment, M1/M2/M3 Macs, AMD/Intel GPUs, or when CUDA is unavailable. Supports GGUF quantization (1.5-8 bit) for reduced memory and 4-10× speedup vs PyTorch on CPU.

davila7/claude-code-templates · 76 tokens

amc-run-rtsp-calibration

Calibrate a new dataset from live RTSP camera streams via the AutoMagicCalib REST API. Use when the user provides RTSP URLs or asks to calibrate live cameras; VIOS records clips, AMC ingests them, then runs calibration.

NVIDIA/skills · 59 tokens

amc-run-video-calibration

Calibrates pre-recorded cam.mp4 datasets through the AutoMagicCalib REST API. Use for user-supplied local MP4s; route live RTSP streams to amc-run-rtsp-calibration.

NVIDIA/skills · 57 tokens