Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx agentmods add skills/apache/doris-skills/data-lakenpx skills add apache/doris-skills --skill data-lakegit clone --depth 1 https://github.com/apache/doris-skillsWhat it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5 | $0.00041 | $0.00850 |
| Opus 5 | $0.00020 | $0.00425 |
| Sonnet 5 | $0.00008 | $0.00170 |
| Haiku 4.5 | $0.00004 | $0.00085 |
Grade A, and why
doris-debug-data-lake scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Makes network callslowCapability
Not a fault in itself. Listed so you know the mod talks to something, and to what.
curl -I "https://<bucket>.s3.<region>.amazonaws.com" How it starts
The opening of the file, as written. The whole thing — 101 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Data Lake (Multi-Catalog)
Causes
| ID | Cause | Evidence | Source anchor |
|---|---|---|---|
| A | Metadata stale | Query returns old data / missing partitions after upstream write | HMSClient.java, CachedHMSClient.java |
| B | S3/HDFS connectivity | Access Denied, Timeout, NoSuchBucket |
S3FileSystem.java, HdfsResource.java |
| C | External MV rewrite miss | EXPLAIN shows no MATERIALIZED_REWRITE | MTMVService.java rewrite rules |
| D | Schema mismatch | Parquet/ORC schema ≠ Hive Metastore schema | ParquetReader.cpp, schema merge |
| E | Credential / IAM expiry | STS / IAM token rotated; 403 on S3 | S3FileSystem.java credential refresh |
| F | Too many open files | FD exhaustion listing large table directories | BE ulimit -n, FileSystem.listFiles() |
10 min triage
-- Verify catalog is alive
SHOW CATALOGS;
-- Refresh metadata (hive / iceberg / paimon)
REFRESH CATALOG hive_catalog;
REFRESH DATABASE hive_catalog.db_name;
REFRESH TABLE hive_catalog.db_name.tbl_name;
-- Check if external MV rewrite is enabled
SET materialized_view_rewrite_enable_contain_external_table = true;
-- Analyze external table for CBO stats
ANALYZE TABLE hive_catalog.db_name.tbl_name;
# BE logs for S3/HDFS errors
./scripts/doris-debug log-grep be/log --query-id "$QID"
grep -r "403\|Access Denied\|Timeout\|NoSuchBucket\|Token.*expired" be/log/
# Check BE file descriptor limit
cat /proc/$BE_PID/limits | grep "open files"
Cause A — Metadata staleness
Hive Metastore metadata is cached; REFRESH CATALOG invalidates the cache. For large catalogs, prefer:
-- Refresh only the changed partition
REFRESH TABLE catalog.db.tbl PARTITION (dt='2026-07-15');
If refresh is slow, check HMSClient cache settings (fe.conf):
hive_metastore_client_timeout_second = 10
Cause B — S3/HDFS connectivity
# be.conf — S3 credential chain
aws_access_key_id = ...
aws_secret_access_key = ...
aws_region = us-east-1
What ships with it
1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 2d ago First seen · 101 lines · 41 tokens per session scan A 6fac97f2bb14
doris-debug-data-lake is a skill published in the GitHub repository apache/doris-skills (37 stars, last pushed 13d ago), licensed Apache-2.0. It adds 41 tokens to every session and 850 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other skills, from other repositories
mongodb-natural-language-querying
Generate read-only MongoDB queries (find) or aggregation pipelines using natural language, with collection schema context and sample documents. Use this skill whenever the user asks to write, create, or generate MongoDB queries, wants to filter/query/aggregate data in MongoDB, asks "how do I query...", needs help with…
yida-data-management
宜搭数据管理。表单实例/子表/流程实例/任务中心的查询、新增、更新。表单走 /v1/form/，流程走 /v1/process/，不能混用。.
yida-business-rule
宜搭表单业务关联规则与高级函数配置。用于在表单设置中配置业务关联规则，或使用 INSERT、UPDATE、DELETE、UPSERT 高级函数实现跨表增删改。适用于需要表单间数据联动的场景。.
yida-aggregate-table
宜搭聚合表（virtualView）管理。用于列出、创建空聚合表、读取/预览设计配置、保存草稿、发布配置和查询构建状态；严格区分 stash 与 live revision，并在写入前校验固定前端已确认的六数组契约。.
yida-db-seq-fix
PostgreSQL Sequence 自动修复工具。检测并修复宜搭环境检测自动建表时 Sequence 起始值问题，避免主键冲突。当用户提到"Sequence"、"主键冲突"、"自增ID错误"、"db-seq-fix"时触发。.
mongodb-connection
Optimize MongoDB client connection configuration (pools, timeouts, patterns) for any supported driver language. Use this skill when working/updating/reviewing on functions that instantiate or configure a MongoDB client (eg, when calling connect()), configuring connection pools, troubleshooting connection errors…