xberg-io/xberg

Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 file extensions, plus code intelligence for 371 languages. Fifteen bindings, with CLI, REST API, and MCP server.

9.2kStars on the repository
33Mods indexed here, across every type
todayLast push, which is what freshness is scored on
MITLicence, which decides whether bodies are shown

xberg-io/xberg

Skill Claude CodeCodex

Alef-managed generated bindings in packages/ and binding crates — the regeneration workflow (task alef:generate / alef:verify), the alef.toml section layout, the core-side edits that break a regen, and the FFI bridge's JSON marshalling requirement. Load before editing anything under packages/ or a binding crate…

9.2k +4 today A 91 tokens original MIT

api-server-mcp

02

xberg-io/xberg

Skill Claude CodeCodex

REST API server and MCP protocol integration.

9.2k +4 today A 12 tokens original MIT

benchmark-workflow

03

xberg-io/xberg

Skill Claude CodeCodex

Run, diagnose, or change Xberg extraction benchmarks, quality scoring, benchmark fixtures, artifact contracts, and independently sourced ground truth. Load for the Benchmarks workflow or benchmark-harness work, not ordinary unit tests.

9.2k +4 today A 47 tokens original MIT

chunking-embeddings

04

xberg-io/xberg

Skill Claude CodeCodex

Chunking, embeddings, and RAG pipeline integration.

9.2k +4 today A 16 tokens original MIT

xberg-io/xberg

Skill Claude CodeCodex

How Xberg resolves configuration — CLI-mode and server/MCP-mode precedence orders, config file auto-discovery (xberg.toml walk-up, then the user config dir), field-level inline JSON merge (mergejsonintoconfig), the ExtractionOverrides CLI layer, and the two mechanisms that make a config change silently do nothing.…

9.2k +4 today A 95 tokens original MIT

crate-structure

06

xberg-io/xberg

Skill Claude CodeCodex

The Xberg workspace layout — the version source of truth (root Cargo.toml [workspace.package] version), the 19 workspace members and 3 excluded crates, the distribution packages under packages/, the tools/ directory, and the ignore-file allowlists a new workspace member must be added to. Load when navigating the repo…

9.2k +4 today A 83 tokens original MIT

xberg-io/xberg

Skill Claude CodeCodex

Change or diagnose Xberg's core extraction orchestration, cache semantics, extractor fallback, post-processing, concurrency defaults, or format-wide quality invariants. Load for pipeline work, not a single parser's syntax.

9.2k +4 today A 49 tokens original MIT

feature-flag-policy

08

xberg-io/xberg

Skill Claude CodeCodex

Cargo feature flags for crates/xberg — ORT-incompatible targets (WASM, Android x8664 emulator), type-only and tract inference companion features, WASM/Android-safe variants, PDF backend, mutually-exclusive ORT variants, platform-conditional deps, aggregate feature sets, and build profiles. Load when adding, wiring, or…

9.2k +4 today A 98 tokens original MIT

xberg-io/xberg

Skill Claude CodeCodex

MIME type detection and extractor routing in core/mime.rs — the FORMATS registry that EXTTOMIME and SUPPORTEDMIMETYPES are derived from, the path-based and bytes-based detection functions, priority-based registry selection, wildcard MIME families, and the real procedure for adding a format. Load when adding a format…

9.2k +4 today A 93 tokens original MIT

xberg-io/xberg

Skill Claude CodeCodex

Change or evaluate Xberg OCR backends, preprocessing, caching, page acceptance, geometry, hOCR structure, table reconstruction, or cross-backend quality. Load for OCR behavior and A/B quality work, not ordinary PDF text extraction.

9.2k +4 today A 53 tokens original MIT

pdf-backends

12

xberg-io/xberg

Skill Claude CodeCodex

Change or diagnose Xberg PDF extraction, native/Pdfium backend selection, PDF rendering sessions, encrypted documents, OCR fallback, or backend-specific capability gaps. Load for PDF engine work, not generic image OCR.

9.2k +4 today A 46 tokens original MIT

xberg-io/xberg

Skill Claude CodeCodex

Design, implement, or diagnose Xberg plugin traits, typed registries, priority collisions, lifecycle, native extractors, and Alef-generated Python plugin bridges. Load for plugin-system work, not ordinary extractor parsing.

9.2k +4 today A 49 tokens original MIT

polyrepo-boundaries

14

xberg-io/xberg

Skill Claude CodeCodex

Decide which xberg-io repository owns a cross-repository fix or API, and coordinate compatible changes across Xberg, Alef, enterprise, crawler, LLM, and OCR repositories. Load when work spans sibling repos; do not use for a self-contained Xberg edit.

9.2k +4 today A 62 tokens original MIT

release-readiness

15

xberg-io/xberg

Skill Claude CodeCodex

Audit Xberg before a push or release by reconciling CI, Publish Release dry-run, Benchmarks, generated freshness, changelog, and remote branch state. Load for release-readiness work, not routine local commits.

9.2k +4 today A 49 tokens original MIT

release-versioning

16

xberg-io/xberg

Skill Claude CodeCodex

How xberg versions are synced and released — Cargo.toml is the single source of truth, task version:sync propagates it to alef-managed binding manifests AND the integrations under integrations/, which are versioned and published in lockstep with core (including -rc.N). Load before bumping a version, editing the…

9.2k +4 today A 84 tokens original MIT

test-corpus

17

xberg-io/xberg

Skill Claude CodeCodex

The testdocuments submodule is a bucket-fetched fixture corpus that is not committed. This skill covers readtestfixture, missing fixtures, valid A/B controls, and submodule push order. Load before running Rust tests on a fresh clone, setting up an A/B control, adding a fixture-backed test, or diagnosing…

9.2k +4 today A 72 tokens original MIT

wasm-constraints

18

xberg-io/xberg

Skill Claude CodeCodex

WASM build constraints for the crates/xberg-wasm crate — the wasm-target feature set, no-tokio sync-only internal APIs, the crate-private SyncExtractor trait, the 2 MB HTML size limit, size-optimized build config (opt-level="z"), and the async-wrapper/sync-internal API pattern. Load when building for wasm32, adding or…

9.2k +4 today A 94 tokens original MIT

xberg-io/xberg

Skill Claude CodeCodex

Work on Xberg TypeScript or JavaScript packages with the repository's actual poly, pnpm, npm, Vitest, napi-rs, wasm-pack, and integration-package boundaries. Load for TS/JS tooling or package changes, not Rust-only binding generation.

9.2k +4 today A 60 tokens original MIT

batch-extraction

20

xberg-io/xberg

Skill Claude CodeCodex

Use when extracting from many files at once with shared config, bounded parallelism, per-file overrides, and error recovery. Covers the batch command, --file-configs, --max-concurrent, and output layout.

9.2k +4 today A 51 tokens original MIT

chunking

21

xberg-io/xberg

Skill Claude CodeCodex

Use when splitting extracted text into chunks for LLM context windows or RAG ingestion. Covers chunk size, overlap, markdown/yaml/semantic chunkers, tokenizer-based sizing, and the standalone chunk command.

9.2k +4 today A 46 tokens original MIT

extracting-keywords

22

xberg-io/xberg

Skill Claude CodeCodex

Use when extracting keywords (YAKE/RAKE) from documents — and, secondarily, when detecting document language or generating embeddings for RAG and search. Covers the keyword config (and its feature gating), --detect-language, and the standalone embed command with real flags.

9.2k +4 today A 63 tokens original MIT

extracting-tables

23

xberg-io/xberg

Skill Claude CodeCodex

Use when extracting tabular data from PDFs, spreadsheets, or images. Covers layout-aware table detection, table model selection, output formats (markdown / JSON cells), and known limits.

9.2k +4 today A 41 tokens original MIT

extracting-with-ocr

24

xberg-io/xberg

Skill Claude CodeCodex

Use when extracting text from scanned PDFs, photographed pages, or images that have no embedded text layer. Covers OCR backends, language packs, force-OCR, and performance tuning.

9.2k +4 today B 42 tokens original MIT