google-ai-edge

6 mods across 1 repository, 415 stars between them.

google-ai-edge/litert-samples

Skill Claude CodeCodex

Shrink a converted LiteRT model with ai-edge-quantizer (fp16 / int8 / int4) without losing accuracy, verifying parity against the float source after every step. Use when choosing a quantization recipe for a new model, when a quantized model fails to load, degrades on a task benchmark, or degenerates over long…

415 3d ago A 92 tokens original Apache-2.0

google-ai-edge/litert-samples

Skill Claude CodeCodex

Build a new Android app (Kotlin, Compose) around a verified LiteRT model using the CompiledModel API - the app architecture, the inference-layer lifecycle rules, model delivery, and the UI traps that masquerade as model bugs. Use when turning a converted and device-verified model into a demo or product app, when an…

415 3d ago A 98 tokens original Apache-2.0

google-ai-edge/litert-samples

Skill Claude CodeCodex

Convert a PyTorch or Hugging Face model into a LiteRT model that runs fully on the GPU via the CompiledModel API with verified-correct output, and lay it out as a model recipe. Use when converting a new model, or when a converted model is rejected by the GPU, falls back to CPU, or returns wrong numbers on device.

415 3d ago A 76 tokens original Apache-2.0

google-ai-edge/litert-samples

Skill Claude CodeCodex

Rapidly migrate an Android application from legacy TensorFlow Lite (TFLite) to modern LiteRT CompiledModel API v2.1.6 in Open Source GitHub repositories. Supports True Async Execution (runAsync), Zero-Copy I/O Buffers, NPU JIT compilation, and automated 2-stage verification self-testing.

415 3d ago A 76 tokens original Apache-2.0

google-ai-edge/litert-samples

Skill Claude CodeCodex

Convert a Hugging Face LLM or vision-language model checkpoint into a .litertlm bundle that runs on the LiteRT-LM runtime with verified quality - classify the architecture against known runtime walls, pick the recipe family (dense, reasoning, hybrid SSM, VLM), export, quantize, gate the result against the source…

415 3d ago A 132 tokens original Apache-2.0

google-ai-edge/litert-samples

Skill Claude CodeCodex

Prove a converted or quantized LiteRT model on the actual device via the CompiledModel API - confirm GPU residency, compare device output against the source model, and diagnose device-only failures such as silent CPU fallback, whole-graph compile ceilings, and fp16 range breaks. Use after conversion or quantization…

415 3d ago A 99 tokens original Apache-2.0