zetic-mlange

ZETIC Melange (MLange) SDK Integration Skill

This skill helps users integrate the ZETIC Melange on-device AI SDK into mobile applications.

Naming: The product is called Melange but source code uses MLange (e.g., ZeticMLangeModel).

Key Resources

• Dashboard: https://melange.zetic.ai
• Docs: https://docs.zetic.ai
• GitHub: https://github.com/zetic-ai
• Contact: [email protected]

Prerequisites

Users need two things from the Melange Dashboard:

1. Personal Key — authentication credential
2. Model Name — in account_name/project_name format (e.g., "Steve/YOLOv11_comparison")

Supported upload formats: PyTorch .pt2, ONNX .onnx, TorchScript .pt

SDK Setup

Android (Gradle):

// app/build.gradle.kts
dependencies {
    implementation("com.zeticai.mlange:mlange:+")
}

android {
    packaging { jniLibs.useLegacyPackaging = true }
}

Add <uses-permission android:name="android.permission.INTERNET" /> to AndroidManifest.xml (SDK downloads model weights on first run).

iOS (CocoaPods):

pod 'ZeticMLange'

iOS (SPM): Add https://github.com/zetic-ai/ZeticMLangeiOS as a Swift Package dependency.

---

CRITICAL: Threading & Concurrency Rules

All MLange SDK calls are synchronous and blocking. They directly interface with native hardware (NPU/GPU/CPU) using fixed memory buffers. Every code example you generate MUST follow these rules:

Rule 1: Never Call on the Main/UI Thread

model.run(), model.waitForNextToken(), and even model construction can block for significant time. Always dispatch to a background thread.

Android (Kotlin):

// Always use Dispatchers.IO for blocking SDK calls (large thread pool designed for blocking work).
// Do NOT use Dispatchers.Default — it's sized to CPU cores and blocking calls would starve other coroutines.
withContext(Dispatchers.IO) {
    val outputs = model.run(inputs)
}

iOS (Swift):

// Use an actor or Task to move off @MainActor
func infer() async throws -> [Tensor] {
    try await Task.detached {
        try self.model.run(inputs: inputs)  // Runs on cooperative thread pool
    }.value
}