atai-newton-fusion-model

Newton C 2.6 Fusion Model — Multimodal /query in One Hop

Single stateless POST to /query for text, image, or video reasoning against the C 2.6 fusion checkpoint. No Lens session, no batch pipeline, no SSE. One call → one response.

When to Apply

• User wants to describe / classify / extract structure from an image with one API call
• User wants the same for a short video in a single /query call
• User wants stateless multimodal reasoning (no per-session warmup, no orphan cleanup)
• User wants JSON output from a multimodal input (the prompt is the schema)
• User is building a serverless / per-request handler where a streaming Lens session would be the wrong shape

Do not use this skill when:

• The workload is live, streaming video → text from a long-running camera feed — a session-based activity monitor is the right shape, not stateless /query
• The workload is a large multi-file batch job
• The task is time-series classification via embeddings (KNN / anomaly detection)

The Model Identifier

Newton::c2_6_8b_fp8_260424d7a55d5e

The full Newton:: prefix and the _fp8_ segment are required. Variants that omit either are rejected with 400 invalid_model_version:

c2_6_8b_fp8_260424d7a55d5e            ❌ missing Newton:: prefix
Newton::c2_6_8b_260424d7a55d5e        ❌ missing _fp8_
c2_6_8b_260424d7a55d5e                ❌ both missing

This was probed end-to-end against https://platform.u1.archetypeai.app/api/lens/query on prod.

Endpoint

POST {ATAI_API_ENDPOINT}/api/lens/query
Authorization: Bearer <API_KEY>
Content-Type: application/json

Both ATAI_API_KEY and ATAI_API_ENDPOINT are required — there is no default endpoint, so a wrong-deployment mistake fails loudly at startup instead of silently at query time. Prod is https://platform.u1.archetypeai.app/api. The same endpoint serves all three modalities below — what changes is the request body.

Wire Shapes

Text + JSON

{
  "query": "Classify the operational state. Respond with ONLY the JSON object.",
  "instruction_prompt": "You output {\"state\": \"...\", \"confidence\": <0..1>}.",
  "file_ids": [],
  "model": "Newton::c2_6_8b_fp8_260424d7a55d5e",
  "max_new_tokens": 300
}