minimax-image-understanding

MiniMax Image Understanding Skill

Use this skill when you need to analyze, describe, or extract information from images.

How to Use

Call the understand_image tool directly with a prompt and image URL:

understand_image({
  prompt: "Your question about the image",
  image_url: "https://example.com/image.png"
})

When to Use

Use understand_image when:

• Screenshots: Error messages, UI issues, code in screenshots
• Visual content: Photos, diagrams, charts, graphs
• Documents: Extracting text from images (OCR), understanding layouts
• UI/UX analysis: Evaluating designs, identifying components
• Visual debugging: Understanding visual bugs or layout issues

When NOT to Use

Do NOT use understand_image when:

• Image is already described in the conversation
• The image is a simple icon or emoji you recognize
• No image is provided or the image URL is inaccessible
• Redundant with existing context (e.g., file contents already visible)

Usage

understand_image({
  prompt: "What do you see in this image?",
  image_url: "https://example.com/screenshot.png"
})

API Details

Endpoint: POST {api_host}/v1/coding_plan/vlm

Request Body:

{
  "prompt": "Your question about the image",
  "image_url": "data:image/jpeg;base64,/9j/4AAQ..."
}

Response Format:

{
  "content": "AI analysis of the image...",
  "base_resp": {
    "status_code": 0,
    "status_msg": "success"
  }
}

Image Processing

The tool automatically handles three types of image inputs:

1. HTTP/HTTPS URLs: Downloads the image and converts to base64

   • Example: https://example.com/image.jpg

2. Local file paths: Reads local files and converts to base64

   • Absolute: /Users/username/Documents/image.png
   • Relative: images/photo.png
   • Removes @ prefix if present

3. Base64 data URLs: Passes through existing base64 data

   • Example: data:image/png;base64,iVBORw0KGgo...

Image Formats