fabric-spark-monitoring

fabric-spark-monitoring is a skill for Claude Code from wardawgmalvicious/agent-config. It costs 147 tokens per session (2,030 once invoked), scanned A, original, MIT.

Instructions for diagnosing how long Microsoft Fabric Spark notebooks and jobs take by reading monitoring APIs and Spark History Server data. The APIs provide read-only timing and execution details.

In plain words
What is it for?
Use them to list Spark sessions, inspect queue and run durations, retrieve notebook or job history, and attribute elapsed time to Fabric Spark activities.
Why use it?
They help separate time spent waiting for a Livy session from time spent running Spark work, making slow jobs easier to investigate.

Skill for Claude Code

Written for Claude Code: disable-model-invocation in frontmatter.

Good fit Use them to list Spark sessions, inspect queue and run durations, retrieve notebook or job history, and attribute elapsed time to Fabric Spark activities.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/wardawgmalvicious/agent-config/fabric-spark-monitoring
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add wardawgmalvicious/agent-config --skill fabric-spark-monitoring
Clone the repo
git clone --depth 1 https://github.com/wardawgmalvicious/agent-config

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for fabric-spark-monitoring

README.md
[![agentmods](https://agentmods.dev/badge/skills/wardawgmalvicious/agent-config/fabric-spark-monitoring/github.svg)](https://agentmods.dev/skills/wardawgmalvicious/agent-config/fabric-spark-monitoring)
Your own site
<a href="https://agentmods.dev/skills/wardawgmalvicious/agent-config/fabric-spark-monitoring"><img src="https://agentmods.dev/badge/skills/wardawgmalvicious/agent-config/fabric-spark-monitoring/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for fabric-spark-monitoring

Your own site · 80×15
<a href="https://agentmods.dev/skills/wardawgmalvicious/agent-config/fabric-spark-monitoring"><img src="https://agentmods.dev/badge/skills/wardawgmalvicious/agent-config/fabric-spark-monitoring.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 147 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,030 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00147 $0.02030
Opus 5 $0.00073 $0.01015
Sonnet 5 $0.00029 $0.00406
Haiku 4.5 $0.00015 $0.00203

Measured 2d ago against content hash 94a6f8b2c845, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-12, from the pricing page.

Security

Grade A, and why

fabric-spark-monitoring scanned grade A with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

`https://api.fabric.microsoft.com/v1`; plain `curl` with a bearer
skills/fabric/fabric-spark-monitoring/SKILL.md · 181 lines

How it starts

The opening of the file, as written. The whole thing — 181 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Fabric Spark monitoring APIs

Attribute Fabric Spark notebook / pipeline wall-clock time using the Spark monitoring REST surface: Livy session listings plus the embedded Spark History Server (SHS) mirror. Every endpoint here is a GET — read-only diagnostics, no state changes.

All endpoint shapes and field names below were exercised live on 2026-08-17. The surface is preview-era — re-verify response shapes before building anything that depends on their stability.

Auth & base URL

az account get-access-token --resource https://api.fabric.microsoft.com --query accessToken -o tsv

Delegated token. On a Fabric-only tenant (no Azure subscription) the login itself needs az login --allow-no-subscriptions. Base URL is https://api.fabric.microsoft.com/v1; plain curl with a bearer header works from there — no SDK or MCP server required. Full token audience table and 401 debugging: fabric-auth skill.

Listing Livy sessions

GET /workspaces/{wsId}/spark/livySessions?maxResults=N            # workspace-wide
GET /workspaces/{wsId}/notebooks/{itemId}/livySessions            # per-item
GET /workspaces/{wsId}/sparkJobDefinitions/{itemId}/livySessions  #   "
GET /workspaces/{wsId}/lakehouses/{itemId}/livySessions           #   "

Field guide for the session objects:

Field Meaning
sparkApplicationId YARN application id — required for SHS drill-down below
livyId The Livy session id used in per-application URLs
livyName HC_<NotebookName>_<livyId> prefix marks a high-concurrency session
state Session lifecycle state
origin, submitter, jobType Who/what launched the session
submittedDateTime / startDateTime / endDateTime Submission vs actual start vs end
queuedDuration / runningDuration / totalDuration Duration objects

queuedDuration is pure capacity contention — time spent before the Spark application existed at all. If it dominates, the problem is capacity/queueing, not the notebook.

Read the full file on GitHub · 181 lines

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago Changed 94a6f8b2c845
  2. 8d ago Changed · +5 lines eb3bb1f7f3a8
  3. 12d ago First seen · 176 lines · 147 tokens per session scan A cc0e0df7fab2

Subscribe to this mod's changes

fabric-spark-monitoring is a skill published in the GitHub repository wardawgmalvicious/agent-config (1 stars, last pushed yesterday), licensed MIT. It adds 147 tokens to every session and 2,030 once invoked, about $0.0007 per session on Opus 5. A static security scan graded it A with 1 finding (makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

azure-diagnostics

WORKFLOW SKILL — Debug and troubleshoot Azure production issues: Container Apps + Function Apps diagnostics, KQL log analysis, health checks. WHEN: 'debug production issues', 'troubleshoot container apps', 'troubleshoot function apps', 'image pull failures', 'cold start issues', 'health probe failures'. DO NOT USE…

jonathan-vella/apex-accelerator · 91 tokens

azure-messaging

Troubleshoot and resolve issues with Azure Messaging SDKs for Event Hubs and Service Bus. Covers connection failures, authentication errors, message processing issues, and SDK configuration problems. WHEN: event hub SDK error, service bus SDK issue, messaging connection failure, AMQP error, event processor host issue…

jonathan-vella/apex-accelerator · 135 tokens

azure-diagnostics

Debug Azure production issues on Azure using AppLens, Azure Monitor, resource health, and safe triage. WHEN: debug production issues, troubleshoot app service, app service high CPU, app service deployment failure, troubleshoot container apps, troubleshoot functions, troubleshoot AKS, VM RDP, Linux SSH, VM black…

microsoft/skills · 160 tokens

azure-messaging

Troubleshoot and resolve issues with Azure Messaging SDKs for Event Hubs and Service Bus. Covers connection failures, authentication errors, message processing issues, and SDK configuration problems. WHEN: event hub SDK error, service bus SDK issue, messaging connection failure, AMQP error, event processor host issue…

microsoft/skills · 178 tokens

spk-admin-setup-doctor

Install, verify, and repair Spec Kitty commands, skills, agent paths, runtime prerequisites, and common setup failures.

Priivacy-ai/spec-kitty · 31 tokens

ak-test

Set up testing and debug common issues in Agent Kernel projects. This skill guides you through configuring the built-in test framework, writing agent tests, choosing test modes (score, llm, fallback), and troubleshooting common errors.

yaalalabs/agent-kernel · 47 tokens