kanban-stuck-task-recovery

name: kanban-stuck-task-recovery description: Diagnose and recover stuck kanban in_progress tasks (worker dead, claim_expires expired, dispatcher down). Includes SQL reset script, root cause analysis, and preventive monitoring. type: skill space: outcome tags: [skill, kanban, operations] created: 2026-05-31 updated: 2026-05-31 links:

• "[[@memory/kanban/KANBAN_INDEX]]"
• "[[@memory/growth/kanban-maintenance-guide]]"
• "[[@identity/brain/rules]]"---

Kanban Stuck Task Diagnosis & Recovery

When to Use

• task_list(status='in_progress') returns tasks with no worker running
• Worker processes (PID) are dead but tasks remain stuck in in_progress
• claim_expires timestamps are past the current time
• After a dispatcher outage, tasks need to be reset before the system resumes

Diagnosis

# 1. Find all in_progress tasks with their worker status
python3 -c "
import sqlite3
db = '~/.{{AGENT_NAME_LOWER}}/P2-hippocampus/kanban/state/{{AGENT_NAME_LOWER}}_tasks.db'
conn = sqlite3.connect(db)
cur = conn.cursor()
for id_, title, board, pid, expires in cur.execute(
    'SELECT id, title, board, worker_pid, claim_expires FROM tasks WHERE status=\"in_progress\"'
):
    print(f'{id_} | board={board} | pid={pid} | expires={expires}')
conn.close()
"

# 2. Check if worker PIDs are alive
ps -p 68898 -o pid,etime 2>/dev/null || echo "worker PID 68898 is DEAD"

Recovery Script

# Reclaim all stale in_progress tasks (expired claim_expires)
python3 -c "
import sqlite3
from datetime import datetime, timezone

db = '~/.{{AGENT_NAME_LOWER}}/P2-hippocampus/kanban/state/{{AGENT_NAME_LOWER}}_tasks.db'
conn = sqlite3.connect(db)
cur = conn.cursor()

stale = cur.execute('''
    SELECT id, title, worker_pid, claim_expires
    FROM tasks
    WHERE status='in_progress'
    AND (worker_pid IS NULL OR claim_expires < datetime('now'))
''').fetchall()

print(f'Found {len(stale)} stale in_progress tasks')
reclaimed = 0
for row in stale:
    tid = row[0]
    cur.execute('''
        UPDATE tasks
        SET status='ready', worker_pid=NULL, claim_expires=NULL, started_at=NULL
        WHERE id=? AND status='in_progress'
    ''', (tid,))
    if cur.rowcount > 0:
        print(f'RECLAIMED: {tid}')
        reclaimed += 1

conn.commit()
print(f'Total reclaimed: {reclaimed}')
conn.close()
"