find-duplicates

Find Duplicates Skill

Detect potential duplicate issues using semantic similarity search with pgvector embeddings.

Quick Start

Use this skill when:

• New issue being created (automatic check)
• User suspects duplicate exists (/find-duplicates)
• Cleaning up issue backlog

Example:

New issue: "Users cannot log in with email addresses"

AI finds duplicates:
- "Login fails for email users" (similarity: 0.92, RECOMMENDED duplicate)
- "Email authentication broken" (similarity: 0.88, RECOMMENDED duplicate)
- "User auth not working" (similarity: 0.65, ALTERNATIVE - may be related)

Workflow

1. Generate Embedding

   • Combine issue title + description
   • Generate embedding using OpenAI text-embedding-3-large (3072 dims)
   • Store in embeddings column (pgvector)

2. Semantic Search

   • Query pgvector for similar issues using cosine similarity
   • Filter by project_id (same project)
   • Exclude closed/archived issues (optional)
   • Return top 10 matches

3. Score Similarity

   • RECOMMENDED duplicate (>0.85): Very high semantic overlap
   • DEFAULT duplicate (0.70-0.85): Likely duplicate, needs review
   • ALTERNATIVE related (0.60-0.70): Possibly related, not duplicate

4. Provide Context

   • Include issue status (open, in_progress, closed)
   • Show creation date (older = likely original)
   • Link to issue for review

Output Format

{
  "duplicates": [
    {
      "issue_id": "issue-abc123",
      "title": "Login fails for email users",
      "similarity": 0.92,
      "confidence": "RECOMMENDED",
      "status": "open",
      "created_at": "2024-01-15T10:00:00Z",
      "rationale": "Very high semantic similarity (0.92), same symptoms described",
      "url": "/issues/issue-abc123"
    },
    {
      "issue_id": "issue-def456",
      "title": "Email authentication broken",
      "similarity": 0.88,
      "confidence": "RECOMMENDED",
      "status": "in_progress",
      "created_at": "2024-01-20T14:30:00Z",
      "rationale": "High similarity, currently being worked on",
      "url": "/issues/issue-def456"
    },
    {
      "issue_id": "issue-ghi789",
      "title": "User auth not working",
      "similarity": 0.65,
      "confidence": "ALTERNATIVE",
      "status": "closed",
      "created_at": "2023-12-10T09:15:00Z",
      "rationale": "Moderate similarity, may be related but different root cause",
      "url": "/issues/issue-ghi789"
    }
  ],
  "summary": "Found 3 potential duplicates (2 RECOMMENDED)",
  "suggestion": "Review issue-abc123 before creating new issue"
}