e2e-validate

E2E Validate - Test Output Validation

Validate existing e2e test outputs without re-running tests.

Time: ~1 minute Requirements: None Purpose: Quick validation of test outputs from previous e2e runs

---

Phase 1: Locate Test Outputs

Find Test Output Directory

Check for existing test outputs:

ls -lR /tmp/gobbler_e2e_tests/

Expected Directory Structure

/tmp/gobbler_e2e_tests/
├── youtube/           # YouTube transcripts
├── audio/             # Audio transcriptions
├── webpages/          # Web scraping outputs
├── documents/         # Document conversions
├── downloads/         # Downloaded videos
├── crawled/           # Crawled sites
└── batch/
    ├── audio/         # Batch audio results
    ├── documents/     # Batch document results
    ├── webpages/      # Batch webpage results
    └── playlist/      # Playlist batch results

Report Output Inventory

# E2E Validate - Output Inventory

## Output Directory: /tmp/gobbler_e2e_tests/

Found directories:
- youtube/: [X files]
- audio/: [X files]
- webpages/: [X files]
- documents/: [X files]
- downloads/: [X files]
- crawled/: [X files/dirs]
- batch/audio/: [X files]
- batch/documents/: [X files]
- batch/webpages/: [X files]
- batch/playlist/: [X files]

Total files found: [X]

If no outputs found: Report no test outputs to validate

---

Phase 2: Validation Checks

For Each Markdown File (.md)

Run comprehensive validation:

1. YAML Frontmatter Validation

Check structure:

• File starts with ---
• Contains closing ---
• Valid YAML syntax (parse without errors)

Check required fields:

• title field present
• source field present
• timestamp or created_at field present
• tool_used or similar metadata present

Parse and validate:

import yaml

with open(file_path) as f:
    content = f.read()

# Extract frontmatter
if content.startswith('---'):
    parts = content.split('---', 2)
    if len(parts) >= 3:
        frontmatter_text = parts[1]
        try:
            metadata = yaml.safe_load(frontmatter_text)
            # Validate required fields
            assert 'title' in metadata
            assert 'source' in metadata
            # etc.
        except Exception as e:
            # Report parsing error