huggingface-backup

Hugging Face Backup

Use this skill for safe Hugging Face bucket backups.

First load/use the official hf-cli skill when you need current command details. It is installed at:

~/.agents/skills/hf-cli/SKILL.md

Golden Rules

• Prefer Hugging Face Buckets for raw folder backups unless the user explicitly asks for a model/dataset/space repo.
• Create buckets as private by default.
• Never upload obvious secrets if avoidable.
• Never permanently delete local data after upload. Move verified uploads to quarantine instead.
• Verify remote bucket metadata and nonzero file count before quarantine.
• Use conservative concurrency. HF/Xet can rate-limit hard; prefer one or two active syncs for multi-GB folders.
• If an upload appears stuck with zero CPU, old logs, 429 Too Many Requests, or CLOSE_WAIT, stop/restart with lower concurrency or serial sync.

Safe Excludes

Always include these excludes for bucket syncs unless the user explicitly overrides:

--exclude '**/.git/**'
--exclude '**/.DS_Store'
--exclude '**/__pycache__/**'
--exclude '**/.pytest_cache/**'
--exclude '**/.venv/**'
--exclude '**/venv/**'
--exclude '**/.env'
--exclude '**/.env.*'
--exclude '**/*cookie*'
--exclude '**/*Cookie*'
--exclude '**/*token*'
--exclude '**/*Token*'
--exclude '**/*secret*'
--exclude '**/*Secret*'
--exclude '**/*.ovpn'
--exclude '**/auth_session.json'

Pi Extension

The global Pi extension is installed at:

~/.pi/agent/extensions/hf-buckets/index.ts

After /reload or a new Pi session, it provides:

Slash commands

/hf-backup <path> --bucket <bucket-name> [--namespace <user-or-org>] [--dry-run]
/hf-status [job-id]
/hf-quarantine <job-id>

Tools available to the model

• hf_safe_bucket_backup — start a detached private bucket sync with secret-safe excludes.
• hf_backup_status — inspect one or all backup jobs.
• hf_quarantine_uploaded — move a completed verified source folder to quarantine.

Job state lives under:

~/.pi/hf-backups/jobs/