cncoder

2 mods across 1 repository, 2 stars between them.

cncoder/serverless-litellm

Instructions file

Deployment instructions for running LiteLLM, an API proxy for language models, on Amazon’s EKS Kubernetes service and connecting it to AWS Bedrock. They cover infrastructure setup, model routing, configuration, and deployment scripts.

2 1mo ago A 1,124 tokens original MIT

cncoder/serverless-litellm

Skill Claude CodeCodex

Harden ALB-backed services (LiteLLM, generic APIs) behind CloudFront + WAF. Creates CloudFront distribution with secret origin header, WAF Web ACL with path whitelist, and locks down ALB Security Group to CloudFront-only. Use when deploying any internet-facing ALB service that should not be directly accessible.

2 1mo ago A 73 tokens original MIT