Instructions file
Deployment instructions for running LiteLLM, an API proxy for language models, on Amazon’s EKS Kubernetes service and connecting it to AWS Bedrock. They cover infrastructure setup, model routing, configuration, and deployment scripts.
2 1mo ago A 1,124 tokens
original MIT