aws-samples/sample-genai-on-eks-starter-kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
Stars
51
Forks
30
Language
JavaScript
License
MIT-0
Last pushed
Apr 10, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-inference/aws-samples/sample-genai-on-eks-starter-kit"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related engines
nordwestt/ollama-ai-provider-v2
Vercel AI Provider for running LLMs locally using Ollama
OEvortex/Webscout
Webscout is the all-in-one search and AI toolkit you need. Discover insights with Yep.com,...
superagentxai/superagentx
Move from idea to production in hours with policy-driven autonomous AI agents. Unified Control...
ArvinLovegood/go-stock
🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部...
kubernetes-sigs/lws
LeaderWorkerSet: An API for deploying a group of pods as a unit of replication