xlite-dev/Awesome-LLM-Inference
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
5,135 stars. Actively maintained with 6 commits in the last 30 days.
Stars
5,135
Forks
359
Language
Python
License
GPL-3.0
Last pushed
Apr 09, 2026
Commits (30d)
6
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-inference/xlite-dev/Awesome-LLM-Inference"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related engines
nordwestt/ollama-ai-provider-v2
Vercel AI Provider for running LLMs locally using Ollama
OEvortex/Webscout
Webscout is the all-in-one search and AI toolkit you need. Discover insights with Yep.com,...
superagentxai/superagentx
Move from idea to production in hours with policy-driven autonomous AI agents. Unified Control...
ArvinLovegood/go-stock
🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部...
kubernetes-sigs/lws
LeaderWorkerSet: An API for deploying a group of pods as a unit of replication