Llm Comparison Evaluation MLOps Tools

There are 3 llm comparison evaluation tools tracked. The highest-rated is ksm26/Automated-Testing-for-LLMOps at 26/100 with 6 stars.

Get all 3 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=mlops&subcategory=llm-comparison-evaluation&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 ksm26/Automated-Testing-for-LLMOps

Create a continuous integration (CI) workflow for testing LLMs applications...

26
Experimental
2 kishan5111/perfsmith

Tool to find the cheapest self-hosted serving configuration that meets your SLO.

22
Experimental
3 Jeeban420/python-api-frameworks-benchmark

🚀 Benchmark five Python web frameworks under realistic workloads with Docker...

13
Experimental