ManasVardhan/bench-my-llm
🏎️ Dead-simple LLM benchmarking CLI - latency, cost, and quality metrics
38
/ 100
Emerging
No Package
No Dependents
Maintenance
13 / 25
Adoption
1 / 25
Maturity
11 / 25
Community
13 / 25
Stars
1
Forks
2
Language
Python
License
MIT
Category
Last pushed
Mar 17, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/ManasVardhan/bench-my-llm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
allenai/RL4LMs
A modular RL library to fine-tune language models to human preferences
45
emredeveloper/Mem-LLM
Mem-LLM is a Python library for building memory-enabled AI assistants that run entirely on local...
44
cloudguruab/modsysML
Human reinforcement learning (RLHF) framework for AI models. Evaluate and compare LLM outputs,...
41
modal-labs/stopwatch
A tool for benchmarking LLMs on Modal
36
Mya-Mya/CBF-LLM
"CBF-LLM: Safe Control for LLM Alignment"
35