roboflow/vision-ai-checkup

Take your LLM to the optometrist.

51
/ 100
Established

Vision AI Checkup helps evaluate how well different vision-capable AI models understand and respond to visual information from real-world scenarios. You provide images alongside specific questions and expected answers, and the tool benchmarks various AI models against these to see how accurately they perform. This is ideal for AI researchers, product managers, or anyone needing to quickly compare the practical performance of vision AI models without diving into complex technical benchmarks.

Use this if you want to quickly compare the real-world visual understanding capabilities of different vision AI models using a straightforward assessment.

Not ideal if you need a deep, granular performance analysis with thousands of data points or if you're building a highly customized, domain-specific evaluation suite.

AI model evaluation vision AI large language models AI benchmarking model comparison
No Package No Dependents
Maintenance 10 / 25
Adoption 8 / 25
Maturity 15 / 25
Community 18 / 25

How are scores calculated?

Stars

46

Forks

15

Language

Python

License

MIT

Last pushed

Mar 07, 2026

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/roboflow/vision-ai-checkup"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.