GAI-Community/GraphOmni
Enable Comprehensive LLM Evaluation on Graph Reasoning
This tool helps AI researchers and practitioners assess how well large language models (LLMs) understand and solve problems related to graphs, like finding cycles or shortest paths. You input various graph representations and different LLM models, then receive detailed evaluation results showing how accurately the LLMs perform on these graph-theoretic tasks. This is for anyone building, researching, or deploying LLMs, especially those working with complex, interconnected data.
No commits in the last 6 months.
Use this if you need to systematically benchmark the graph reasoning capabilities of different LLMs using a standardized and extendable framework.
Not ideal if you are looking for a tool to generate or visualize graphs, or if your primary interest is in evaluating LLMs on general text-based tasks rather than specific graph algorithms.
Stars
76
Forks
2
Language
Python
License
MIT
Category
Last pushed
Jun 12, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/GAI-Community/GraphOmni"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Featured in
Higher-rated alternatives
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations 🚀
open-compass/VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
EuroEval/EuroEval
The robust European language model benchmark.
Giskard-AI/giskard-oss
🐢 Open-Source Evaluation & Testing library for LLM Agents