katha-ai/VELOCITI
VELOCITI Benchmark Evaluation and Visualisation Code
This tool helps researchers and engineers rigorously test the compositional reasoning abilities of video-language AI models (like CLIP or Video-LLMs). You input a video-language model and the VELOCITI dataset, and it outputs detailed evaluation metrics and predictions, showing how well the model understands complex relationships in videos. It's designed for AI researchers and practitioners working on advanced video understanding.
No commits in the last 6 months.
Use this if you need to benchmark and understand the strengths and weaknesses of your video-language AI models in interpreting complex visual and linguistic information.
Not ideal if you intend to use the VELOCITI dataset to train or fine-tune your models, as it is strictly designed as a test set for evaluation.
Stars
8
Forks
—
Language
Python
License
—
Category
Last pushed
Apr 18, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/katha-ai/VELOCITI"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
opentensor/bittensor
Internet-scale Neural Networks
trailofbits/fickling
A Python pickling decompiler and static analyzer
benchopt/benchopt
A framework for reproducible, comparable benchmarks
BiomedSciAI/fuse-med-ml
A python framework accelerating ML based discovery in the medical field by encouraging code...
mosaicml/streaming
A Data Streaming Library for Efficient Neural Network Training