whwu95/FreeVA
FreeVA: Offline MLLM as Training-Free Video Assistant
This project helps researchers and machine learning practitioners evaluate the performance of multimodal large language models (MLLMs) on video question-answering tasks without the need for extensive training. It takes existing image-based MLLMs and video datasets as input, and outputs performance metrics related to zero-shot video QA and text generation, allowing for direct comparison of different models. Scientists and ML researchers focused on video understanding would use this.
No commits in the last 6 months.
Use this if you want to quickly benchmark how well existing image-based MLLMs can understand and answer questions about videos without any additional training, providing a strong baseline for your research.
Not ideal if you are looking to fine-tune a video-specific MLLM or want a tool for general video content creation or analysis outside of research benchmarking.
Stars
69
Forks
1
Language
Python
License
Apache-2.0
Category
Last pushed
Jun 09, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/whwu95/FreeVA"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jingyaogong/minimind-v
🚀 「大模型」1小时从0训练26M参数的视觉多模态VLM！🌏 Train a 26M-parameter VLM from scratch in just 1 hours!
SkyworkAI/Skywork-R1V
Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in...
roboflow/vision-ai-checkup
Take your LLM to the optometrist.
zai-org/GLM-TTS
GLM-TTS: Controllable & Emotion-Expressive Zero-shot TTS with Multi-Reward Reinforcement Learning
NExT-GPT/NExT-GPT
Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model