Letian2003/C-VQA
Counterfactual Reasoning VQA Dataset
This dataset provides visual questions designed to test how well multi-modal language models can understand and reason about 'what-if' scenarios in images. It takes images and corresponding CSV files of questions as input, and helps researchers evaluate how accurately models can answer these counterfactual queries. This is for AI researchers and developers studying and improving the reasoning capabilities of multi-modal AI systems.
No commits in the last 6 months.
Use this if you are a researcher or developer who needs to rigorously evaluate the counterfactual reasoning abilities of visual question answering (VQA) models.
Not ideal if you are looking for a ready-to-use application or a general-purpose dataset for training standard VQA models without a focus on counterfactuals.
Stars
28
Forks
2
Language
Python
License
—
Category
Last pushed
Nov 23, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/Letian2003/C-VQA"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
open-thought/reasoning-gym
[NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
Hmbown/Hegelion
Dialectical reasoning architecture for LLMs (Thesis → Antithesis → Synthesis)
LLM360/Reasoning360
A repo for open research on building large reasoning models
TsinghuaC3I/Awesome-RL-for-LRMs
A Survey of Reinforcement Learning for Large Reasoning Models
bowang-lab/BioReason
BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model | NeurIPS '25