IDEA-Research/ChatRex
Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding
This project helps anyone needing to deeply understand and interact with visual content by combining image analysis with natural language. You input images and text questions or commands, and it outputs detailed descriptions, object detections, and grounded conversations, highlighting specific regions in the image relevant to the response. It's for analysts, content creators, or researchers who need to go beyond simple image recognition to understand objects, relationships, and context within images.
211 stars. No commits in the last 6 months.
Use this if you need to ask detailed questions about specific elements or regions within an image and get precise, visually-referenced answers.
Not ideal if you only need basic image classification or simple text generation without direct visual grounding and object-level interaction.
Stars
211
Forks
9
Language
Python
License
—
Category
Last pushed
Oct 15, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/IDEA-Research/ChatRex"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
posit-dev/chatlas
Your friendly guide to building LLM chat apps in Python with less effort and more clarity.
xming521/WeClone
🚀 One-stop solution for creating your AI twin from chat history 💡 Fine-tune LLMs with your chat...
ooyinet/WeClone
🚀从聊天记录创造数字分身的一站式解决方案💡 使用聊天记录微调大语言模型，让大模型有“那味儿”，并绑定到聊天机器人，实现自己的数字分身。 数字克隆/数字分身/数字永生/LLM/聊天机器人/LoRA
vemonet/libre-chat
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline...
qqqqqf-q/MirrorFlow
从对话数据到训练:数字分身 + 模型蒸馏 From Dialogue Data to Training Closed-Loop: Digital Twin + Model Distillation