TonyLianLong/LLM-groundedVideoDiffusion
[ICLR 2024] LLM-grounded Video Diffusion Models (LVD): official implementation for the LVD paper
This project helps video creators and content producers generate short video clips from detailed text descriptions. You input a text prompt, and the system uses an AI planner to create a scene layout with objects and their movements. This layout then guides a video generator to produce a video that accurately reflects your prompt's specifics, making it easier to visualize and create dynamic scenes.
167 stars. No commits in the last 6 months.
Use this if you need to create specific video content from complex text prompts, ensuring objects and their actions appear exactly as described across multiple frames.
Not ideal if you're looking for a simple text-to-video tool that doesn't require precise control over scene composition and object placement.
Stars
167
Forks
8
Language
Python
License
—
Category
Last pushed
May 07, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/TonyLianLong/LLM-groundedVideoDiffusion"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ljleb/sd-mecha
Executable State Dict Recipes
SJTU-DENG-Lab/Discrete-Diffusion-Forcing
Discrete Diffusion Forcing (D2F): dLLMs Can Do Faster-Than-AR Inference
declare-lab/tango
A family of diffusion models for text-to-audio generation.
Li-Jinsong/DAEDAL
[ICLR 2026] Official repository of "Beyond Fixed: Training-Free Variable-Length Denoising for...
SalesforceAIResearch/CoDA
Salesforce AI Research's open diffusion language model