Multimodal Conditioned Generation Diffusion Models

Tools that generate images from non-text inputs (voice, speech, captions, parameters, specifications) or combine multiple input modalities to drive image generation. Does NOT include pure text-to-image, video generation, or image editing tools.

There are 183 multimodal conditioned generation models tracked. 3 score above 50 (established tier). The highest-rated is neggles/animatediff-cli at 64/100 with 269 stars. 1 of the top 10 are actively maintained.

Get all 183 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=diffusion&subcategory=multimodal-conditioned-generation&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Model Score Tier
1 neggles/animatediff-cli

a CLI utility/library for AnimateDiff stable diffusion generation

64
Established
2 sakalond/StableGen

Transform your 3D texturing workflow with the power of generative AI,...

57
Established
3 victordibia/peacasso

UI interface for experimenting with multimodal (text, image) models (stable...

53
Established
4 ai-forever/Kandinsky-2

Kandinsky 2 — multilingual text2image latent diffusion model

47
Emerging
5 carefree0910/carefree-drawboard

🎨 Infinite Drawboard in Python

47
Emerging
6 carefree0910/carefree-creator

AI magics meet Infinite draw board.

46
Emerging
7 LUMI2049/deepfake-detection-streamlit

🔍 Detect deepfakes with advanced AI using EfficientNetB7 and an attention...

44
Emerging
8 bil9148/LyricDiffusion

LyricDiffusion is a versatile application that transforms song lyrics into...

44
Emerging
9 mwydmuch/ZoomVideoComposer

Pyhton script for generating zoom in/out videos from a set of images

43
Emerging
10 vicgalle/stable-diffusion-aesthetic-gradients

Personalization for Stable Diffusion via Aesthetic Gradients 🎨

42
Emerging
11 gordicaleksa/stable_diffusion_playground

Playing around with stable diffusion. Generated images are reproducible...

42
Emerging
12 Teriks/dgenerate

dgenerate is a scriptable command line tool (and library) for generating...

42
Emerging
13 minimaxir/stable-diffusion-negative-prompt

Jupyter Notebooks for experimenting with negative prompting with Stable...

42
Emerging
14 cloneofsimo/paint-with-words-sd

Implementation of Paint-with-words with Stable Diffusion : method from...

42
Emerging
15 movenb3at/snap-pocket

SnapPocket — Capture. Transform. Save.

41
Emerging
16 SyntheticAutonomicMind/ALICE

Artificial Latent Image Composition Engine

41
Emerging
17 NeuralRealm/StableFusion

Transform text into images and images into new ones using AI. Our...

41
Emerging
18 samedii/perceptor

Modular image generation library

41
Emerging
19 mix1009/stable-diffusion-video-maker

Video generation tool for Stable Diffusion.

40
Emerging
20 open-mmlab/Live2Diff

Live2Diff: A Pipeline that processes Live video streams by a uni-directional...

40
Emerging
21 lunarring/latentblending

Create butter-smooth transitions between prompts, powered by stable diffusion

40
Emerging
22 yownas/shift-attention

In stable diffusion, generate a sequence of images shifting attention in the prompt.

40
Emerging
23 prompthero/openjourney

A fine-tuned model based on Stable Diffusion to create images in the style...

39
Emerging
24 AvishakeAdhikary/Text-To-Image-Generator

Python GUI application that generates images based on user prompts using the...

39
Emerging
25 JSJeong-me/Generate_AI_for_Image

생성형AI는 어떻게 이미지를 만들까요?

39
Emerging
26 Kittensx/Simple_KES

Simple KES blends single or multiple schedulers and provides a noise...

38
Emerging
27 aagdev/mlimgsynth

Image synthesis using machine learning

38
Emerging
28 Nota-NetsPresso/BK-SDM

A Compressed Stable Diffusion for Efficient Text-to-Image Generation [ECCV'24]

38
Emerging
29 Leonm99/Stable-Diffusion-Video2Video

Small script for AUTOMATIC1111/stable-diffusion-webui to run video through img2img.

38
Emerging
30 RandomGamingDev/MCSkinsGen

A repository for a Minecraft skin generator based off of Stable Diffusion...

37
Emerging
31 Alyxsissy/Sissy-Research-Projects

Alyxsissy x Sissy Research Institute collaborative projects.

37
Emerging
32 dimitreOliveira/stable-diffusion-textual-inversion-app

Custom Textual-Inversion for Stable-Diffusion models with Keras.

37
Emerging
33 Purushothaman-natarajan/Synth-SONAR

A controllable SONAR image generation with text-to-image diffusion models,...

37
Emerging
34 rootLocalGhost/ArtTic-LAB

An open-source AI image generation suite. Features a beautiful UI along with...

37
Emerging
35 sbaier1/pyttv

A tool for generating (music-)videos using generative models

37
Emerging
36 ototadana/imgflw

A demo application for image editing using LLM

36
Emerging
37 miguelCalado/prompt-to-prompt-tensorflow

TensorFlow implementation of the "Prompt-to-Prompt Image Editing with Cross...

35
Emerging
38 torresflo/Picture-Machine

A little Python application to generate pictures from a text prompt. Based...

35
Emerging
39 sofiadparamo/DiffusionCraft

Diffusioncraft python img2img pipeline integration using diffusers with...

35
Emerging
40 albertotrunk/depth2video

stable diffusion V2 depth2video - animation - coherence

34
Emerging
41 Zeqiang-Lai/Anything2Image

Generate image from anything with ImageBind and Stable Diffusion

34
Emerging
42 sshh12/planet-diffusion

Fine-tuning stable diffusion to generate planet/moon textures.

34
Emerging
43 paolorechia/openimagegenius

Stable Diffusion

33
Emerging
44 Anashel-RPG/echoai

Echo AI - Passsive AI Image Generation

33
Emerging
45 numz/StableDiffusionPygameInpaintIsometricMap

This technical demo is an open-source project that allows users to customize...

33
Emerging
46 Logeswaran123/Stable-Diffusion-Playground

An application that generates images or videos using Stable Diffusion models.

33
Emerging
47 habedi/mosaic-art-maker

Making mosaic art using a Stable Diffusion model

32
Emerging
48 MonishSoundarRaj/image-generator-streamlit

IMAGINATE HUB: Text-to-Image Streamlit App Select from six cutting-edge...

32
Emerging
49 schmidtdominik/stablediffusion-interpolation-tools

Tools for smoothly interpolating between prompts for Stable Diffusion models

32
Emerging
50 DN6/giffusion

Create GIFs and Videos using Stable Diffusion

32
Emerging
51 Extraltodeus/noise_latent_perlinpinpin

This allows to create latent spaces filled with perlin-based noise that can...

32
Emerging
52 h2oai/wave-image-styling-playground

A interactive playground to style and edit images, generate art and have fun.

32
Emerging
53 RubenGres/Seg2Sat

Using StableDiffusion and ControlNet to generate synthetic aerial images

31
Emerging
54 uninterruptedpowersupply/Stable-Diffusion-Mobile-UI

For generating images using Stable Diffusion 1.5 with as less as 2gb Vram

31
Emerging
55 sayakpaul/caption-upsampling

This repository implements the idea of "caption upsampling" from DALL-E 3...

31
Emerging
56 lasthero3819/DeepFakeAI-GUI-2026

DeepFake Soft AI is a powerful and user-friendly desktop software designed...

29
Experimental
57 chenruiRae/GalaxySD

Fine-tuning sd-1.5 for galaxy image generation by given morphological prompts.

29
Experimental
58 sumitsahoo/img-to-video-svd

img-to-video-svd

29
Experimental
59 inferless/animagine-xl-3.0

High-quality image generation from text prompts, with improved hand anatomy...

29
Experimental
60 pica-labs/picachain

⚡️ Build quick LLM pipelines for AI applications

29
Experimental
61 sae-llm-coconut/coconut-ai

Python library that ease the installation process of Stable Diffusion, and...

28
Experimental
62 akx/lcm_test

Quick and dirty Streamlit UI for Latent Consistency Models

28
Experimental
63 sshh12/terrain-diffusion-app

An infinite collaborative inpainter which allows users to dynamic generate...

28
Experimental
64 karand120497/glaze

Glaze is langchain for images. If you're building a text-to-image app with...

28
Experimental
65 geocine/sd-easy-mode

Easy Mode Stable Diffusion process allows you to generate images based on...

28
Experimental
66 lcysyzxdxc/AGIQA-3k-Database

[IEEE TCSVT2023] A Fine-grained Subjective Perception & Alignment Database...

28
Experimental
67 inferless/stable-diffusion-xl-turbo

A distilled and cost-effective variant of SDXL that delivers high-quality...

28
Experimental
68 inferless/animagine-xl-3.1

Generates high-quality anime images with improved hand anatomy and new...

28
Experimental
69 dlimeng/awesome-ai-generated

独立开源创作者,积累AI生成相关,随着学习提交资料(教程,原理,新闻,使用)

28
Experimental
70 thinh-vu/ai_artist

Image generator using Stable Diffusion AI model

28
Experimental
71 shirayu/purepale

🎨 A simple web interface of image generations

28
Experimental
72 abgache/Genmoji

Reproduction of Apple Intelligence Genmoji for apple style emoji generation...

28
Experimental
73 Haoke98/FrameDiffusion

A frame2frame, video2video Video Editor based on the stable-diffusion

28
Experimental
74 nihaljn/multimodal-prompting

Enabling the use of multiple modalities while prompting Stable Diffusion

28
Experimental
75 boostcampaitech5/level3_cv_finalproject-cv-16

"앗, 『이 세계』로부터의 손님이 내게 찾아왔다!?"는 사진에서 선택 인물만 추출해서 원하는 화풍으로 애니메이션화 하는 프로젝트입니다.

27
Experimental
76 360CVGroup/Bridge_Diffusion_Model

Chinese-native image generation while compatible with SD eco-system,...

27
Experimental
77 inferless/playground-v2.5

Generate highly aesthetic 1024x1024 images with superior quality, flexible...

27
Experimental
78 yangheng95/SuperResolutionAnimeDiffusion

Super Resolution Anime Diffusion, waifu2x

27
Experimental
79 LyFl0w/TextureMaker

TextureMaker is an innovative Minecraft tool that utilizes AI (stable...

27
Experimental
80 DonMischo/Billions-of-Wildcards-for-Stable-Diffusion

Billions of Wildcards for Stable Diffusion and maybe other generative AI

26
Experimental
81 inferless/sdxl-lightning

A lightning-fast text-to-image generation model that generate high-quality...

26
Experimental
82 Cominclip/Long_Video_Generation

A pipeline to generate long videos according to text prompt

25
Experimental
83 andreafailla/Diff2GIF-Animated-Diffusion-Models

Create your own animated network visualization by exploiting a diffusion model!

25
Experimental
84 mmehmetisik/ai-text-to-image-generator

AI-powered image generation tool using Hugging Face API and Stable...

25
Experimental
85 YUKII2K3/Image-generator

A powerful AI image generator powered by Stable Diffusion, Gradio, and...

25
Experimental
86 akleine/sdcpp-on-android

Create images from text using sd.cpp on Android

24
Experimental
87 s-du/FocusPocusAI

Realtime diffusion (LCM-LoRA) from screen capture or webcam, for...

24
Experimental
88 sidhantls/minimal-casteer

Minimal and extensible implementation of CASteer

23
Experimental
89 yeonsumia/momentum-textual-inversion

[NCSOFT 23' winter internship] Enhance personalizing stable diffusion for...

23
Experimental
90 shadowlamer/diffusezx

DiffuseZX is a demo project showcasing the capabilities of pretrained Stable...

22
Experimental
91 ylp1455/Flask-A-Graph

"Flask-A-Graph' is a Flask app that uses Stable Diffusion Pipeline to...

22
Experimental
92 jerenchen/simple-diffusion-pose-gen

A simple Python/Godot example of an AI prompt-based 3D human pose generator

22
Experimental
93 hyeonsangjeon/AIsketcher

Text-to-image generation using Huggingface stable diffusion ControlNet...

22
Experimental
94 FxThomas08/stable-diffusion

Generate high-quality images from text prompts using an efficient latent...

22
Experimental
95 Stefan356/Stable-Diffusion-X-Dreamhold

FHOOE Semester Project, AI based visualization of interactive fiction game

22
Experimental
96 PRITHIVSAKTHIUR/Canopus-Realism

Realistic Image Generation, Realistic trigger works properly, better for...

22
Experimental
97 tigrisdata-community/tigris-text-to-image

Text-To-Image Generator with Hugging Face model, Fly GPUs and Tigris as storage

21
Experimental
98 PsorTheDoctor/generative-ai

Generative AI techniques including Stable Diffusion based image generation.

21
Experimental
99 FareedKhan-dev/digiart-Powerful-AI-Image-generator

DigiArt is a powerful AI image generator built on top of Stable Diffusion....

21
Experimental
100 Robin-WZQ/Text-Guide-Chinese-Landscape-Painting-Generation

Fine Tuning Stable Diffusion on Chinese Landscape Painting Generation(基于扩散模型的中国山水画生成)

21
Experimental
101 YouvenZ/Imagegen_ink

Inkscape extension to create image with generative model within inkscape.

21
Experimental
102 aredden/denoisemoji

command-line tool that allows you to create a pseudo diffusion denoised...

21
Experimental
103 5anjana/StyleSwap

Localized fashion image editing using text-driven latent diffusion and...

21
Experimental
104 ytl0623/Stable-Diffusion-LINE-app-Vercel

Implements Stable-Diffusion text-to-image function on LINE app with Vercel platform

21
Experimental
105 tejank10/null-text-inversion

Unofficial Implementation of Null-text Inversion (https://arxiv.org/abs/2211.09794)

21
Experimental
106 LazyShuyaa/Tensor.art-Scaper

A simple scraper for tensor.art.. it will help u to generate images

21
Experimental
107 jzbor/sdiff-gtk

GTK+ front end for AI image generation using StableDiffusion

20
Experimental
108 bigsk1/sd-ascii-image

Stable Diffusion Script to turn images into Ascii Art

20
Experimental
109 soheil-mp/GameAssetLab

AI-powered game asset generation studio - transform prompts into...

20
Experimental
110 nub340/DreamsOfAJaguar

Dreams of a Jaguar is a side scrolling video game made with pygame and...

20
Experimental
111 aimagelab/Alfie

Democratising RGBA Image Generation With No $$$ (AI4VA@ECCV24)

20
Experimental
112 IlIllII/diffusion-sketch

Draw with Stable Diffusion

19
Experimental
113 palaashatri/jforge

Text-to-image powered by Stable Diffusion. Image upscaling with ESRGAN....

19
Experimental
114 samuelvinay91/image-generation

Cloud-native Image Generation Service with diffusion models, VAE, and...

19
Experimental
115 hrvojet/bela-dataset-gen

Hungarian (Belote) card dataset generator

19
Experimental
116 dilums/ml-bytedance-sdxl-lightning

experiments with ByteDance's SDXL-Lightning model for generating images from...

19
Experimental
117 jan1na/Un-Stable-Diffusion

Test the text- and image-encoder CLIP against adversarial text attacks using...

19
Experimental
118 Friday202/ComicGenerator

Comic generator that works using Stable Diffusion 1.5

19
Experimental
119 ihsavru/sd-text-effects

Inspired by Adobe Firefly's text effects, Stable Diffusion Text Effects...

19
Experimental
120 palakv07/Text_to_video

A text prompt to video generation

19
Experimental
121 mtkaya/stable-diffusion-text2img

Stable Diffusion Text-to-Image & Image-to-Image Generator with Gradio

19
Experimental
122 shinn-bit/image-maker

AI画像生成アプリ(Colab版)- Stable Diffusion + LoRA + ControlNet...

19
Experimental
123 brucethemoose/StableDiffusion-Video2Video

Experiments using modified Diffusers img2img and Vapoursynth for temporally...

18
Experimental
124 PoyBoi/AynAssg

Generate Images, Upscale Images, Fix Faces and Replace background using...

18
Experimental
125 dieBaerigenBerchtesgadener/PlOtter

Ein selbstmalender Bilderrahmen

18
Experimental
126 adithya-s-k/diffusechain

🎨Streamlining the creation of consistent diffusion images with AI-powered...

18
Experimental
127 RolandoAndrade/stable-diffusion-instagram-publisher

Small script used to generate images from a prompt, define the caption and...

18
Experimental
128 ixtal23/neuroimage

This is an image generation tool that implements the generating of images by...

18
Experimental
129 MohamedAliRashad/Imaginate

Imaginate is a gradio app for generating images from initial images and prompts

18
Experimental
130 AstraBert/awesome-tiny-sd

Tiny stable diffusion chatbot based on segmind/small-sd to generate images...

18
Experimental
131 TheCleverIdiott/stable-diffusion-3

gradio based starter transcript for generating images from text

18
Experimental
132 Fardeen37/BRANDGENAI

BrandGenAI is a text-based AI Iamge/logo generator that uses Stable...

18
Experimental
133 DebarghaSanyal/Music_And_Video_Generator

This project uses Stable Diffusion to generate AI-driven images & musics...

17
Experimental
134 gopalchand/rotopy

Combine PNG or JPEG files in a folder into a movie file. Useful for...

17
Experimental
135 AtharvaTaras/Stable-Diffusion-Library

A library of images generated using Stable Diffusion

17
Experimental
136 ncdisrup-ai/Captioning4Generation

Caption image and with that base generate new images (with stable diffusion...

17
Experimental
137 player29879/Kandinsky

Kandinsky 2 — multilingual text2image latent diffusion model

17
Experimental
138 aahmed-se/generate_image

Stable Diffusion Image Generator

17
Experimental
139 causeri3/selfusion-pi

Art installation for Fusion 2025 - automated selfies, diffuser...

15
Experimental
140 DolicaAkelloEgwel/studies-show

Not tech-art, but TeX-art ???

15
Experimental
141 nhatm6586/ScreenDiffusion

🌌 Transform your screen into living art with real-time AI rendering,...

14
Experimental
142 thefcraft/civitai-stable-diffusion-337k

Civitai Stable Diffusion 337k Dataset; dataset of ai generated image

13
Experimental
143 mohbenaicha/pbr-texture-generator

A preliminary pipeline and UI I built to generate PBR textures based on an...

13
Experimental
144 ranjanashwin/digital-twin-generator

Advanced digital twin generator using IPAdapter FaceID with batch image...

13
Experimental
145 SaltyGod/LLMs_stable-diffusion-v2

基于给定的关键词,利用LLMs随机生成场景文字,在随机添加画风跟主角的基础上,利用stable-diffusions批量生成ai图片

12
Experimental
146 shekharkalshetti/sticker-generator

Create unique stickers based on textual prompts.

12
Experimental
147 jeremy-collins/sd-video-gen

Video generation using Stable Diffusion.

12
Experimental
148 erkara/Rise-of-Transfer-Learning

you will find brief code implementations of some of the latest developments...

12
Experimental
149 graceduansu/IdentifyingPromptedArtists

Identifying Prompted Artist Names from Generated Images: a large-scale...

12
Experimental
150 jonathanswinnen/continuous-style-control

Image morphing between prompts using Stable Diffusion

11
Experimental
151 mohammadzainabbas/Deep-Learning-CS

🎨 Monet like Painting 👩🏻‍🎨 with stable diffusion model 👨🏻‍💻

11
Experimental
152 PRITHIVSAKTHIUR/Stable-Wallpapers

Demo space for generating, Desktop / Mobile Wallpapers. 16:9 / 9:16 #Dream...

11
Experimental
153 kianelbo/magic-rugs

A dataset of oriental rugs and a diffusion image generator

11
Experimental
154 Sher-Kal/hf-space-poetry-art

Portfolio demo: Hugging Face Space with text + image generation (poetry & painting)

11
Experimental
155 R4F405/python-stable-diffusion-generator

An image generator implemented in Python using the powerful Stable Diffusion...

11
Experimental
156 Pixel4bit/pxd-image-generator

Streamlit-based application that allows you to generate AI images from text...

11
Experimental
157 zzbuzzard/sd-variant-anim

Create animations where each frame is an AI-generated variation of the one before.

11
Experimental
158 M26I/image-generation-system

A fast, lightweight command-line tool for text-to-image generation using...

11
Experimental
159 ty70/stable-diffusion-image-generator

A simple and flexible Python script for generating images using Stable...

11
Experimental
160 zeittresor/pygame-mizzzout

Simple skillgame written in python using pygame with sound and AI generated...

11
Experimental
161 HariPasapuleti/Stable-diffusion-image-generation

This project utilizes Stable Diffusion for image generation, allowing users...

11
Experimental
162 creative-graphic-design/huggingface-datasets_Magazine

Magazine dataset from Content-aware Generative Modeling of Graphic Design...

11
Experimental
163 Ba5bit/echoscape

Interactive generative city simulation using webcam motion, audio input,...

11
Experimental
164 arpitamangal/text-to-image-generation

Generate Images from text prompt using Stable Diffusion Model

11
Experimental
165 dizys/nyu-cv-final-project

NYU CV Final Project: build a AI-generated v.s. real-world-captured image classifier

11
Experimental
166 Dont4rootMe/image-generation-project

This project is the result of a laboratory study exploring the primary...

11
Experimental
167 Opikadash/Blog.AI

LLM using API tokens

11
Experimental
168 JoelVO/generating_avatar_with_Stable_Diffusion

This is a very simple notebook with which I generated an avatar of myself...

11
Experimental
169 kennymckormick/DrawBench-Glance

DrawBench at a Glance

11
Experimental
170 Razorwings18/Stable-Totem

UNMAINTAINED! Stable Totem is a user-friendly desktop application for...

11
Experimental
171 maximkr/image-dedup

Finds the images in the directory that are most similar to the others and...

10
Experimental
172 inferless/stable-diffusion-3-5-large-turbo

A fast, optimized diffusion model that generates high-quality images from...

10
Experimental
173 dhanushreddy291/lcm-sdxl-cog

Generate high-quality images faster with Latent Consistency Models (LCM), a...

10
Experimental
174 bchachar/image-generation

A Streamlit app for generating AI images using Stable Diffusion with prompt...

10
Experimental
175 GeorgeNance/gpt-caption

Auto caption images for training in Stable Diffusion

10
Experimental
176 ErniW/Stable-diffusion-flow-of-latent-space-using-Perlin-noise-algorithm

Applying Perlin Noise algorithm for procedural spatial noise flow and...

10
Experimental
177 alireza13742010/text-to-image-generation-comparison

This repository belongs to comparing the results of generated image using...

10
Experimental
178 svjack/Diffusion-Story-Teller

A Story Teller supported by Huggingface Inference Api on Stable-Diffusion and LLM

10
Experimental
179 shaadclt/Text-to-Image-Generation

This project demonstrates how to generate images using diffusion models,...

10
Experimental
180 sebi75/sd-video-replicate

Stable Video Diffusion running on Replicate inference endpoint.

10
Experimental
181 brianjz/sd-api-random

Quick and dirty Python script to have Stable Diffusion automatically make a...

10
Experimental
182 atfortes/Generative-Powers-of-Ten

An implementation of "Generative Powers of Ten" using DeepFloyd IF

10
Experimental
183 GagDrag/ThreadShift

ThreadShift leverages advanced segmentation, image editing, and generation...

10
Experimental