Siwoo4985/Micro-Diffusion
The essence of text diffusion in ~150 lines of pure Python. Inspired by Karpathy's MicroGPT.
This project provides a minimal, pure Python implementation to understand how text diffusion models work for generating text. It takes a list of short text entries, like names, and demonstrates how a model learns to 'denoise' them from a fully masked state. It's designed for machine learning practitioners and researchers who want to grasp the core mechanics of discrete text diffusion without complex frameworks.
Use this if you are a machine learning practitioner, student, or researcher looking for a simple, clear, and runnable example to understand the internals of text diffusion for discrete data.
Not ideal if you need a production-ready system for high-quality text generation, a library for integrating into a larger application, or a tool for large-scale training with massive datasets.
Stars
27
Forks
1
Language
Python
License
MIT
Category
Last pushed
Mar 12, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/diffusion/Siwoo4985/Micro-Diffusion"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
quantgirluk/aleatory
📦 Python library for Stochastic Processes Simulation and Visualisation
blei-lab/treeffuser
Treeffuser is an easy-to-use package for probabilistic prediction and probabilistic regression...
TuftsBCB/RegDiffusion
Diffusion model for gene regulatory network inference.
yuanchenyang/smalldiffusion
Simple and readable code for training and sampling from diffusion models
chairc/Integrated-Design-Diffusion-Model
IDDM (Industrial, landscape, animate, latent diffusion), support LDM, DDPM, DDIM, PLMS, webui...