ronniross/attention-heatmap-visualizer

A set of scripts to generate full attention-head heatmaps for transformer-based LLMs

41
/ 100
Emerging

This tool helps AI researchers understand how large language models (LLMs) process text. You provide an input text prompt, and it generates detailed heatmaps showing which parts of the text the model 'pays attention' to across all its internal layers and heads. This allows AI researchers to visualize the model's focus, identifying patterns that inform debugging, bias detection, and architectural improvements.

Use this if you are an AI researcher wanting to visualize and analyze the internal workings of transformer-based language models to understand their attention mechanisms.

Not ideal if you are looking for a plug-and-play solution for production LLM deployments or do not need deep insights into model attention patterns.

AI research LLM interpretability model debugging prompt engineering neural network analysis
No Package No Dependents
Maintenance 10 / 25
Adoption 5 / 25
Maturity 15 / 25
Community 11 / 25

How are scores calculated?

Stars

13

Forks

2

Language

Jupyter Notebook

License

MIT

Last pushed

Feb 26, 2026

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/ronniross/attention-heatmap-visualizer"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.