Medical Image Diagnosis Transformers Transformer Models

Tools for diagnosing medical conditions from medical imaging data using transformer-based models (ViT, Swin, DINOv2, etc.). Includes skin lesions, tumors, retinopathy, and cancer detection. Does NOT include general medical text analysis, non-transformer medical imaging, or non-diagnostic medical applications.

There are 32 medical image diagnosis transformers models tracked. 1 score above 50 (established tier). The highest-rated is Omid-Nejati/MedViTV2 at 54/100 with 91 stars.

Get all 32 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=medical-image-diagnosis-transformers&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	Omid-Nejati/MedViTV2 MedViTV2: Medical Image Classification with KAN-Integrated Transformers and...	54	Established	91	Jupyter Notebook
2	fahadshamshad/awesome-transformers-in-medical-imaging A collection of resources on applications of Transformers in Medical Imaging.	41	Emerging	1,286	—
3	urmzd/md-classifier A deep learning system combining transformers and CNNs to classify diseases...	40	Emerging	2	Jupyter Notebook
4	jaketae/vit-breast-cancer Transfer learning pretrained vision transformers for breast histopathology	36	Emerging	14	Python
5	jmnolte/HCCNet Early prediction of liver cancer using longitudinal MRI	34	Emerging	5	Python
6	ChaitanyaK77/Optimal-Detection-of-Diabetic-Retinopathy-Severity-Using-Attention-Based-CNN-and-Vision-Transformers This repository contains the implementation of a hybrid model combining...	31	Emerging	4	Jupyter Notebook
7	abdur75648/MedicalGPT Medical Report Generation And VQA (Adapting XrayGPT to Any Modality)	31	Emerging	14	Python
8	pohl-michel/2D-MR-image-prediction Future frame prediction in 2D chest and liver cine-MRI using the PCA...	29	Experimental	3	Jupyter Notebook
9	Type-Here/med-vix-ray A Knowledge-Guided Model for CXR classification	27	Experimental	1	Python
10	mahsaama/ViT3D-BrainTumorSegmentation Segmentation of Brain Tumors using Vision Transformer	25	Experimental	23	Python
11	marvelefe/vit-brain-tumor Vision Transformer (ViT) model for brain tumour detection and classification	25	Experimental	5	Python
12	yuval6957/SIIM-Transformer Yuval and nosound models and write-up for Kaggle's competition "SIIM-ISIC...	24	Experimental	12	Jupyter Notebook
13	AI-14/pkatransnet [IVC 2025] [Official code] - Enhancing radiology report generation: A prior...	24	Experimental	2	Python
14	AI-14/micar-vl-moe [IJCNN 2025] [Official code] - MicarVLMoE: A modern gated cross-aligned...	23	Experimental	6	Python
15	agentdr1/LA_MIL Implementation of LA_MIL, Local Attention Graph-based Transformer for WSIs, PyTorch	22	Experimental	24	Python
16	azwad-tamir/Transfer_ViT Pretraining and finetuning different vision transformer models on the...	22	Experimental	6	Python
17	kambhampati-vijaya-sri-vyshnavi-devi89/medical-image-classifier Deep learning-based thoracic disease classification using transfer learning...	21	Experimental	—	HTML
18	CristianoPatricio/viconex-med Code for the paper "ViConEx-Med: Visual Concept Explainability via...	21	Experimental	6	Python
19	samibahig/Prediction-Image-Protocole- Classification automatique des protocoles TDM (C+/C-/C- C+) via OCR +...	21	Experimental	—	Jupyter Notebook
20	perceivelab/Transformer-IPMN Official PyTorch implementation for paper: "Neural Transformers for...	20	Experimental	5	Python
21	saizk/GlioScan IDH Classification for Gliomas using CNN and Transformers.	20	Experimental	5	Jupyter Notebook
22	MohamedAmineDHIAB/guided_self-attention_for_vision_transformer Building a dockerized classifier for detecting dysplastic colon glands while...	18	Experimental	2	Jupyter Notebook
23	AnjaliiD/Breast-Cancer-Subtype-Classification Multimodal deep learning model for breast cancer subtype classification...	17	Experimental	—	Jupyter Notebook
24	boomer3boom/ViT_Skin-Cancer-Diagnosis Repository for deep learning course on the use of Vision Transformer to make...	13	Experimental	—	Python
25	nestivi/bachelor This project implements an advanced Cascade Convolutional Neural Network...	13	Experimental	—	Python
26	DeborahAdedigba/Melanoma-Detection-using-Transformer Implementation of a transformer-CNN ensemble framework for multi-class...	13	Experimental	—	Jupyter Notebook
27	galassoandrea/skin-lesion-classification Fine-tuning of a Transformer-based model for Skin Lesion Classification in...	13	Experimental	—	Jupyter Notebook
28	sAI-2025/Chest-X-Ray-Pneumonia-Detector-xAI-web-app Developed a pneumonia detection system using MobileNet-V3 with transfer...	11	Experimental	—	Jupyter Notebook
29	D-Kumar19/RCC-Cancer-Diagnostics Revolutionizing Kidney Cancer Detection: Harnessing AI to Predict Renal Cell...	11	Experimental	—	—
30	3bdulah/multimodal-diagnosis Multi-modal AI system for diagnosing respiratory diseases using Vision...	11	Experimental	2	Python
31	ai-art-dev99/master-project Fine-tuned Large Language Models to generate detailed radiology reports...	10	Experimental	1	Jupyter Notebook
32	bmi-labmedinfo/radiology-qa-transformer Supplementary material for "Reshaping free-text radiology notes into...	10	Experimental	2	Python