Medical Image Diagnosis Transformers Transformer Models

Tools for diagnosing medical conditions from medical imaging data using transformer-based models (ViT, Swin, DINOv2, etc.). Includes skin lesions, tumors, retinopathy, and cancer detection. Does NOT include general medical text analysis, non-transformer medical imaging, or non-diagnostic medical applications.

There are 32 medical image diagnosis transformers models tracked. 1 score above 50 (established tier). The highest-rated is Omid-Nejati/MedViTV2 at 50/100 with 91 stars.

Get all 32 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=medical-image-diagnosis-transformers&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	Omid-Nejati/MedViTV2 MedViTV2: Medical Image Classification with KAN-Integrated Transformers and...	50	Established	91	Jupyter Notebook
2	fahadshamshad/awesome-transformers-in-medical-imaging A collection of resources on applications of Transformers in Medical Imaging.	34	Emerging	1,286	—
3	urmzd/md-classifier A deep learning system combining transformers and CNNs to classify diseases...	33	Emerging	2	Jupyter Notebook
4	FutureComputing4AI/HGConv HGConv: Holographic Global Convolutional Networks	32	Emerging	8	Python
5	jaketae/vit-breast-cancer Transfer learning pretrained vision transformers for breast histopathology	29	Experimental	14	Python
6	jmnolte/HCCNet Early prediction of liver cancer using longitudinal MRI	27	Experimental	5	Python
7	ChaitanyaK77/Optimal-Detection-of-Diabetic-Retinopathy-Severity-Using-Attention-Based-CNN-and-Vision-Transformers This repository contains the implementation of a hybrid model combining...	24	Experimental	4	Jupyter Notebook
8	abdur75648/MedicalGPT Medical Report Generation And VQA (Adapting XrayGPT to Any Modality)	24	Experimental	14	Python
9	samibahig/Prediction-Image-Protocole- Classification automatique des protocoles TDM (C+/C-/C- C+) via OCR +...	22	Experimental	—	Jupyter Notebook
10	pohl-michel/2D-MR-image-prediction Future frame prediction in 2D chest and liver cine-MRI using the PCA...	22	Experimental	3	Jupyter Notebook
11	AsianZeus/FaceMask-Classification-Models This repository holds the downstream task of Face Mask Classification...	22	Experimental	1	Jupyter Notebook
12	Type-Here/med-vix-ray A Knowledge-Guided Model for CXR classification	20	Experimental	1	Python
13	kambhampati-vijaya-sri-vyshnavi-devi89/medical-image-classifier Deep learning-based thoracic disease classification using transfer learning...	19	Experimental	—	HTML
14	ethicalabs-ai/SkinCancerViT A Multimodal Deep Learning Approach for Skin Cancer Classification using...	19	Experimental	4	Python
15	CristianoPatricio/viconex-med Code for the paper "ViConEx-Med: Visual Concept Explainability via...	19	Experimental	6	Python
16	marvelefe/vit-brain-tumor Vision Transformer (ViT) model for brain tumour detection and classification	18	Experimental	5	Python
17	mahsaama/ViT3D-BrainTumorSegmentation Segmentation of Brain Tumors using Vision Transformer	18	Experimental	23	Python
18	yuval6957/SIIM-Transformer Yuval and nosound models and write-up for Kaggle's competition "SIIM-ISIC...	17	Experimental	12	Jupyter Notebook
19	AI-14/pkatransnet [IVC 2025] [Official code] - Enhancing radiology report generation: A prior...	17	Experimental	2	Python
20	AI-14/micar-vl-moe [IJCNN 2025] [Official code] - MicarVLMoE: A modern gated cross-aligned...	17	Experimental	6	Python
21	agentdr1/LA_MIL Implementation of LA_MIL, Local Attention Graph-based Transformer for WSIs, PyTorch	15	Experimental	24	Python
22	azwad-tamir/Transfer_ViT Pretraining and finetuning different vision transformer models on the...	15	Experimental	6	Python
23	AnjaliiD/Breast-Cancer-Subtype-Classification Multimodal deep learning model for breast cancer subtype classification...	15	Experimental	—	Jupyter Notebook
24	saizk/GlioScan IDH Classification for Gliomas using CNN and Transformers.	13	Experimental	5	Jupyter Notebook
25	perceivelab/Transformer-IPMN Official PyTorch implementation for paper: "Neural Transformers for...	13	Experimental	5	Python
26	MohamadDabboussi/Multiview-Xray-Matching Self-Supervised Multiview Xray Matching	13	Experimental	2	Python
27	galassoandrea/skin-lesion-classification Fine-tuning of a Transformer-based model for Skin Lesion Classification in...	11	Experimental	—	Jupyter Notebook
28	jvelasquezpi/Tumor-classifier-dinov2 Brain tumor image classifier using DINOv2 and PyTorch (transfer learning).	11	Experimental	—	Jupyter Notebook
29	DeborahAdedigba/Melanoma-Detection-using-Transformer Implementation of a transformer-CNN ensemble framework for multi-class...	11	Experimental	—	Jupyter Notebook
30	nestivi/bachelor This project implements an advanced Cascade Convolutional Neural Network...	11	Experimental	—	Python
31	boomer3boom/ViT_Skin-Cancer-Diagnosis Repository for deep learning course on the use of Vision Transformer to make...	11	Experimental	—	Python
32	MohamedAmineDHIAB/guided_self-attention_for_vision_transformer Building a dockerized classifier for detecting dysplastic colon glands while...	11	Experimental	2	Jupyter Notebook