Safety Robustness Evaluation Transformer Models

There are 10 safety robustness evaluation models tracked. 1 score above 50 (established tier). The highest-rated is HowieHwong/TrustLLM at 55/100 with 619 stars.

Get all 10 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=transformers&subcategory=safety-robustness-evaluation&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

#	Model	Score	Tier	Stars	Language
1	HowieHwong/TrustLLM [ICML 2024] TrustLLM: Trustworthiness in Large Language Models	55	Established	619	Python
2	Intelligent-CAT-Lab/PLTranslationEmpirical Artifact repository for the paper "Lost in Translation: A Study of Bugs...	41	Emerging	51	Python
3	rishub-tamirisa/tamper-resistance [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for...	39	Emerging	67	Python
4	tsinghua-fib-lab/ANeurIPS2024_SPV-MIA [NeurIPS'24] "Membership Inference Attacks against Fine-tuned Large Language...	34	Emerging	200	Python
5	FudanDISC/ReForm-Eval An benchmark for evaluating the capabilities of large vision-language models (LVLMs)	31	Emerging	46	Python
6	codessian/epistemic-confidence-layer Model-agnostic trust protocol for calibrated, auditable AI	27	Experimental	1	Python
7	invarlock/invarlock Edit‑agnostic robustness reports for model weight edits (quantization, pruning, etc.)	22	Experimental	—	Python
8	yyy01/LLMRiskEval_RCC LLMs evaluation tool for robustness, consistency, and credibility	21	Experimental	9	Python
9	CSM-Research/SRV-ImpLLMinSLR This repository contains a replication package from a survey that...	21	Experimental	—	TeX
10	atlaspolat/llm_harness llm-harness, a repository designed to streamline testing of various...	10	Experimental	1	Jupyter Notebook