mkuchnik/relm
ReLM is a Regular Expression engine for Language Models
This tool helps AI developers and researchers evaluate language models for specific patterns. By inputting a regular expression and a language model, you can identify strings like phone numbers or email addresses that the model is likely to generate. This is useful for understanding a model's memorization, biases, or ability to produce desired output formats.
107 stars. No commits in the last 6 months.
Use this if you need to systematically test a language model for the presence of specific patterns, such as identifying if it memorizes sensitive data or generates structured output.
Not ideal if you are a non-technical user without experience in Python, setting up development environments, or working with language models.
Stars
107
Forks
11
Language
Python
License
Apache-2.0
Category
Last pushed
Jun 02, 2023
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/mkuchnik/relm"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
jncraton/languagemodels
Explore large language models in 512MB of RAM
microsoft/unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
haizelabs/verdict
Inference-time scaling for LLMs-as-a-judge.
albertan017/LLM4Decompile
Reverse Engineering: Decompiling Binary Code with Large Language Models
bytedance/Sa2VA
Official Repo For Pixel-LLM Codebase