epfl-dlab/llm-latent-language
Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
This tool helps researchers and practitioners understand how multilingual large language models process and translate text between different languages. By analyzing the 'latent language' within these models, you can gain insights into their internal workings. You provide text in one language, and the tool helps visualize how the model transforms it to understand or translate into another language. This is ideal for computational linguists, NLP researchers, and machine translation specialists.
No commits in the last 6 months.
Use this if you need to analyze the internal representations of multilingual large language models during translation or text completion tasks to better understand their behavior.
Not ideal if you are looking for a tool to simply perform translations or generate text, rather than to deeply investigate model internals.
Stars
80
Forks
18
Language
Jupyter Notebook
License
—
Category
Last pushed
Mar 11, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/epfl-dlab/llm-latent-language"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
NX-AI/xlstm
Official repository of the xLSTM.
sinanuozdemir/oreilly-hands-on-gpt-llm
Mastering the Art of Scalable and Efficient AI Model Deployment
DashyDashOrg/pandas-llm
Pandas-LLM
wxhcore/bumblecore
An LLM training framework built from the ground up, featuring a custom BumbleBee architecture...
MiniMax-AI/MiniMax-01
The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model &...