fdalvi/NeuroX
A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
This toolkit helps researchers and practitioners understand what specific parts of a deep natural language processing (NLP) model are 'thinking' or focusing on. By inputting a trained NLP model, it extracts and visualizes neuron activity, revealing which neurons are important for particular linguistic concepts or tasks. This allows NLP model developers and researchers to analyze how their models process language.
106 stars. No commits in the last 6 months. Available on PyPI.
Use this if you are a researcher or developer working with deep NLP models and need to interpret why a model makes certain predictions or how it represents linguistic information.
Not ideal if you are looking for a tool to build or train new NLP models, or if you don't work with the internal mechanics of deep neural networks.
Stars
106
Forks
27
Language
Python
License
BSD-3-Clause
Category
Last pushed
Oct 04, 2023
Commits (30d)
0
Dependencies
12
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/fdalvi/NeuroX"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
rmovva/HypotheSAEs
HypotheSAEs: hypothesizing interpretable relationships in text datasets using sparse...
interpretml/interpret-text
A library that incorporates state-of-the-art explainers for text-based machine learning models...
jalammar/ecco
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations...
alexdyysp/ESIM-pytorch
中国高校计算机大赛--大数据挑战赛
MultiplEYE-COST/wg1-experiment-implementation
In this repository we keep the code for the implementation of the eye-tracking experiment for...