bootphon/pygamma-agreement
Gamma Agreement in Python
When you have multiple people, or the same person at different times, marking up sequences of information (like transcribing audio or categorizing text), this tool helps you objectively quantify how consistent those annotations are. It takes in those annotated sequences and gives you a single Gamma (γ) score, which indicates the level of agreement. This is for researchers and data quality managers who rely on human-generated annotations for their projects.
Used by 1 other package. No commits in the last 6 months. Available on PyPI.
Use this if you need to calculate a robust agreement score between several annotators or annotation passes for sequential data.
Not ideal if your data is not sequential or if you only need a simple percentage agreement and not a nuanced, aligned agreement score.
Stars
45
Forks
8
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Mar 04, 2024
Commits (30d)
0
Dependencies
12
Reverse dependents
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/bootphon/pygamma-agreement"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
natasha/ipymarkup
NER, syntax markup visualizations
neomatrix369/nlp_profiler
A simple NLP library allows profiling datasets with one or more text columns. When given a...
thepushkarp/nalcos
Search Git commits in natural language
lyeoni/nlp-tutorial
A list of NLP(Natural Language Processing) tutorials
NirantK/NLP_Quickbook
NLP in Python with Deep Learning