MUSC-TBIC/etude-engine

ETUDE (Evaluation Tool for Unstructured Data and Extractions) is a Python-based tool that provides consistent evaluation options across a range of annotation schemata and corpus formats

27
/ 100
Experimental

This tool helps researchers and clinical informaticists evaluate the accuracy of systems that automatically extract information from unstructured text, such as medical notes. You input a collection of documents with "gold standard" human annotations and another collection with machine-generated annotations. The tool then outputs detailed performance metrics like true positives, false positives, and false negatives, allowing you to assess how well your automated system performs at identifying specific types of information.

No commits in the last 6 months.

Use this if you need to rigorously compare the quality of information extracted by an automated system against human-annotated ground truth data in text documents.

Not ideal if you are looking for a tool to perform the actual annotation of text or if your primary goal is to train a new information extraction model rather than evaluate an existing one.

clinical-informatics natural-language-processing text-mining medical-research data-annotation-quality
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 5 / 25
Maturity 16 / 25
Community 6 / 25

How are scores calculated?

Stars

12

Forks

1

Language

Jupyter Notebook

License

Apache-2.0

Last pushed

Jul 22, 2022

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/nlp/MUSC-TBIC/etude-engine"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.