mitmedialab/sherlock-project

This repository provides data and scripts to use Sherlock, a DL-based model for semantic data type detection: https://sherlock.media.mit.edu.

49
/ 100
Emerging

This project helps data professionals automatically identify the type of information within columns of a dataset, such as 'name,' 'address,' or 'product ID'. You input a table, and it outputs labels for each column, helping ensure data quality and prepare datasets for analysis or integration. Data scientists, data engineers, and business analysts who work with various datasets can use this.

183 stars. No commits in the last 6 months.

Use this if you need to quickly and accurately categorize the semantic types of columns in your tables to improve data validation, processing, or integration.

Not ideal if you require a simple, manual labeling process for only a few columns, or if you're not comfortable working with Python-based deep learning tools.

data-quality data-preparation data-integration data-labeling table-profiling
Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 23 / 25

How are scores calculated?

Stars

183

Forks

74

Language

Jupyter Notebook

License

MIT

Last pushed

Jul 30, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/ml-frameworks/mitmedialab/sherlock-project"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.