abcsys/libem
Compound AI toolchain for fast and accurate entity matching, powered by LLMs.
Libem helps data professionals accurately identify if two different descriptions refer to the same real-world item or person, which is crucial for data integration and cleaning. You provide two pieces of descriptive text, and it determines if they represent the same entity, giving you a 'yes' or 'no' match. This tool is for data scientists, data engineers, or anyone managing large datasets that need to be deduplicated or linked.
No commits in the last 6 months.
Use this if you need to reliably match records across different datasets where entities might be described inconsistently, like product catalogs or customer lists.
Not ideal if your matching needs are simple keyword comparisons or exact string matches, as this tool is designed for more complex, nuanced entity resolution.
Stars
26
Forks
4
Language
Python
License
Apache-2.0
Category
Last pushed
Mar 25, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/transformers/abcsys/libem"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
shibing624/MedicalGPT
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline....
lyogavin/airllm
AirLLM 70B inference with single 4GB GPU
GradientHQ/parallax
Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere
CrazyBoyM/llama3-Chinese-chat
Llama3、Llama3.1 中文后训练版仓库 - 微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档。
CLUEbenchmark/CLUE
中文语言理解测评基准 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained...