villagecomputing/superpipe

Superpipe - optimized LLM pipelines for structured data

21
/ 100
Experimental

Building and refining workflows that use large language models (LLMs) to process text and extract specific information can be challenging. This project helps you define clear steps for your LLM, feed it raw text data like job histories, and reliably get back structured data such as job departments. It's designed for data scientists, analysts, or product managers who need to extract consistent, categorized information from unstructured text at scale.

109 stars. No commits in the last 6 months.

Use this if you need to reliably classify, extract, or transform text data into structured formats using LLMs, and want to systematically test and improve your results for accuracy, speed, and cost.

Not ideal if you are looking for a pre-built, ready-to-use LLM application and don't intend to customize or evaluate the underlying data transformation steps.

data-extraction text-classification data-transformation LLM-workflow prompt-engineering
No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 9 / 25
Maturity 8 / 25
Community 4 / 25

How are scores calculated?

Stars

109

Forks

2

Language

Python

License

Last pushed

Jun 18, 2024

Commits (30d)

0

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/villagecomputing/superpipe"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.