All Data Engineering Tools

1,297 tools ranked by quality score · Page 4 of 13

Showing 301–400 of 1,297

« Prev Next »

#	Tool	Score	Tier	Category	Stars	Language
301	wp-labs/warp-parse Focusing on building industry-leading ETL engines.	46	Emerging	data-pipeline-frameworks	163	Rust
302	turbot/steampipe-plugin-shopify Use SQL to instantly query Shopify products, orders and more. Open source...	46	Emerging	sql-query-adapters	7	Go
303	colliery-io/cloacina Embedded workflow orchestration library for Rust and Python. Build...	46	Emerging	data-pipeline-frameworks	6	Rust
304	turbot/steampipe-plugin-ipstack Use SQL to instantly query IP geolocation and more from ipstack. Open source...	46	Emerging	sql-query-adapters	8	Go
305	strake-data/strake The Data Layer for AI. A high-performance federated SQL engine that gives AI...	46	Emerging	rust-tensor-frameworks	2	Rust
306	turbot/steampipe-plugin-snowflake Use SQL to instantly query Snowflake resources. Open source CLI. No DB required.	45	Emerging	sql-query-adapters	5	Go
307	Ultrathink-Solutions/openclaw-logfire Pydantic Logfire observability plugin for OpenClaw — OTEL GenAI semantic...	45	Emerging	llm-evaluation-platforms	2	TypeScript
308	DevDizzle/gammarips-engine An end-to-end, serverless AI platform built on Google Cloud that...	45	Emerging	data-pipeline-frameworks	8	Python
309	turbot/steampipe-plugin-nomad Use SQL to instantly query Nomad ACLs, deployments, namespaces & more. Open...	45	Emerging	sql-query-adapters	3	Go
310	sipist/sipist-workspace This repository provides containerized applications and microservices for...	45	Emerging	—	5	—
311	turbot/steampipe-plugin-twilio Use SQL to instantly query Twilio resources across accounts. Open source...	45	Emerging	sql-query-adapters	4	Go
312	turbot/steampipe-plugin-auth0 Use SQL to instantly query Auth0 resources. Open source CLI. No DB required.	45	Emerging	sql-query-adapters	4	Go
313	turbot/steampipe-plugin-tailscale Use SQL to instantly query Tailscale resources. Open source CLI. No DB required.	45	Emerging	sql-query-adapters	5	Go
314	turbot/steampipe-plugin-equinix Use SQL to instantly query infrastructure resources (e.g. servers, networks)...	45	Emerging	sql-query-adapters	4	Go
315	weld-project/weld High-performance runtime for data analytics applications	45	Emerging	rust-tensor-frameworks	3,003	Rust
316	hiero-hackers/analytics Stay up to date with hiero organisation activity and contributor diversity	45	Emerging	data-pipeline-frameworks	10	Python
317	turbot/steampipe-plugin-hcloud Use SQL to instantly query servers, networks and more from Hetzner Cloud....	45	Emerging	sql-query-adapters	4	Go
318	turbot/steampipe-plugin-servicenow Use SQL to instantly query ServiceNow CMDB CI services, servers, incidents,...	45	Emerging	sql-query-adapters	4	Go
319	logjuicer/logjuicer LogJuicer extracts anomalies from log	45	Emerging	anomaly-detection-systems	26	Rust
320	icoretech/airbroke 🔥 Lightweight, Airbrake/Sentry-compatible, PostgreSQL-based Open Source Error Catcher	45	Emerging	mcp-client-configuration	214	TypeScript
321	turbot/steampipe-plugin-googledirectory Use SQL to instantly query users, groups, domains and more from Google...	45	Emerging	sql-query-adapters	12	Go
322	terrylica/exness-data-preprocess Professional forex tick data preprocessing with unified DuckDB storage,...	45	Emerging	data-pipeline-frameworks	3	Python
323	AndreaBozzo/Ceres Harvesting & Semantic search for open data portals	45	Emerging	data-pipeline-frameworks	12	Rust
324	bdist/bdist-workspace This repository provides containerized applications and microservices for...	45	Emerging	—	13	—
325	GregoryKogan/yt-framework Build scalable data pipelines on YTsaurus with automatic stage management,...	45	Emerging	data-pipeline-frameworks	19	Python
326	19-84/redd-archiver A PostgreSQL-backed archive generator that creates browsable HTML archives...	45	Emerging	social-media-trends	329	Python
327	skale-me/skale High performance distributed data processing engine	45	Emerging	model-inference-serving	397	JavaScript
328	turbot/steampipe-plugin-scaleway Use SQL to instantly query instances, networks, databases, and more from...	45	Emerging	sql-query-adapters	13	Go
329	turbot/steampipe-plugin-finance Use SQL to instantly query financial data including quotes (equities,...	45	Emerging	sql-query-adapters	13	Go
330	bastienboutonnet/sheetwork A handy package to load Google Sheets to your database right from the CLI...	45	Emerging	—	15	Python
331	samber/awesome-olap 🧊 A curated list of OLAP databases, data lake tools, columnar engines, and...	45	Emerging	—	106	—
332	AMPATH/etl-rest-server This project hosts scripts to generate flat tables used for reporting purposes.	45	Emerging	data-pipeline-frameworks	10	JavaScript
333	turbot/steampipe-plugin-steampipe Use SQL to instantly query plugin metadata from the Steampipe Hub. Open...	45	Emerging	sql-query-adapters	12	Go
334	CategoricalData/CQL Categorical Query Language IDE	45	Emerging	data-pipeline-frameworks	327	Java
335	pretzelai/pretzelai The modern replacement for Jupyter Notebooks	45	Emerging	data-analytics-platforms	2,186	TypeScript
336	turbot/steampipe-plugin-vanta Use SQL to instantly query Vanta resources. Open source CLI. No DB required.	45	Emerging	sql-query-adapters	3	Go
337	B1AAB/EBA An ML-first temporal graph of Bitcoin's on-chain fund flows.	45	Emerging	data-pipeline-frameworks	7	C#
338	MTSWebServices/syncmaster-ui Frontend for Syncmaster, no-code ETL tool. WIP	44	Emerging	data-pipeline-frameworks	4	TypeScript
339	turbot/steampipe-plugin-workos Use SQL to instantly query resources from WorkOS. Open source CLI. No DB required.	44	Emerging	sql-query-adapters	3	Go
340	ineelhere/forex-connect Streamlit Connection to Explore Foreign Currency Exchange rates 💰 in real-time	44	Emerging	data-pipeline-frameworks	3	Python
341	rocketlaunchr/dataframe-go DataFrames for Go: For statistics, machine-learning, and data...	44	Emerging	go-ml-bindings	1,283	Go
342	netxs2000/devops DevOps Data Application Platform...	44	Emerging	data-pipeline-frameworks	3	Python
343	rannd1nt/phaethon Dimensional Data Pipeline & Semantic Data Engineering Framework	44	Emerging	data-pipeline-frameworks	3	Python
344	turbot/steampipe-plugin-code Use SQL to instantly query secrets and more from source code. Open source...	44	Emerging	sql-query-adapters	18	Go
345	alexhraber/flowhawk Real-time eBPF-powered network security monitor with AI-driven threat...	44	Emerging	network-traffic-classification	74	Go
346	orchest/orchest Build data pipelines, the easy way 🛠️	44	Emerging	mlops-workflow-orchestration	4,139	TypeScript
347	moj-analytical-services/etl_manager A python package to create a database on the platform using our moj data...	44	Emerging	data-pipeline-frameworks	21	Python
348	ludovicschmetz-stack/datavow Open-source data contract enforcement — define, sync dbt, validate, block,...	44	Emerging	data-pipeline-frameworks	8	Python
349	DataKitchen/dataops-observability DataOps Observability is part of DataKitchen's Open Source Data...	44	Emerging	data-pipeline-frameworks	50	Python
350	turbot/steampipe-plugin-whois Use SQL to instantly query WHOIS. Open source CLI. No DB required.	44	Emerging	sql-query-adapters	18	Go
351	jitsucom/bulker Service for bulk-loading data to databases with automatic schema management...	44	Emerging	—	225	Go
352	realdatadriven/etlx ETL / ELT Framework powered by DuckDB, designed to seamlessly integrate and...	44	Emerging	data-pipeline-frameworks	38	Go
353	AltimateAI/altimate-code Opensource agentic data engineering harness for dbt, SQL, and cloud...	44	Emerging	langchain-application-tutorials	32	TypeScript
354	turbot/steampipe-plugin-mongodbatlas Use SQL to instantly query MongoDB Atlas resources. Open source CLI. No DB required.	44	Emerging	sql-query-adapters	4	Go
355	turbot/steampipe-plugin-ansible Use SQL to instantly query Ansible resources. Open source CLI. No DB required.	44	Emerging	sql-query-adapters	4	Go
356	yanghaiji/JsonCleanseETL JSONCleanseETL是一款专业的数据清洗和转换工具，旨在为用户提供高效处理JSON格式数据的解决方案。...	44	Emerging	data-pipeline-frameworks	4	Java
357	melvynator/ELK_twitter This is a data pipeline for Twitter (ETL) using the elastic stack...	44	Emerging	twitter-sentiment-pipelines	59	—
358	turbot/steampipe-plugin-zoom Use SQL to instantly query meetings, users & more from Zoom. Open source...	44	Emerging	sql-query-adapters	3	Go
359	turbot/steampipe-plugin-sentry Use SQL to instantly query Sentry organizations, projects, teams and more....	44	Emerging	sql-query-adapters	3	Go
360	turbot/steampipe-plugin-dockerhub Use SQL to instantly query Docker Hub repositories, tags, tokens and more....	44	Emerging	sql-query-adapters	4	Go
361	turbot/steampipe-plugin-linear Use SQL to instantly query Linear organizations, projects, teams, users &...	44	Emerging	sql-query-adapters	3	Go
362	nationalarchives/ds-caselaw-ingester Parse judgements from the Transformation Engine and load them into MarkLogic...	44	Emerging	data-pipeline-frameworks	4	Python
363	turbot/steampipe-plugin-hackernews Use SQL to instantly query stories, users and other items from Hacker News....	44	Emerging	sql-query-adapters	18	Go
364	ContextData/VectorETL Build super simple end-to-end data & ETL pipelines for your vector databases...	43	Emerging	vector-db-benchmarking	108	Python
365	Trojan3877/AWS-SageMaker-Snowflake-ML-Pipeline The AWS SageMaker + Snowflake ML Pipeline is a fully production-grade,...	43	Emerging	—	4	Python
366	aborruso/arigadicomando Documentazione in italiano su strumenti CLI per dati strutturati e AI: CSV,...	43	Emerging	csv-data-chat	5	HTML
367	yobix-ai/extractous Fast and efficient unstructured data extraction. Written in Rust with...	43	Emerging	file-content-extraction	1,696	Rust
368	bywwcnll/StreamPanel Stream Panel 是一个 Chrome DevTools 扩展，允许开发者实时监控和检查流式请求。它支持服务器发送事件 (SSE) 和基于...	43	Emerging	llm-json-streaming	158	JavaScript
369	fal-ai/dbt-fal do more with dbt. dbt-fal helps you run Python alongside dbt, so you can...	43	Emerging	scikit-learn-pipelines	857	Python
370	turbot/steampipe-plugin-chaos Chaos plugin for testing Steampipe with the craziest edge cases we can think...	43	Emerging	sql-query-adapters	6	Go
371	turbot/steampipe-plugin-ipinfo Use SQL to instantly query ipinfo.io for IP address information. Open source...	43	Emerging	sql-query-adapters	6	Go
372	trustedshops-public/schema2pyarrow Converts AsyncApi and JsonSchema to PyArrow schema	43	Emerging	data-pipeline-frameworks	12	Python
373	cloverdx/cloverdx-server-docker CloverDX Docker container for CloverDX Server deployment including examples.	43	Emerging	—	12	Shell
374	emeraldpay/dshackle-archive ETL for Bitcoin and Ethereum data	43	Emerging	—	6	Rust
375	datacompose/datacompose Data Cleaning for Pyspark	42	Emerging	data-pipeline-frameworks	12	Python
376	DataZooDE/flapi API Framework heavily relying on the power of DuckDB and DuckDB extensions....	42	Emerging	openapi-mcp-generation	66	C++
377	turbot/steampipe-plugin-tfe Use SQL to instantly query workspaces, runs and more from Terraform...	42	Emerging	sql-query-adapters	7	Go
378	turbot/steampipe-plugin-crtsh Use SQL to instantly query crt.sh for certificates, log entries and more....	42	Emerging	sql-query-adapters	9	Go
379	cnstlungu/postcard-company-datamart learning-by-doing data model built with dbt-core	42	Emerging	—	17	Python
380	turbot/steampipe-plugin-hibp Use SQL to instantly query breaches, passwords, pastes and more from HIBP....	42	Emerging	sql-query-adapters	7	Go
381	turbot/steampipe-plugin-trivy Use SQL to instantly query advisories, vulnerabilities, packages, findings...	42	Emerging	sql-query-adapters	9	Go
382	digitalghost-dev/poke-cli A hybrid CLI/TUI tool written in Go for viewing Pokémon data from the...	42	Emerging	sql-query-adapters	59	Go
383	DawnbrandBots/yaml-yugipedia An automatically-updated collection of wikitexts from Yugipedia. Part of YAML Yugi.	42	Emerging	data-pipeline-frameworks	7	Python
384	turbot/steampipe-plugin-databricks Use SQL to instantly query Databricks resources. Open source CLI. No DB required.	42	Emerging	sql-query-adapters	7	Go
385	Beyond-Finance/dataeng-de-technical-assessment Public repo of Beyond Finance's technical assessment for Data Engineering candidates	42	Emerging	data-pipeline-frameworks	5	Jupyter Notebook
386	ChrisDevRepo/vscode_data_lineage VS Code extension for visualizing SQL Server database object dependencies...	42	Emerging	data-pipeline-frameworks	9	TypeScript
387	wharfie/wharfie Wharfie is an experimental table-oriented data application framework built...	42	Emerging	ml-platform-builder	8	JavaScript
388	FrigadeHQ/trench Trench — Open-Source Analytics Infrastructure. A single production-ready...	42	Emerging	fullstack-ai-monorepos	1,618	TypeScript
389	probcomp/bayeslite BayesDB on SQLite. A Bayesian database table for querying the probable...	42	Emerging	bayesian-inference-frameworks	939	Python
390	zappzerapp/laravel-ingest A robust, configuration-driven ETL and data import framework for Laravel....	42	Emerging	—	88	PHP
391	MTSWebServices/syncmaster No-code ETL tool, based on onETL + PySpark	41	Emerging	data-pipeline-frameworks	11	Python
392	turbot/steampipe-plugin-linkedin Use SQL to instantly query LinkedIn for profiles, companies, connections &...	41	Emerging	sql-query-adapters	11	Go
393	ankiano/etl Extract transform load CLI tool for extracting small and middle data volume...	41	Emerging	data-pipeline-frameworks	11	Python
394	ccao-data/data-architecture Codebase for CCAO data infrastructure construction and management	41	Emerging	data-pipeline-frameworks	12	R
395	zero-one-group/geni A Clojure dataframe library that runs on Spark	41	Emerging	scala-ml-frameworks	293	Clojure
396	chalk-ai/chalk-go Go client for Chalk	41	Emerging	data-pipeline-frameworks	8	Go
397	turbot/steampipe-plugin-abuseipdb Use SQL to instantly query IP abuse scores and more from AbuseIPDB. Open...	41	Emerging	sql-query-adapters	8	Go
398	turbot/steampipe-plugin-grafana Use SQL to instantly query dashboards, data sources, users and more from...	41	Emerging	sql-query-adapters	10	Go
399	RustedBytes/audios-to-dataset Convert your audio files into DuckDB or Parquet files	41	Emerging	data-pipeline-frameworks	8	Rust
400	intel/hdk A low-level execution library for analytic data processing.	41	Emerging	distributed-training-frameworks	32	C++

« Prev 1 2 3 4 5 6 … 11 12 13 Next »