All Data Engineering Tools

Production-style financial data engineering pipeline that standardizes NSE...

Code for the USDA Branded Food Dataset pipeline and the USDA Food Assistant....

Java library to build modern applications with high-def itemized financial...

Semantic cost-linting and performance warnings extension for Databricks in VS Code

Transform data with queries

Implementation of an ETL process for real-time sentiment analysis of tweets...

BirdiDQ leverages the power of the Python Great Expectations open-source...

Catla for Hadoop and Spark (Catla-HS): An open-source system to support...

Enterprise-grade distributed data processing pipeline with Apache Spark...

A Golang tool for obtaining data on Golang binaries in csv format

personal finance mint.com-like site

🛍️ Analyze retail data with our platform, scraping insights from major...

This is core library for financial data access components in Apache Nifi

Data science and Spark applied to 7 hypotheses regarding the DJIA stock...

The scope of this task is to build a working pilot of a portal that collects...

PardoX: The Hyper-Fast Data Engine

Global Power Plant Database Analysis is a Streamlit-based interactive web...

Pipeline that extracts data from the Spotify API to build a more detailed...

⚽ Football database. Ideal for machine learning, betting and analytics. 📂...

A sophisticated cross-browser extension for bulk Google Classroom downloads,...

Converts English query to Informal/Format SQL SELECT.

CLI based interface for Optical Fiber Fault Detection, Diagnosis, and...

DBDataSource (dbds) is primarily a lightweight PostgreSQL-backed dataSource...

KMU CS Hot Topics in Big Data

A flexible, high-performance tagging system for Rails applications with...

Rakshan/Finance Tracker

Open-source Data Backend written in Java and based on PostgreSQL & GraphQL.

Demo Django (Django Rest Framework) API uploads .csv/.xlsx for bulk data,...

Full-stack ESG analytics dashboard for S&P 500 companies with FastAPI,...

Event-driven microservices backend for Humane, a behavior-rewarding social...

A Google Calendar-style plugin to improve your DAG management with a visual schedule

elevata is an Architecture Runtime for modern data platforms —...

A hash you can do algebra on — composable verification for ordered data over...

Enterprise-grade multimodal redaction runtime that detects and removes...

A high-performance service designed to eliminate duplicate and...

A simple, self-contained CLI for performance-focused data streaming & anonymization.

Scrapping products from well known e-com. sites like Amazon, Flipkart and...

:fish: A streaming ETL for fish

Projeto da API do primeiro semestre de 2026

🧶 Framework for IO mapping and validation across heterogeneous data.

ThinkDB is an easy-to-use SQL client that makes working with your databases...

LLM, DuckDB, Excel, CSV , Data Analysis

This project aims to predict smartphone prices using a combination of batch...

Cash flow is one of the most critical aspects of the supply chain, and it...

Macro-aware, explainable equity analytics system using Bronze–Silver–Gold...

Deterministic key and join discovery for structured datasets

pipefn is a Go library for building lazy, functional, and composable...

Pipeline for processing, classifying, and ingesting large-scale social data

Java

PHP ETL engine for building extract–transform–load pipelines with pluggable...

📊 Monitor your macOS network in real-time with Peek—get instant insights on...

OpenAutoLoader: A lightweight, open-source alternative to Databricks Auto...

Streamlit-based Nepali cricket visualization dashboard that utilizes python...

CRose（China...

Data engineering demo project for Danish Parliament (Folketing) open data —...

A movie journal coupled with open IMDb data, and a Flask web-app for easy...

Big-data pipeline detecting wash trading, pump & dump, and spoofing in trade...

Spotfire is a crowd-sourcing tool that can support real-time detection and...

"Dataherd-Raika is a library designed to simulate large-scale user behavior...

The Integrated Data Intelligence Suite is a data-collection and data-mining...

evdschat is an open-source Python package designed to enhance the evdspy...

Data privacy tool, for fast & thorough anonymization/pseudonymization, easy...

CRM DupKiller - Hack Night @ Cloudflare 2025 ft. Fiberplane, Claude, Elevenlabs

Data Mesh concepts in Python - Data Products with schema validation, CRUD,...

Kotlin DSL for expressive, code-first data pipelines, inspired by jazz.

Prototype decision-support dashboard built on the SCSI-SLM EV design insight...

AI-powered sales analytics dashboard built with Streamlit that generates...

Ask for data in plain English; get validated, parameterized SQL with guardrails.

MarketIQ is a full-stack Streamlit + SQL + Prophet dashboard for real-time...

This project focuses on analyzing the Lok Sabha Election data of India. The...

Detect anomaly in call detail records.

🚀 Build a containerized data engineering workflow for NYC Yellow Taxi Trip...

asyncIO, Github Actions, GCP, dbt, Terraform, Docker

A comprehensive guide and codebase for building interactive storytelling...

Local-first data warehouse for AI agents. Write Snowflake-compatible SQL,...

A high-performance Dart library for FP-Growth algorithm and association rule...

Open-source methodology, SQL, and sample data for a Cannabis Price Index....

Code Snippets, Designs, and other things about building a Data Analytics...

SehatChain, an AI and Blockchain powered tool for researchers and healthcare...

Quickly sync your customers' CRM data to various destinations

📊 Analyze Brazilian e-commerce data with this complete Business Intelligence...

Backing store for developmentseed/skynet-scrub

Full-Funnel AI Marketing Analytics. A modern data stack powered by dbt...

BlackRoad Forge — hailo vision — BlackRoad Forge. Enhanced developer tools...

The list of podcasts I listen to

Rails ETL for Zendesk — collects and syncs Zendesk ticket data into PostgreSQL

👾 blockchain infrastructure projects and resources (e.g., ethereum event...

ShadowCheck SIGINT Forensics Platform - Real-time wireless network analysis

iGaming Platform Core — Wallet Service, Bonus Engine & ML-powered Fraud...

🚀 Accelerate your browsing with Directly, a Chromium extension for quick...

Data transformation toolkit — 43+ transforms, 5 domain packs. 10 MCP tools...

This project involves web scraping, data preprocessing, database storage and...

A RESTful Gilhari microservice demonstrating ORM for JSON objects with an...

A repository for information related to the Data Analytics team's Advanced...

A repository for information related to the Data Analytics team's Data...

DisasterRecord- Disaster Response and Relief Coordination pipeline.

A data lineage tool detects table dependencies from rendered SQL statements.

Fast, memory-efficient dataset deduplication for ML workloads

Klasyfikacja ryzyka kredytowego klientów banku. Projekt obejmuje inżynierię...

ASENA-ANALYSIS: A hybrid Intrusion Detection System (IDS) that combines...