All Data Engineering Tools

Official Neo4j JDBC Driver

100+ SQL Scripts - PostgreSQL, MySQL, Oracle, Google BigQuery, MariaDB, AWS...

go-etl is a toolset for data extraction, transformation and loading.

DataOps Data Quality TestGen is part of DataKitchen's Open Source Data...

R interface for Apache Spark

Monopoly is a Python library & CLI that converts bank statement PDFs to CSV.

A lightweight, developer-focused database management tool. Supports MySQL,...

Use data to tell stories.An intelligent Visualization Narrative Development...

Home of the Open Data Contract Standard (ODCS).

Java dataframe and visualization library

DataSAIL is a tool to split datasets while reducing information leakage.

Lightweight REST for Java

A Clojure high performance data processing system

A Python package to load complex XML files into a relational database

Zero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No...

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

LinkedPipes ETL is an RDF based, lightweight ETL tool

Configurable Extract, Transform, and Load

Data Engineering Zoomcamp is a free 9-week course on building...

Python Streaming DataFrames for Kafka

Community-driven, simple, yet powerful framework for fast, cost-effective...

Use SQL to instantly query repositories, users, gists and more from GitHub....

Core package of the Metafacture tool suite for metadata processing.

One framework to develop, deploy and operate data workflows with Python and SQL.

1 Line of code data quality profiling & exploratory data analysis for Pandas...

HeavyDB (formerly MapD/OmniSciDB)

Consolidate, enrich and republish the data gathered by warn-scraper

FeatHub - A stream-batch unified feature store for real-time machine learning

Privacy and Security focused Segment-alternative, in Golang and React

Community supported integrations for the Dagster platform.

Instant no code DATA API platform for relational databases. Connect any...

The Boring query platform - Connect and query anything

Use SQL to instantly query GCP resources across regions, projects and...

Sparkling Water provides H2O functionality inside Spark cluster

Drop-in replacement for Apache Spark UI

Frontend & BFF (Backend for frontend) for Olake. This includes the UI code...

🎲 Business Logic Code in a flow!

Use SQL to instantly query Kubernetes API resources. Open source CLI. No DB required.

TAK Compatible, browser based Common Operation Picture & Situational Awareness tool

Common pipeline-editor components used in different clients (e.g. Elyra...

Use SQL to instantly query Azure resources across regions and subscriptions....

🥪🦘 An open source sandbox project exploring dbt workflows via a fictional...

Declarative text based tool for data analysts and engineers to extract,...

A deterministic orchestrator for composable micro-workflows with reusable modules

Building data processing pipelines for documents processing with NLP using...

Data Pipeline Automation Framework to build MCP servers, data APIs, and data...

🔥🔥DatalinkX异构数据源之间的数据同步系统，支持海量数据的增量或全量同步，同时支持HTTP、Oracle、MySQL、ES等数据源之间的数据流转，...

High performance Rust stream processing engine seamlessly integrates AI...

Protect your SIP Servers from bad actors at https://sentrypeer.org

Steampipe Plugin SDK is a simple abstraction layer to write a Steampipe...

DocWire SDK: Award-winning modern data processing in C++20. SourceForge...

High Performance Storage and Streaming Solution for Data Acquisition Systems

The Emerging Solutions Toolbox is a collection of solutions created by...

SimTradeData is a utility library supporting SimTradeDesk, SimTradeLab and...

In-memory Java DataFrame library

The Open-Source Enterprise Data Platform in a single Portal

The World's Most Comprehensive, Authoritative, and Structured Open Source...

A simple and easy to use Data Validation library for Python.

💬 Open Source App Framework to build streaming apps with real-time data - 💎...

A package supporting the conversion from Synthea CSV to OMOP CDM

Open Source Business Intelligence with Malloy Semantic Layer :tada:

A high-performance rules engine for IFTTT-style automation in Rust with...

Data Engineering Pilipinas is a community for data engineers, data analysts,...

Transforms and pipelines with tabular data in Julia

This application is built in four stages using infrastructure as code with...

Tiozin, your friendly ETL framework

(Spatial) data harmonisation with hale»studio (formerly HUMBOLDT Alignment Editor)

The data-validation toolkit for enhanced dbt (data build tool) PR review

Installer for DataKitchen's Open Source Data Observability Products. Data...

Representing BIM Data as Parquet

Lakevision is a tool which provides insights into your Apache Iceberg based...

Flowfile is a visual ETL tool and Python library combining drag-and-drop...

Use @xonsh wherever you go through the SSH without installation on the host.

AI Native Data Platform: explore, clean, transform and govern your data...

Library and CLI for profiling tabular data

Byzer (former MLSQL): A low-code open-source programming language for data...

RKI Metadata Exchange | Software development toolkit for the MEx project...

Preswald is a WASM packager for Python-based interactive data apps: bundle...

glue-utils makes AWS Glue jobs less repetitive, more type-safe, and easier...

FalkorDB Typescript Client

Uncovering Hidden Connections in Unstructured Financial Data using Amazon...

Home of the Open Data Product Standard (ODPS).

end-to-end data engineering project to get insights from PyPi using python,...

A modern, blazing-fast SQL IDE for the cloud era. Query PostgreSQL, MySQL,...

Dataform Tools - VS Code extension to run and visualise Dataform data...

A community AWS SDK for Perl Programmers

OpenSnowcat Collector, an open source fork of Snowplow (Apache 2.0 License)

embiggden-disk live-resizes a filesystem after first live-resizing any...

Cookbook for Pipelex, the declarative language for composable Al workflows....

Use SQL to instantly query resources, data sources and more from Terraform...

High-performance streaming SQL query engine designed for real-time data...

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF,...

SeaTunnel Web is a visual platform for building, managing, and monitoring...

An encrypted data analytics platform

Complete structured archive of every CIA World Factbook edition from...

What's in your data? Extract schema, statistics and entities from datasets

A Python library that acts as a client to download, pre-process and...

RTEC is an Event Calculus implementation optimised for stream reasoning

🔥 Lightweight, Airbrake/Sentry-compatible, PostgreSQL-based Open Source Error Catcher

A simple Spark-powered ETL framework that just works 🍺