Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.

Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.

Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.

从数据仓库到用户画像，从数据建设到数据应用

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)

An open-source columnar data format designed for fast & realtime analytic with big data.

Free and open source schema versioning and database migration made natively with .NET/6. NEW THIS MAY 2022! v1.3.15 released!

Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end.

Roadmap for Data Engineering

Code for dbt tutorial

Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)

Hydra九头龙，保姆级为您打造属于您的造跨平台TB-PB级别专属搜索引擎、专属上帝之眼。Hydra-面向云计算、多任务调度、服务通信、数仓、微服务化、抽象化分布式操作系统——以实现小型爬虫搜索引擎为例。

All of my individual learning materials, documents, and notes from the process of getting the Coursera IBM Data Engineer Professional Certificate specialization are stored in this repository.

implementing an end-to-end tweets ETL/Analysis pipeline.

End to end data engineering project

AlphaSQL provides Integrated Type and Schema Check and Parallelization for SQL file set mainly for BigQuery

A library for data warehouse and data integration pattern and architecture documentation.

A library to accelerate ML and ETL pipeline by connecting all data sources

Data warehouse for CouchDB