dataengineering

This is a repo with links to everything you'd ever want to learn about data engineering

Scalable and efficient data transformation framework - backwards compatible with dbt.

Compare tables within or across databases

AI based entity resolution, identity resolution, master data management and deduplication at scale for humans and agents

The open source knowledgehouse for your company. Marmot knows what your data means, governs who may use it and runs every query your people and agents make, checked and recorded. Catalog, lineage, governed SQL and an MCP server in one Go binary.

A free to use dbt package for creating and loading Data Vault 2.0 compliant Data Warehouses (powered by dbt, an open source data engineering tool, registered trademark of dbt Labs)

The agent harness for building analytics into your app on top of ClickHouse, Redpanda and other high-performance analytical infrastructure

This repository provides various demos/examples of using Snowpark for Python.

An open source development framework to help you build data workflows and modern data architecture on AWS.

Roadmap for Data Engineering

Data Engineering Pilipinas is a community for data engineers, data analysts, data scientists, developers, AI / ML engineers, and users of closed and open source data tools and methods / techniques in the Philippines. Data Engineering Pilipinas is a PyData group.

end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck

Code and data for the Modern Polars book

Companion repository that goes along with Snowflake's "Introduction to Modern Data Engineering with Snowflake" course on Coursera

Все, о чем меня когда-либо спрашивали на собеседованиях, и другие полезные знания в кратком формате

PDFStract - Extract, Chunking and Embedding Layer in Your RAG Pipeline - Available as CLI - WEBUI - API

A Data Platform built for AWS, powered by Kubernetes.