GitHub 数据工程专题榜
GITHUB专题榜这个专题下星数最高的开源项目，按总星数排序。专题是按项目自己标的 topic 归类的，一个项目可能同时属于几个专题；星数说明「这个领域里谁最有分量」，想找「最近在涨」的看趋势榜或增长榜。
本榜项目数
65 个项目
数据日期 2026-10-28 23:48:41
本榜项目数
65
数据工程 领域里星数最高的 65 个开源项目，按总星数排序
排名依据
与 GitHub 趋势页顺序一致
名次不按新增星数重排，星数与简介按 GitHub 原样列出
数据日期
2026-10-28 23:48:41
这批榜单数据是哪一天的
数据工程热门项目完整榜
65 个项目| 排名 | 项目 | 语言 | Stars | Fork | 7 日增长 | 创建 | 操作 |
|---|---|---|---|---|---|---|---|
| 1 |
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
analyticsapacheapache-superset
|
Python | 75,341 | 18,537 | — | 2015-07-22 | 查看详情 › |
| 2 |
GokuMohandas/Made-With-ML
Learn how to develop, deploy and iterate on production-grade ML applications.
data-engineeringdata-qualitydata-science
|
Jupyter Notebook | 49,835 | 7,810 | — | 2018-11-05 | 查看详情 › |
| 3 |
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
airflowapacheapache-airflow
|
Python | 47,297 | 18,197 | — | 2015-04-14 | 查看详情 › |
| 4 |
DataTalksClub/data-engineering-zoomcamp
Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼
coursedata-engineeringdbt
|
Jupyter Notebook | 46,495 | 9,010 | — | 2021-10-21 | 查看详情 › |
| 5 |
eugeneyan/applied-ml
📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.
applied-data-scienceapplied-machine-learningcomputer-vision
|
未标注 | 30,740 | 4,049 | — | 2020-07-05 | 查看详情 › |
| 6 |
kestra-io/kestra
Orchestrate everything, everywhere. The open-source control plane for workflows across data, infrastructure, business processes and AI agents. Declarative YAML, event-driven, any language, Git-versioned, scalable to millions of executions.
ai-agentsautomationcontrol-plane
|
Java | 30,054 | 3,487 | — | 2019-08-24 | 查看详情 › |
| 7 |
PrefectHQ/prefect
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
automationdatadata-engineering
|
Python | 24,092 | 2,619 | — | 2018-06-30 | 查看详情 › |
| 8 |
airbytehq/airbyte
Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.
bigquerychange-data-capturedata
|
Python | 22,281 | 5,420 | — | 2020-07-28 | 查看详情 › |
| 9 |
Avaiga/taipy
Turns Data and AI algorithms into production-ready web applications in no time.
automationdata-engineeringdata-integration
|
Python | 19,450 | 1,996 | — | 2022-02-18 | 查看详情 › |
| 10 |
argoproj/argo-workflows
Workflow Engine for Kubernetes
airflowargoargo-workflows
|
Go | 17,063 | 3,717 | — | 2017-08-22 | 查看详情 › |
| 11 |
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
analyticsdagsterdata-engineering
|
Python | 16,345 | 2,383 | — | 2018-05-01 | 查看详情 › |
| 12 |
andkret/Cookbook
The Data Engineering Cookbook
best-practicesbig-datacookbook
|
Python | 15,519 | 2,764 | — | 2019-03-11 | 查看详情 › |
| 13 |
semantica-agi/semantica
Graph-Native Infrastructure for Context and Accountable AI Systems
agent-memoryaiai-governance
|
Python | 14,289 | 1,678 | — | 2025-06-25 | 查看详情 › |
| 14 |
datastacktv/data-engineer-roadmap
Roadmap to becoming a data engineer in 2021
clouddata-engineer-roadmapdata-engineering
|
未标注 | 12,756 | 1,335 | — | 2020-09-02 | 查看详情 › |
| 15 |
fivetran/great_expectations
Always know what to expect from your data.
cleandatadata-engineeringdata-profilers
|
Python | 11,908 | 1,880 | — | 2017-09-11 | 查看详情 › |
| 16 |
cocoindex-io/cocoindex
Incremental engine for long horizon agents 🌟 Star if you like it!
agentic-data-frameworkaiai-agents
|
Rust | 11,770 | 920 | — | 2025-03-04 | 查看详情 › |
| 17 |
xonsh/xonsh
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
anthropicclaudeclaude-code
|
Python | 9,686 | 754 | — | 2015-01-22 | 查看详情 › |
| 18 |
risingwavelabs/risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
apache-icebergdata-engineeringdatabase
|
Rust | 9,394 | 857 | — | 2022-01-28 | 查看详情 › |
| 19 |
mage-ai/mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
artificial-intelligencedatadata-engineering
|
Python | 8,839 | 993 | — | 2022-05-17 | 查看详情 › |
| 20 |
redpanda-data/connect
Fancy stream processing made operationally mundane
amqpcqrsdata-engineering
|
Go | 8,791 | 979 | — | 2016-03-22 | 查看详情 › |
| 21 |
growthbook/growthbook
Open Source Feature Flags, Experimentation, and Product Analytics
ab-testingabtestabtesting
|
TypeScript | 8,545 | 888 | — | 2021-05-08 | 查看详情 › |
| 22 |
feast-dev/feast
The Open Source Feature Store for AI/ML
big-datadata-engineeringdata-quality
|
Python | 7,350 | 1,486 | — | 2018-12-10 | 查看详情 › |
| 23 |
Zipstack/unstract
LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows
ai-agentsdata-engineeringdocument-ai
|
Python | 7,342 | 732 | — | 2024-02-21 | 查看详情 › |
| 24 |
evidence-dev/evidence
Business intelligence as code: build fast, interactive data visualizations in SQL and markdown
analyticsbusiness-intelligencedashboard
|
TypeScript | 7,075 | 430 | — | 2021-05-27 | 查看详情 › |
| 25 |
cloudquery/cloudquery
Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.
airbyteattack-surface-managementaws
|
Go | 6,545 | 567 | — | 2020-11-18 | 查看详情 › |
| 26 |
dlt-hub/dlt
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
datadata-engineeringdata-lake
|
Python | 6,022 | 636 | — | 2022-01-26 | 查看详情 › |
| 27 |
Eventual-Inc/Daft
High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale
ai-engineeringai-pipelinearrow
|
Rust | 5,817 | 578 | — | 2022-04-26 | 查看详情 › |
| 28 |
treeverse/lakeFS
lakeFS - Data version control for your data lake | Git for data
apache-sparkapache-sparksqlaws-s3
|
Go | 5,574 | 486 | — | 2019-09-12 | 查看详情 › |
| 29 |
ruc-datalab/DeepAnalyze
DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！
agentagenticagentic-ai
|
Python | 4,757 | 750 | — | 2025-10-11 | 查看详情 › |
| 30 |
rudderlabs/rudder-server
Privacy and Security focused Segment-alternative, in Golang and React
bigquerycdpcustomer-data
|
Go | 4,508 | 81 | — | 2019-07-19 | 查看详情 › |
| 31 |
Moataz-Elmesmary/Data-Science-Roadmap
Data Science Roadmap from A to Z
big-datachatgptcheatsheet
|
未标注 | 4,407 | 629 | — | 2022-04-17 | 查看详情 › |
| 32 |
whoiskatrin/sql-translator
SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.
data-analysisdata-engineeringdataquery
|
TypeScript | 4,328 | 374 | — | 2023-03-12 | 查看详情 › |
| 33 |
aws/aws-sdk-pandas
pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
amazon-athenaamazon-sagemaker-notebookapache-arrow
|
Python | 4,124 | 751 | — | 2019-02-26 | 查看详情 › |
| 34 |
adilkhash/Data-Engineering-HowTo
A list of useful resources to learn Data Engineering from scratch
cloud-providersdata-engineeringdata-pipeline
|
未标注 | 4,037 | 573 | — | 2019-03-28 | 查看详情 › |
| 35 |
Netflix/maestro
Maestro: Netflix’s Workflow Orchestrator
agentic-workflowanalyticsautomation
|
Java | 3,849 | 312 | — | 2024-04-17 | 查看详情 › |
| 36 |
dathere/qsv
Blazing-fast, Neuro-symbolic Data-Wrangling toolkit
aickancsv
|
Rust | 3,818 | 115 | — | 2020-12-11 | 查看详情 › |
| 37 |
lakehq/sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
apache-icebergapache-sparkarrow
|
Rust | 3,475 | 236 | — | 2023-12-21 | 查看详情 › |
| 38 |
superstreamlabs/memphis
Memphis.dev is a highly scalable and effortless data streaming platform
datadata-engineeringdata-pipeline
|
Go | 3,443 | 221 | — | 2022-02-01 | 查看详情 › |
| 39 |
GokuMohandas/mlops-course
Learn how to design, develop, deploy and iterate on production-grade ML applications.
data-engineeringdata-qualitydata-science
|
Jupyter Notebook | 3,410 | 608 | — | 2020-11-12 | 查看详情 › |
| 40 |
gunnarmorling/awesome-opensource-data-engineering
An Awesome List of Open-Source Data Engineering Projects
awesome-listdata-engineering
|
未标注 | 3,308 | 567 | — | 2020-02-12 | 查看详情 › |
| 41 |
apache/devlake
Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.
dashboard-friendlydatadata-analysis
|
Go | 3,179 | 831 | — | 2021-07-08 | 查看详情 › |
| 42 |
decodingai-magazine/second-brain-ai-assistant-course
Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.
agentsai-systemsdata-engineering
|
Jupyter Notebook | 3,129 | 528 | — | 2024-12-30 | 查看详情 › |
| 43 |
meltano/meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
connectorsdatadata-engineering
|
Python | 2,670 | 273 | — | 2021-06-22 | 查看详情 › |
| 44 |
Zleap-AI/SAG
A new SOTA for RAG — an original retrieval architecture and an open-source knowledge base for humans and agents.
agentaidata-engineering
|
Python | 2,641 | 185 | — | 2025-11-07 | 查看详情 › |
| 45 |
apache/hamilton
Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
dagdata-analysisdata-engineering
|
Jupyter Notebook | 2,617 | 226 | — | 2023-02-24 | 查看详情 › |
| 46 |
sodadata/soda-core
Data Contracts engine for the modern data stack. https://www.soda.io
data-contractsdata-engineeringdata-governance
|
Python | 2,457 | 297 | — | 2020-12-15 | 查看详情 › |
| 47 |
metarank/metarank
A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine
automldata-engineeringdata-science
|
Scala | 2,456 | 111 | — | 2020-08-20 | 查看详情 › |
| 48 |
running-elephant/datart
Datart is a next generation Data Visualization Open Platform
analyticsbibusiness-analytics
|
TypeScript | 2,311 | 656 | — | 2021-10-15 | 查看详情 › |
| 49 |
bytewax/bytewax
Python Stream Processing
data-engineeringdata-processingdata-science
|
Python | 2,066 | 114 | — | 2022-02-05 | 查看详情 › |
| 50 |
data-engineering-community/data-engineering-wiki
The best place to learn data engineering. Built and maintained by the data engineering community.
datadata-engineerdata-engineering
|
CSS | 2,053 | 246 | — | 2021-05-04 | 查看详情 › |
| 51 |
san089/Udacity-Data-Engineering-Projects
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
airflowairflow-operatorsaws
|
Python | 2,016 | 599 | — | 2020-01-21 | 查看详情 › |
| 52 |
getnao/nao
👾 nao is an open source analytics agent. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone
agentic-analyticsanalyticsanalytics-engineering
|
TypeScript | 1,968 | 300 | — | 2025-12-31 | 查看详情 › |
| 53 |
feathr-ai/feathr
Feathr – A scalable, unified data and AI engineering platform for enterprise
apache-sparkartificial-intelligenceazure
|
Scala | 1,946 | 247 | — | 2022-02-18 | 查看详情 › |
| 54 |
OBenner/data-engineering-interview-questions
More than 2000+ Data engineer interview questions.
airflowavroaws
|
Python | 1,806 | 575 | — | 2021-08-08 | 查看详情 › |
| 55 |
Hiflylabs/awesome-dbt
A curated list of awesome dbt resources
analytics-engineeringawesomeawesome-list
|
未标注 | 1,744 | 188 | — | 2021-10-09 | 查看详情 › |
| 56 |
benthecoder/yt-channels-DS-AI-ML-CS
A comprehensive list of 180+ YouTube Channels for Data Science, Data Engineering, Machine Learning, Deep learning, Computer Science, programming, software engineering, etc.
aiartificial-intelligenceawesome
|
未标注 | 1,708 | 159 | — | 2021-06-14 | 查看详情 › |
| 57 |
mlrun/mlrun
MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.
data-engineeringdata-scienceexperiment-tracking
|
Python | 1,704 | 315 | — | 2019-09-02 | 查看详情 › |
| 58 |
Multiwoven/multiwoven
🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.
bigquerycdpcustomer-data-platform
|
Ruby | 1,683 | 99 | — | 2023-10-20 | 查看详情 › |
| 59 |
DataWithBaraa/sql-ultimate-course
The most comprehensive SQL guide from a real-world expert! Learn everything from basics to advanced queries, optimizations, and real-world SQL
datadata-analyticsdata-engineering
|
TSQL | 1,637 | 702 | — | 2025-03-18 | 查看详情 › |
| 60 |
Kaelio/ktx
ktx is an executable context layer for data and analytics agents 🐙 Allow Claude Code, Codex, or other AI agents to query analytical databases accurately and with full context of your company
agentagent-skillsagents
|
TypeScript | 1,624 | 109 | — | 2026-05-11 | 查看详情 › |
| 61 |
kantord/just-dashboard
:bar_chart: :clipboard: Dashboards using YAML or JSON files
big-databusiness-intelligencechart
|
TypeScript | 1,586 | 58 | — | 2018-01-18 | 查看详情 › |
| 62 |
quixio/quix-streams
Python Streaming DataFrames for Kafka
data-engineeringdata-intensive-applicationsdata-science
|
Python | 1,581 | 117 | — | 2022-11-18 | 查看详情 › |
| 63 |
san089/goodreads_etl_pipeline
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
airflowairflow-dagapache-airflow
|
Python | 1,549 | 247 | — | 2020-02-14 | 查看详情 › |
| 64 |
slothflowlabs/duckle
Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.
cdcconnectorsdata-engineering
|
Rust | 1,533 | 121 | — | 2026-05-21 | 查看详情 › |
| 65 |
pyper-dev/pyper
Concurrent Python made simple
asyncioconcurrencydata
|
Python | 1,514 | 33 | — | 2024-05-22 | 查看详情 › |
读榜要点
怎么看这张榜排名依据GitHub 官方趋势算法不是按新增星数重排，照官方顺序
星数与简介与 GitHub 页面一致名次、星数、简介与语言都按 GitHub 原样显示
数据日期2026-10-28 23:48:41这批榜单数据是哪一天的，页头已标注
「GitHub 热门」的排名依据是什么？
名次与 GitHub 官方 Trending 页面的顺序一致，排序由它自己的趋势算法决定——不是单纯按新增星数排（实测会出现第 9 名的新增星数少于第 10 名、月榜第 1 名少于第 2 名）。本页照它的顺序展示，也不把不同周期的数据合成一个综合分。
为什么日榜只有十几条，不是 25 条？
趋势榜的条数由 GitHub 自己决定，实测日榜 10–15 条、周榜十几条、月榜 20 条上下。条数完全按 GitHub 给的来，所以会随 GitHub 那边的渲染结果变化。
新秀榜和趋势榜有什么区别？
趋势榜看「近期新增星数」，老项目也可能上榜；新秀榜走官方搜索接口，只取近 7 天 / 30 天内新建、按总星数排序的仓库，回答的是「这个月冒出来的项目里谁最猛」。两张榜的指标不同，不混算。
数据来自 GitHub 官方趋势榜与官方接口；名次与星数与 GitHub 页面一致，数据日期 2026-10-28 23:48:41。
