spitfireuptown/datalinkx
🔥🔥DatalinkX异构数据源之间的数据同步系统，支持海量数据的增量或全量同步，同时支持HTTP、Oracle、MySQL、ES等数据源之间的数据流转，支持中间transform算子如SQL算子、大模型算子，底层依赖Flink、Seatunnel引擎，提供流转任务管理、任务级联配置、任务日志采集等功能🔥🔥
Leverages Chunjun (FlinkX) as the core sync framework with pluggable driver architecture, allowing custom data source connectors via a standardized interface. Integrates xxl-job for distributed task scheduling, Redis Stream for message queuing, and Ollama for LLM-based transformations, while providing a Vue2/Ant Design UI for visual job DAG construction and data lineage tracking. Built on SpringBoot with JPA persistence, supports both batch and real-time streaming pipelines through Kafka.
353 stars.
Stars
353
Forks
37
Language
Java
License
—
Category
Last pushed
Mar 10, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/data-engineering/spitfireuptown/datalinkx"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.