ASF Member
ASF Member since 2021, with continued participation in Apache community and ALC Beijing activities.
Apache ecosystem
Open infrastructure at production scale.
My open-source work centers on data infrastructure that has to survive real production scale.
Long-Running Threads
My Apache work has grown from HBase and Hadoop-era storage infrastructure into Flink state backends, lakehouse formats, remote shuffle, execution acceleration, and AI-era data systems. The common thread is building open infrastructure that is technically deep, community-governed, and proven under demanding production workloads.
Apache Roles
PMC Member
Apache Flink, HBase, Paimon, Celeborn, Gluten, and Fluss; HBase committer and PMC work dates back to 2016.
Champion
Apache Paimon, Apache Celeborn, and Apache Fluss during incubation.
Mentor
Apache Amoro and Apache GraphAr.
Apache Timeline
- Apache HBase: Committer and PMC Member, focused on production-scale storage infrastructure.
- Apache Flink: Committer and PMC Member, focused on state backend work and community development.
- Apache Software Foundation: ASF Member, participating in ALC Beijing activities and Apache conference organization.
- Apache Celeborn: guided incubation as Champion and mentor; PMC Member after graduation to TLP.
- Apache Paimon: guided incubation as Champion and mentor; PMC Member after graduation to TLP.
- Apache Amoro: incubating mentor for lakehouse management.
- Apache GraphAr: incubating Champion and mentor for graph data storage format.
- Apache Fluss: incubating Champion and mentor for real-time streaming storage.
Open Source Ecosystem
| Layer | Apache Project | Alibaba Product | Status |
|---|---|---|---|
| Streaming Storage | Fluss | Streaming Storage for Apache Fluss* | TLP |
| Lake Format | Paimon | Milvus x DLF Vector Lake | TLP |
| Lakehouse mgmt | Amoro | DLF* | Incubating |
| Shuffle Service | Celeborn | EMR Fusion for Apache Spark | TLP |
| Batch Execution | Gluten | Fusion Kernel | TLP |
| OLAP | Doris* | EMR StarRocks / Stella Kernel | Related ecosystem |
| Streaming | Flink | Realtime Compute for Apache Flink* | TLP |
| NoSQL | HBase | EMR on ECS DataServing | TLP |
| Vector Database | — | Milvus | — |
Items marked with * are adjacent ecosystem references rather than projects I am directly involved in or products I am responsible for.