Skip to main content

Roadmap

Hudi community strives to deliver major releases every 3-4 months, while offering minor releases every other month! This page captures the forward-looking roadmap of ongoing & upcoming projects and when they are expected to land, broken down by areas on our stack.

H2 2022 Releases

Next major release : 0.13.0 (Mid Q4 2022)

ReleaseTimeline
0.12.1Early Q4 2022
0.13.0Mid Q4 2022
0.13.1TBD

Transactional Database Layer

FeatureTarget ReleaseTracking
Metaserver for all metadata0.13.0Strawman design, RFC-36, HUDI-3345
Supervised table service planning and execution0.13.0RFC-43, HUDI-4147
Support of Change Data Capture (CDC) with Hudi change logs0.13.0RFC-51, HUDI-3478
Record-level index to speed up UUID-based upserts and deletes0.13.0RFC-08, HUDI-53
Consistent hashing index for dynamic buckets0.13.0RFC-42, HUDI-3000
Secondary index to improve query performance0.13.0RFC-52, HUDI-3907
Reducing write amplification with Log Compaction in MOR0.13.0RFC-48, HUDI-3580
Eager conflict detection for Optimistic Concurrency Control0.13.0RFC-56, HUDI-1575
Efficient bootstrap and migration of existing non-Hudi dataset0.13.0HUDI-1265
Eliminating physical partitioning with efficient logical partitioning and file pruning0.13.0HUDI-512
Lock-Free message queue to improve writing efficiency0.13.0RFC-53, HUDI-3963
Lock free concurrency control1.0.0 onwardHUDI-3187
Non-blocking/Lock-free updates during clustering1.0.0 onwardHUDI-1042
Time Travel updates, deletes1.0.0 onward
General purpose support for multi-table transactions1.0.0 onward

Programming APIs

FeatureTarget ReleaseTracking
Redesign and optimization of record payload abstraction0.13.0RFC-46, HUDI-3217
Optimized storage layout for cloud object stores0.13.0RFC-60, HUDI-3625
Support of verification with multiple event_time fields0.13.0RFC-59, HUDI-4569

Execution Engine Integration

FeatureTarget ReleaseTracking
Spark datasource V2 read0.13.0HUDI-4449
Integrate column stats index with all query engines0.13.0RFC-58, HUDI-4552
Upgrade to Spark 3 as the default profile0.13.0HUDI-3431
Materialized Views with incremental updates using Flink1.0.0 onward
SQL DML support for Presto/Trino connectors (could be accelerated based on community feedback)1.0.0 onward
Explore other execution engines/runtimes (Ray, native Rust, Python)1.0.0 onward

Platform Services

FeatureTarget ReleaseTracking
Protobuf source for DeltaStreamer0.13.0RFC-57, HUDI-4399
Hudi integration with Snowflake0.13.0RFC-41, HUDI-2832
Improving Hudi CLI features and usability0.13.0HUDI-1388
Support for reliable, event based ingestion from cloud stores - GCS, Azure and the others1.0.0 onwardHUDI-1896
Mutable, Transactional caching for Hudi Tables (could be accelerated based on community feedback)1.0.0 onwardStrawman design