Skip to main content

Roadmap

Hudi community strives to deliver major releases every 3-4 months, while offering minor releases every other month! This page captures the forward-looking roadmap of ongoing & upcoming projects and when they are expected to land, broken down by areas on our stack.

Future Releases

Next upcoming release : 0.14.1 (Dec 2023)

Transactional Database Layer

FeatureTarget ReleaseTracking
Support for primary key-less table0.14.0HUDI-4699
Efficient bootstrap and migration of existing non-Hudi dataset0.14.0HUDI-1265
Record-level index to speed up UUID-based upserts and deletes0.14.0RFC-08, HUDI-53
1.x Storage format1.0.0HUDI-6242
Writer performance improvements1.0.0HUDI-3249
Non-blocking concurrency control1.0.0HUDI-3187, HUDI-1042, RFC-66
Time Travel updates, deletes1.0.0
General purpose support for multi-table transactions1.0.0
A more effective HoodieMergeHandler for COW table with parquet1.0.0RFC-68
Secondary indexes to improve query performance1.0.0RFC-52, HUDI-3907
Index Function for Optimizing Query Performance1.0.0RFC-63, HUDI-512
Logical partitioning via indexing1.0.0HUDI-512
Streaming CDC/Incremental read improvement1.0.0HUDI-2749
Supervised table service planning and execution1.1.0RFC-43, HUDI-4147

Programming APIs

FeatureTarget ReleaseTracking
MOR snapshot reader0.14.0HUDI-6452
APIs/Abstractions, Record mergers1.0.0HUDI-6243, HUDI-3217
New Hudi Table Format APIs for Query Integrations1.0.0RFC-64, HUDI-4141
Snapshot view management1.0.0RFC-61, HUDI-4677
Optimized storage layout for cloud object stores1.0.0RFC-60, HUDI-3625
Support of verification with multiple event_time fields1.0.0RFC-59, HUDI-4569

Execution Engine Integration

FeatureTarget ReleaseTracking
Support for Spark 3.4.00.14.0HUDI-6198
Integrate column stats index with all query engines0.14.0RFC-58, HUDI-4552
Upgrade to Spark 3 as the default profile0.14.0HUDI-3431
Performance for Spark-SQL writes0.14.0HUDI-6315, HUDI-6376
Presto/Trino queries with new format1.0.0HUDI-3210, HUDI-4394, HUDI-4552
Materialized Views with incremental updates using Flink1.0.0
Explore other execution engines/runtimes (Ray, native Rust, Python)1.0.0
Spark datasource V2 read1.1.0HUDI-4449

Platform Services

FeatureTarget ReleaseTracking
Hudi Reverse streamer1.0.0RFC-70
Partition TTL management1.1.0RFC-65
Diagnostic Reporter1.1.0RFC-62
Hudi integration with Snowflake1.1.0RFC-41, HUDI-2832
Support for reliable, event based ingestion from cloud stores - GCS, Azure and the others1.1.0HUDI-1896
Mutable, Transactional caching for Hudi Tables (could be accelerated based on community feedback)1.1.0Strawman design, HUDI-6489