Build Universal Data lake with MySQL + Debezium+Kafka+DeltaSTreamer + Minio+HiveMetastore+TrinoApril 10, 2024 bySoumil Shahguidebeginnerapache hudiapache kafkadebeziummysqldeltastreamerhudi streamertrinominioapache hivehive metastoredata lakehouselakehouseuniversal lakehouse
Build Universal Data lake with Posgres + Debezium+Kafka+DeltaSTreamer + Minio+HiveMetastore+TrinoApril 6, 2024 bySoumil Shahguidebeginnerapache hudiapache kafkadebeziumpostgresdeltastreamerhudi streamertrinominioapache hivehive metastoredata lakehouselakehouseuniversal lakehouse
How to Delete Items from Hudi using Delta Streamer operating in UPSERT Mode with Kafka Avro MSG #12January 17, 2024 bySoumil Shahguidebeginnerapache hudideletedeltastreamerhudi streamerupsertapache kafka
Apache Hudi Delta Streamer in Action: Python Publishing and AvroKafkaSource Consumption (#11 Guide)December 12, 2023 bySoumil Shahguidebeginnerdeltastreamerhudi streamerapache kafkaapache avroapache hudipython
Real-Time Data: Postgres, Debezium, Kafka, Schema Registry, Delta Streamer #7ANovember 26, 2023 bySoumil Shahguidebeginnerdeltastreamerhudi streamerdebeziumschema registrypostgresapache kafkaapache hudi
Real-Time Data: Postgres, Debezium, Kafka, Schema Registry, DeltaStreamer #7BNovember 26, 2023 bySoumil Shahguidebeginnerdeltastreamerhudi streamerdebeziumschema registryapache kafkaapache hudi
Learn How to use DeltaStreamer and ingest data from Kafka Topic Hands on Labs #6November 24, 2023 bySoumil Shahguidebeginnerdeltastreamerhudi streamerapache hudikafka topicapache kafka
Learn How to Use Apache Flink with Kafka & Build Transactional Datalakes on S3 using PyFLink LocallySeptember 27, 2023 bySoumil Shahguideapache flinkapache hudibeginnerapache kafkapyflinktransactional data lakesaws s3
Bring Data from Source using Debezium with CDC into Kafka&S3Sink &Build Hudi Datalake | Hands on labDecember 27, 2022 bySoumil Shahguidepostgresqlmysqldebeziumincremental etlapache kafkaapache hudiaws glueamazon athenapostgres
Lets Build Streaming Solution using Kafka + PySpark and Apache HUDI Hands on Lab with codeDecember 24, 2022 bySoumil Shahguidestreaming ingestionpysparkapache zookeeperapache kafkaapache sparkapache hudi