Datadog is a popular monitoring service. In the upcoming 0.6.0 release of Apache Hudi, we will introduce the feature of reporting Hudi metrics via Datadog HTTP API, in addition to the current reporter types: Graphite and JMX.
Similar to other supported reporters, turning on Datadog reporter requires these 2 properties.
The following property sets the Datadog API site. It determines whether the requests will be sent to api.datadoghq.eu (EU) or api.datadoghq.com (US). Set this according to your Datadog account settings.
hoodie.metrics.datadog.api.site=EU # or US
The property hoodie.metrics.datadog.api.key allows you to set the api key directly from the configuration.
hoodie.metrics.datadog.api.key=<your api key>hoodie.metrics.datadog.api.key.supplier=<your api key supplier>
Due to security consideration in some cases, you may prefer to return the api key at runtime. To go with this approach, implement java.util.function.Supplier<String> and set the implementation’s FQCN to hoodie.metrics.datadog.api.key.supplier, and make sure hoodie.metrics.datadog.api.key is not set since it will take higher precedence.
The following property helps segregate metrics by setting different prefixes for different jobs.