Compute histogram summaries

The following configuration example shows how to use Collector to compute and ingest summaries of histogram buckets, such as the overall sum of all values in the bucket and their total count.

Prerequisites

Demo configuration

receivers:
  otlp:
    protocols:
      grpc:
      http:

processors:
  transform:
    metric_statements:
      - context: metric
        statements:
          # Get count from the histogram. The new metric name will be <histogram_name>_count
          - extract_count_metric(true) where type == METRIC_DATA_TYPE_HISTOGRAM

          # Get sum from the histogram. The new metric name will be <histogram_name>_sum
          - extract_sum_metric(true) where type == METRIC_DATA_TYPE_HISTOGRAM
      - context: datapoint
        statements:
          # convert the <histogram_name>_sum metrics to gauges.
          - convert_sum_to_gauge() where IsMatch(metric.name, ".*_sum")

  filter:
    metrics:
      metric:
        # Drop metrics of type histogram. The _count and _sum metrics will still be exported.
        - type == METRIC_DATA_TYPE_HISTOGRAM

exporters:
  otlphttp:
    endpoint: ${env:DT_ENDPOINT}
    headers:
      Authorization: "Api-Token ${env:DT_API_TOKEN}"

service:
  pipelines:
    metrics:
      receivers: [otlp]
      processors: [transform,filter]
      exporters: [otlphttp]

Components

For our configuration, we configure the following components.

Receiver

Under receivers, we specify the standard otlp receiver as active receiver component for our Collector instance and configure it to accept OTLP requests on gRPC and HTTP.

Processor

Under processors, we configure the following two processor instances:

With this configuration, the Collector drops histogram metrics and creates in their place two new metrics for the sum and item count of each respective histogram.

Exporter

Under exporters, we specify the default otlphttp exporter and configure it with our Dynatrace API URL and the required authentication token.

For this purpose, we set the following two environment variables and reference them in the configuration values for endpoint and Authorization.

Service pipeline

Under service, we assemble our receiver and exporter objects into a metric pipeline and enable the two processors by referencing them under processors.

Limits and limitations

Metrics are ingested using the OpenTelemetry protocol (OTLP) via the Dynatrace OTLP API and are subject to the API's limits and restrictions. For more information see: