Google Cloud Dataflow monitoring

Dynatrace Google Cloud integration leverages data collected from the Google Operation API to constantly monitor health and performance of Google Cloud Services. While combining all relevant data into dashboards, it also enables alerting and event tracking.

Prerequisites

Set up integration

Add services and feature sets optional

After integration, Dynatrace automatically monitors a number of preset Google Cloud services and feature sets (metrics). Besides these, you can add more services or feature sets to monitoring. For details, see Add or remove services.

For a list of feature sets available for this service, see Metric table.

View metrics

After deploying the integration, you can see metrics from monitored services in the Metrics browser, Data Explorer, and your dashboard tiles.

Metric table

The following feature sets are available for Google Cloud Dataflow.

Feature set
Name
Unit
GCP metric identifier
dataflow_job/default_metrics
Billable shuffle data processed
Byte
dataflow.googleapis.com/job/billable_shuffle_data_processed
dataflow_job/default_metrics
Current number of vCPUs in use
Count
dataflow.googleapis.com/job/current_num_vcpus
dataflow_job/default_metrics
Current shuffle slots in use
Count
dataflow.googleapis.com/job/current_shuffle_slots
dataflow_job/default_metrics
Data watermark lag
Second
dataflow.googleapis.com/job/data_watermark_age
dataflow_job/default_metrics
Elapsed time
Second
dataflow.googleapis.com/job/elapsed_time
dataflow_job/default_metrics
Element count
Count
dataflow.googleapis.com/job/element_count