Google Cloud Composer monitoring

Dynatrace Google Cloud integration leverages data collected from the Google Operation API to constantly monitor health and performance of Google Cloud Services. While combining all relevant data into dashboards, it also enables alerting and event tracking.

Prerequisites

Set up integration

Add services and feature sets optional

After integration, Dynatrace automatically monitors a number of preset Google Cloud services and feature sets (metrics). Besides these, you can add more services or feature sets to monitoring. For details, see Add or remove services.

For a list of feature sets available for this service, see Metric table.

View metrics

After deploying the integration, you can see metrics from monitored services in the Metrics browser, Data Explorer, and your dashboard tiles.

Metric table

The following feature sets are available for Google Cloud Composer.

Feature set
Name
Unit
GCP metric identifier
cloud_composer_environment/default_metrics
API Requests
Count
composer.googleapis.com/environment/api/request_count
cloud_composer_environment/default_metrics
API Latency
MilliSecond
composer.googleapis.com/environment/api/request_latencies
cloud_composer_environment/default_metrics
Parse Error Count
Count
composer.googleapis.com/environment/dag_processing/parse_error_count
cloud_composer_environment/default_metrics
DAG parsing processes
Count
composer.googleapis.com/environment/dag_processing/processes
cloud_composer_environment/default_metrics
Processors Timeout Count
Count
composer.googleapis.com/environment/dag_processing/processor_timeout_count
cloud_composer_environment/default_metrics
Total Parse Time
Second
composer.googleapis.com/environment/dag_processing/total_parse_time
cloud_composer_environment/default_metrics
Dag Bag Size
Count
composer.googleapis.com/environment/dagbag_size
cloud_composer_environment/default_metrics
Database Healthy
Unspecified
composer.googleapis.com/environment/database_health
cloud_composer_environment/default_metrics
Executor Open Slots
Count
composer.googleapis.com/environment/executor/open_slots
cloud_composer_environment/default_metrics
Executor Running Tasks
Count
composer.googleapis.com/environment/executor/running_tasks
cloud_composer_environment/default_metrics
Task Instance Count
Count
composer.googleapis.com/environment/finished_task_instance_count
cloud_composer_environment/default_metrics
Healthy
Unspecified
composer.googleapis.com/environment/healthy
cloud_composer_environment/default_metrics
Celery Workers
Count
composer.googleapis.com/environment/num_celery_workers
cloud_composer_environment/default_metrics
Scheduler Heartbeats
Count
composer.googleapis.com/environment/scheduler_heartbeat_count
cloud_composer_environment/default_metrics
Task Queue Length
Count
composer.googleapis.com/environment/task_queue_length
cloud_composer_environment/default_metrics
Worker Pod Eviction Count
Count
composer.googleapis.com/environment/worker/pod_eviction_count
cloud_composer_environment/default_metrics
Zombie Tasks Killed
Count
composer.googleapis.com/environment/zombie_task_killed_count

Related topics