Google Vertex AI monitoring

  • How-to guide
  • 6-min read
  • Published Sep 30, 2024

Dynatrace Google Cloud integration leverages data collected from the Google Operation API to constantly monitor health and performance of Google Cloud Services. While combining all relevant data into dashboards, it also enables alerting and event tracking.

Prerequisites

Set up integration

Add services and feature sets optional

After integration, Dynatrace automatically monitors a number of preset Google Cloud services and feature sets (metrics). Besides these, you can add more services or feature sets to monitoring. For details, see Add or remove services.

For a list of feature sets available for this service, see Metric table.

View metrics

After deploying the integration, you can see metrics from monitored services in the Metrics browser, Data Explorer, and your dashboard tiles.

Metric table

The following feature sets are available for Google Cloud Vertex AI.

Feature setNameUnitGCP metric identifier
vertexai_deployment_resource_pool/default_metricsAccelerator duty cyclePercentaiplatform_googleapis_com/prediction/online/deployment_resource_pool/accelerator/duty_cycle
vertexai_deployment_resource_pool/default_metricsAccelerator memory usageByteaiplatform_googleapis_com/prediction/online/deployment_resource_pool/accelerator/memory/bytes_used
vertexai_deployment_resource_pool/default_metricsCPU utilizationPercentaiplatform_googleapis_com/prediction/online/deployment_resource_pool/cpu/utilization
vertexai_deployment_resource_pool/default_metricsMemory usageByteaiplatform_googleapis_com/prediction/online/deployment_resource_pool/memory/bytes_used
vertexai_deployment_resource_pool/default_metricsNetwork bytes receivedByteaiplatform_googleapis_com/prediction/online/deployment_resource_pool/network/received_bytes_count
vertexai_deployment_resource_pool/default_metricsNetwork bytes sentByteaiplatform_googleapis_com/prediction/online/deployment_resource_pool/network/sent_bytes_count
vertexai_deployment_resource_pool/default_metricsReplica countCountaiplatform_googleapis_com/prediction/online/deployment_resource_pool/replicas
vertexai_deployment_resource_pool/default_metricsReplica targetCountaiplatform_googleapis_com/prediction/online/deployment_resource_pool/target_replicas
vertexai_endpoint/default_metricsAccelerator duty cyclePercentaiplatform_googleapis_com/prediction/online/accelerator/duty_cycle
vertexai_endpoint/default_metricsAccelerator memory usageByteaiplatform_googleapis_com/prediction/online/accelerator/memory/bytes_used
vertexai_endpoint/default_metricsCPU utilizationPercentaiplatform_googleapis_com/prediction/online/cpu/utilization
vertexai_endpoint/default_metricsNumber of online prediction errorsCountaiplatform_googleapis_com/prediction/online/error_count
vertexai_endpoint/default_metricsMemory usageByteaiplatform_googleapis_com/prediction/online/memory/bytes_used
vertexai_endpoint/default_metricsNetwork bytes receivedByteaiplatform_googleapis_com/prediction/online/network/received_bytes_count
vertexai_endpoint/default_metricsNetwork bytes sentByteaiplatform_googleapis_com/prediction/online/network/sent_bytes_count
vertexai_endpoint/default_metricsNumber of online predictionsCountaiplatform_googleapis_com/prediction/online/prediction_count
vertexai_endpoint/default_metricsPrediction latenciesMilliSecondaiplatform_googleapis_com/prediction/online/prediction_latencies
vertexai_endpoint/default_metricsPrivate endpoint prediction latenciesMilliSecondaiplatform_googleapis_com/prediction/online/private/prediction_latencies
vertexai_endpoint/default_metricsPrivate endpoint response countCountaiplatform_googleapis_com/prediction/online/private/response_count
vertexai_endpoint/default_metricsReplica countCountaiplatform_googleapis_com/prediction/online/replicas
vertexai_endpoint/default_metricsResponse countCountaiplatform_googleapis_com/prediction/online/response_count
vertexai_endpoint/default_metricsReplica targetCountaiplatform_googleapis_com/prediction/online/target_replicas
vertexai_feature_online_store/feature_storeRequest countCountaiplatform_googleapis_com/featureonlinestore/online_serving/request_count
vertexai_feature_online_store/feature_storeResponse bytes countCountaiplatform_googleapis_com/featureonlinestore/online_serving/serving_bytes_count
vertexai_feature_online_store/feature_storeRequest latencyMilliSecondaiplatform_googleapis_com/featureonlinestore/online_serving/serving_latencies
vertexai_feature_online_store/feature_storeRunning sycsCountaiplatform_googleapis_com/featureonlinestore/running_sync
vertexai_feature_online_store/feature_storeServing data agesSecondaiplatform_googleapis_com/featureonlinestore/serving_data_ages
vertexai_feature_online_store/feature_storeServing data by synced timeCountaiplatform_googleapis_com/featureonlinestore/serving_data_by_sync_time
vertexai_feature_online_store/feature_storeCPU loadPercentaiplatform_googleapis_com/featureonlinestore/storage/bigtable_cpu_load
vertexai_feature_online_store/feature_storeCPU load (hottest node)Percentaiplatform_googleapis_com/featureonlinestore/storage/bigtable_cpu_load_hottest_node
vertexai_feature_online_store/feature_storeNode countCountaiplatform_googleapis_com/featureonlinestore/storage/bigtable_nodes
vertexai_feature_online_store/feature_storeOptimized node countCountaiplatform_googleapis_com/featureonlinestore/storage/optimized_nodes
vertexai_feature_online_store/feature_storeBytes storedByteaiplatform_googleapis_com/featureonlinestore/storage/stored_bytes
vertexai_feature_store/feature_storeCPU loadPercentaiplatform_googleapis_com/featurestore/cpu_load
vertexai_feature_store/feature_storeCPU load (hottest node)Percentaiplatform_googleapis_com/featurestore/cpu_load_hottest_node
vertexai_feature_store/feature_storeNode countCountaiplatform_googleapis_com/featurestore/node_count
vertexai_feature_store/feature_storeEntities updated on the Featurestore online storageByteaiplatform_googleapis_com/featurestore/online_entities_updated
vertexai_feature_store/feature_storeLatenciesMilliSecondaiplatform_googleapis_com/featurestore/online_serving/latencies
vertexai_feature_store/feature_storeRequest sizeByteaiplatform_googleapis_com/featurestore/online_serving/request_bytes_count
vertexai_feature_store/feature_storeServing countCountaiplatform_googleapis_com/featurestore/online_serving/request_count
vertexai_feature_store/feature_storeResponse sizeByteaiplatform_googleapis_com/featurestore/online_serving/response_size
vertexai_feature_store/feature_storeBillable bytesByteaiplatform_googleapis_com/featurestore/storage/billable_processed_bytes
vertexai_feature_store/feature_storeBytes storedByteaiplatform_googleapis_com/featurestore/storage/stored_bytes
vertexai_feature_store/feature_storeOffline storage write for streaming writeCountaiplatform_googleapis_com/featurestore/streaming_write/offline_processed_count
vertexai_feature_store/feature_storeStreaming write to offline storage delay timeSecondaiplatform_googleapis_com/featurestore/streaming_write/offline_write_delays
vertexai_location/default_metricsExecuting PipelineJobsCountaiplatform_googleapis_com/executing_vertexai_pipeline_jobs
vertexai_location/default_metricsExecuting PipelineTasksCountaiplatform_googleapis_com/executing_vertexai_pipeline_tasks
vertexai_location/default_metricsGenerate content requests per minute per project per base modelCountaiplatform_googleapis_com/generate_content_requests_per_minute_per_project_per_base_model
vertexai_location/default_metricsOnline prediction dedicated requests per base model versionCountaiplatform_googleapis_com/online_prediction_dedicated_requests_per_base_model_version
vertexai_location/default_metricsOnline prediction dedicated tokens per minute per base model versionCountaiplatform_googleapis_com/online_prediction_dedicated_tokens_per_base_model_version
vertexai_location/default_metricsOnline prediction requests per base modelCountaiplatform_googleapis_com/online_prediction_requests_per_base_model
vertexai_location/default_metricsOnline prediction tokens per minute per base modelCountaiplatform_googleapis_com/online_prediction_tokens_per_minute_per_base_model
vertexai_location/default_metricsGenerate content requests per minute per project per base model quota exceeded errorCountaiplatform_googleapis_com/quota/generate_content_requests_per_minute_per_project_per_base_model/exceeded
vertexai_location/default_metricsGenerate content requests per minute per project per base model quota limitCountaiplatform_googleapis_com/quota/generate_content_requests_per_minute_per_project_per_base_model/limit
vertexai_location/default_metricsGenerate content requests per minute per project per base model quota usageCountaiplatform_googleapis_com/quota/generate_content_requests_per_minute_per_project_per_base_model/usage
vertexai_location/default_metricsOnline prediction dedicated requests per base model version quota exceeded errorCountaiplatform_googleapis_com/quota/online_prediction_dedicated_requests_per_base_model_version/exceeded
vertexai_location/default_metricsOnline prediction dedicated requests per base model version quota limitCountaiplatform_googleapis_com/quota/online_prediction_dedicated_requests_per_base_model_version/limit
vertexai_location/default_metricsOnline prediction dedicated requests per base model version quota usageCountaiplatform_googleapis_com/quota/online_prediction_dedicated_requests_per_base_model_version/usage
vertexai_location/default_metricsOnline prediction dedicated tokens per minute per base model version quota exceeded errorCountaiplatform_googleapis_com/quota/online_prediction_dedicated_tokens_per_base_model_version/exceeded
vertexai_location/default_metricsOnline prediction dedicated tokens per minute per base model version quota limitCountaiplatform_googleapis_com/quota/online_prediction_dedicated_tokens_per_base_model_version/limit
vertexai_location/default_metricsOnline prediction dedicated tokens per minute per base model version quota usageCountaiplatform_googleapis_com/quota/online_prediction_dedicated_tokens_per_base_model_version/usage
vertexai_location/default_metricsOnline prediction requests per base model quota exceededCountaiplatform_googleapis_com/quota/online_prediction_requests_per_base_model/exceeded
vertexai_location/default_metricsOnline prediction requests per base model quota limitCountaiplatform_googleapis_com/quota/online_prediction_requests_per_base_model/limit
vertexai_location/default_metricsOnline prediction requests per base model quota usageCountaiplatform_googleapis_com/quota/online_prediction_requests_per_base_model/usage
vertexai_location/default_metricsOnline prediction tokens per minute per base model quota exceededCountaiplatform_googleapis_com/quota/online_prediction_tokens_per_minute_per_base_model/exceeded
vertexai_location/default_metricsOnline prediction tokens per minute per base model quota limitCountaiplatform_googleapis_com/quota/online_prediction_tokens_per_minute_per_base_model/limit
vertexai_location/default_metricsOnline prediction tokens per minute per base model quota usageCountaiplatform_googleapis_com/quota/online_prediction_tokens_per_minute_per_base_model/usage
vertexai_pipeline_job/pipelinesPipelineJob durationSecondaiplatform_googleapis_com/pipelinejob/duration
vertexai_pipeline_job/pipelinesCompleted PipelineTasksCountaiplatform_googleapis_com/pipelinejob/task_completed_count
vertexai_index/vector_searchDatapoint countCountaiplatform_googleapis_com/matching_engine/stream_update/datapoint_count
vertexai_index/vector_searchStream update latenciesMilliSecondaiplatform_googleapis_com/matching_engine/stream_update/latencies
vertexai_index/vector_searchRequest countCountaiplatform_googleapis_com/matching_engine/stream_update/request_count
vertexai_index_endpoint/vector_searchCPU request utilizationPercentaiplatform_googleapis_com/matching_engine/cpu/request_utilization
vertexai_index_endpoint/vector_searchCurrent replicasCountaiplatform_googleapis_com/matching_engine/current_replicas
vertexai_index_endpoint/vector_searchCurrent shardsCountaiplatform_googleapis_com/matching_engine/current_shards
vertexai_index_endpoint/vector_searchMemory usageByteaiplatform_googleapis_com/matching_engine/memory/used_bytes
vertexai_index_endpoint/vector_searchRequest latencyMilliSecondaiplatform_googleapis_com/matching_engine/query/latencies
vertexai_index_endpoint/vector_searchRequest countCountaiplatform_googleapis_com/matching_engine/query/request_count
vertexai_publisher_model/default_metricsCharacter countCountaiplatform_googleapis_com/publisher/online_serving/character_count
vertexai_publisher_model/default_metricsCharactersCountaiplatform_googleapis_com/publisher/online_serving/characters
vertexai_publisher_model/default_metricsCharacter ThroughputCountaiplatform_googleapis_com/publisher/online_serving/consumed_throughput/count
vertexai_publisher_model/default_metricsFirst token latenciesMilliSecondaiplatform_googleapis_com/publisher/online_serving/first_token_latencies
vertexai_publisher_model/default_metricsModel invocation countCountaiplatform_googleapis_com/publisher/online_serving/model_invocation_count
vertexai_publisher_model/default_metricsModel invocation latenciesMilliSecondaiplatform_googleapis_com/publisher/online_serving/model_invocation_latencies
vertexai_publisher_model/default_metricsToken countCountaiplatform_googleapis_com/publisher/online_serving/token_count
vertexai_publisher_model/default_metricsTokensCountaiplatform_googleapis_com/publisher/online_serving/tokens
visionai_instance/vision_aiRequest countCountvisionai_googleapis_com/platform/connected_service/request_count
visionai_instance/vision_aiRequest latenciesMilliSecondvisionai_googleapis_com/platform/connected_service/request_latencies
visionai_instance/vision_aiPrediction countCountvisionai_googleapis_com/platform/custom_model/predict_count
visionai_instance/vision_aiPrediction latenciesMilliSecondvisionai_googleapis_com/platform/custom_model/predict_latencies
visionai_instance/vision_aiUptimeMilliSecondvisionai_googleapis_com/platform/instance/uptime
visionai_stream/vision_aiReceived bytesBytevisionai_googleapis_com/stream/network/received_bytes_count
visionai_stream/vision_aiReceived packetsCountvisionai_googleapis_com/stream/network/received_packets_count
visionai_stream/vision_aiSent bytesBytevisionai_googleapis_com/stream/network/sent_bytes_count
visionai_stream/vision_aiSent packetsCountvisionai_googleapis_com/stream/network/sent_packets_count
Related tags
Infrastructure Observability