Try it free

Amazon ES (Elasticsearch Service) monitoring

  • Dynatrace Classic
  • How-to guide
  • 6-min read
  • Published Oct 15, 2020

Dynatrace ingests metrics for multiple preselected namespaces, including Amazon Elasticsearch Service (ES). You can view metrics for each service instance, split metrics into multiple dimensions, and create custom charts that you can pin to your dashboards.

Prerequisites

To enable monitoring for this service, you need

  • ActiveGate version 1.181+, as follows:

    • For Dynatrace SaaS deployments, you need an Environment ActiveGate or a Multi-environment ActiveGate.

    • For Dynatrace Managed deployments, you can use any kind of ActiveGate.

      For role-based access (whether in a SaaS or Managed deployment), you need an Environment ActiveGate installed on an Amazon EC2 host.

  • Dynatrace version 1.182+

  • An updated AWS monitoring policy to include the additional AWS services.
    To update the AWS IAM policy, use the JSON below, containing the monitoring policy (permissions) for all supporting services.

JSON predefined policy for all supporting services
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "VisualEditor0",
"Effect": "Allow",
"Action": [
"acm-pca:ListCertificateAuthorities",
"apigateway:GET",
"apprunner:ListServices",
"appstream:DescribeFleets",
"appsync:ListGraphqlApis",
"athena:ListWorkGroups",
"autoscaling:DescribeAutoScalingGroups",
"cloudformation:ListStackResources",
"cloudfront:ListDistributions",
"cloudhsm:DescribeClusters",
"cloudsearch:DescribeDomains",
"cloudwatch:GetMetricData",
"cloudwatch:GetMetricStatistics",
"cloudwatch:ListMetrics",
"codebuild:ListProjects",
"datasync:ListTasks",
"dax:DescribeClusters",
"directconnect:DescribeConnections",
"dms:DescribeReplicationInstances",
"dynamodb:ListTables",
"dynamodb:ListTagsOfResource",
"ec2:DescribeAvailabilityZones",
"ec2:DescribeInstances",
"ec2:DescribeNatGateways",
"ec2:DescribeSpotFleetRequests",
"ec2:DescribeTransitGateways",
"ec2:DescribeVolumes",
"ec2:DescribeVpnConnections",
"ecs:ListClusters",
"eks:ListClusters",
"elasticache:DescribeCacheClusters",
"elasticbeanstalk:DescribeEnvironmentResources",
"elasticbeanstalk:DescribeEnvironments",
"elasticfilesystem:DescribeFileSystems",
"elasticloadbalancing:DescribeInstanceHealth",
"elasticloadbalancing:DescribeListeners",
"elasticloadbalancing:DescribeLoadBalancers",
"elasticloadbalancing:DescribeRules",
"elasticloadbalancing:DescribeTags",
"elasticloadbalancing:DescribeTargetHealth",
"elasticmapreduce:ListClusters",
"elastictranscoder:ListPipelines",
"es:ListDomainNames",
"events:ListEventBuses",
"firehose:ListDeliveryStreams",
"fsx:DescribeFileSystems",
"gamelift:ListFleets",
"glue:GetJobs",
"inspector:ListAssessmentTemplates",
"kafka:ListClusters",
"kinesis:ListStreams",
"kinesisanalytics:ListApplications",
"kinesisvideo:ListStreams",
"lambda:ListFunctions",
"lambda:ListTags",
"lex:GetBots",
"logs:DescribeLogGroups",
"mediaconnect:ListFlows",
"mediaconvert:DescribeEndpoints",
"mediapackage-vod:ListPackagingConfigurations",
"mediapackage:ListChannels",
"mediatailor:ListPlaybackConfigurations",
"opsworks:DescribeStacks",
"qldb:ListLedgers",
"rds:DescribeDBClusters",
"rds:DescribeDBInstances",
"rds:DescribeEvents",
"rds:ListTagsForResource",
"redshift:DescribeClusters",
"robomaker:ListSimulationJobs",
"route53:ListHostedZones",
"route53resolver:ListResolverEndpoints",
"s3:ListAllMyBuckets",
"sagemaker:ListEndpoints",
"sns:ListTopics",
"sqs:ListQueues",
"storagegateway:ListGateways",
"sts:GetCallerIdentity",
"swf:ListDomains",
"tag:GetResources",
"tag:GetTagKeys",
"transfer:ListServers",
"workmail:ListOrganizations",
"workspaces:DescribeWorkspaces"
],
"Resource": "*"
}
]
}

If you don't want to add permissions to all services, and just select permissions for certain services, consult the table below. The table contains a set of permissions that are required for All AWS cloud services and, for each supporting service, a list of optional permissions specific to that service.

Permissions required for AWS monitoring integration:
  • "cloudwatch:GetMetricData"
  • "cloudwatch:GetMetricStatistics"
  • "cloudwatch:ListMetrics"
  • "sts:GetCallerIdentity"
  • "tag:GetResources"
  • "tag:GetTagKeys"
  • "ec2:DescribeAvailabilityZones"

Complete list of permissions for cloud services

NamePermissions

All monitored Amazon services Required

cloudwatch:GetMetricData,cloudwatch:GetMetricStatistics,cloudwatch:ListMetrics,sts:GetCallerIdentity,tag:GetResources,tag:GetTagKeys,ec2:DescribeAvailabilityZones

AWS Certificate Manager Private Certificate Authority

acm-pca:ListCertificateAuthorities

Amazon MQ

Amazon API Gateway

apigateway:GET

AWS App Runner

apprunner:ListServices

Amazon AppStream

appstream:DescribeFleets

AWS AppSync

appsync:ListGraphqlApis

Amazon Athena

athena:ListWorkGroups

Amazon Aurora

rds:DescribeDBClusters

Amazon EC2 Auto Scaling

autoscaling:DescribeAutoScalingGroups

Amazon EC2 Auto Scaling (built-in)

autoscaling:DescribeAutoScalingGroups

AWS Billing

Amazon Keyspaces

AWS Chatbot

Amazon CloudFront

cloudfront:ListDistributions

AWS CloudHSM

cloudhsm:DescribeClusters

Amazon CloudSearch

cloudsearch:DescribeDomains

AWS CodeBuild

codebuild:ListProjects

Amazon Cognito

Amazon Connect

Amazon Elastic Kubernetes Service (EKS)

eks:ListClusters

AWS DataSync

datasync:ListTasks

Amazon DynamoDB Accelerator (DAX)

dax:DescribeClusters

AWS Database Migration Service (AWS DMS)

dms:DescribeReplicationInstances

Amazon DocumentDB

rds:DescribeDBClusters

AWS Direct Connect

directconnect:DescribeConnections

Amazon DynamoDB

dynamodb:ListTables

Amazon DynamoDB (built-in)

dynamodb:ListTables,dynamodb:ListTagsOfResource

Amazon EBS

ec2:DescribeVolumes

Amazon EBS (built-in)

ec2:DescribeVolumes

Amazon EC2 API

Amazon EC2 (built-in)

ec2:DescribeInstances

Amazon EC2 Spot Fleet

ec2:DescribeSpotFleetRequests

Amazon Elastic Container Service (ECS)

ecs:ListClusters

Amazon ECS Container Insights

ecs:ListClusters

Amazon ElastiCache (EC)

elasticache:DescribeCacheClusters

AWS Elastic Beanstalk

elasticbeanstalk:DescribeEnvironments

Amazon Elastic File System (EFS)

elasticfilesystem:DescribeFileSystems

Amazon Elastic Inference

Amazon Elastic Map Reduce (EMR)

elasticmapreduce:ListClusters

Amazon Elasticsearch Service (ES)

es:ListDomainNames

Amazon Elastic Transcoder

elastictranscoder:ListPipelines

Amazon Elastic Load Balancer (ELB) (built-in)

elasticloadbalancing:DescribeInstanceHealth,elasticloadbalancing:DescribeListeners,elasticloadbalancing:DescribeLoadBalancers,elasticloadbalancing:DescribeRules,elasticloadbalancing:DescribeTags,elasticloadbalancing:DescribeTargetHealth

Amazon EventBridge

events:ListEventBuses

Amazon FSx

fsx:DescribeFileSystems

Amazon GameLift

gamelift:ListFleets

AWS Glue

glue:GetJobs

Amazon Inspector

inspector:ListAssessmentTemplates

AWS Internet of Things (IoT)

AWS IoT Analytics

Amazon Managed Streaming for Kafka

kafka:ListClusters

Amazon Kinesis Data Analytics

kinesisanalytics:ListApplications

Amazon Data Firehose

firehose:ListDeliveryStreams

Amazon Kinesis Data Streams

kinesis:ListStreams

Amazon Kinesis Video Streams

kinesisvideo:ListStreams

AWS Lambda

lambda:ListFunctions

AWS Lambda (built-in)

lambda:ListFunctions,lambda:ListTags

Amazon Lex

lex:GetBots

Amazon Application and Network Load Balancer (built-in)

elasticloadbalancing:DescribeInstanceHealth,elasticloadbalancing:DescribeListeners,elasticloadbalancing:DescribeLoadBalancers,elasticloadbalancing:DescribeRules,elasticloadbalancing:DescribeTags,elasticloadbalancing:DescribeTargetHealth

Amazon CloudWatch Logs

logs:DescribeLogGroups

AWS Elemental MediaConnect

mediaconnect:ListFlows

AWS Elemental MediaConvert

mediaconvert:DescribeEndpoints

AWS Elemental MediaPackage Live

mediapackage:ListChannels

AWS Elemental MediaPackage Video on Demand

mediapackage-vod:ListPackagingConfigurations

AWS Elemental MediaTailor

mediatailor:ListPlaybackConfigurations

Amazon VPC NAT Gateways

ec2:DescribeNatGateways

Amazon Neptune

rds:DescribeDBClusters

AWS OpsWorks

opsworks:DescribeStacks

Amazon Polly

Amazon QLDB

qldb:ListLedgers

Amazon RDS

rds:DescribeDBInstances

Amazon RDS (built-in)

rds:DescribeDBInstances,rds:DescribeEvents,rds:ListTagsForResource

Amazon Redshift

redshift:DescribeClusters

Amazon Rekognition

AWS RoboMaker

robomaker:ListSimulationJobs

Amazon Route 53

route53:ListHostedZones

Amazon Route 53 Resolver

route53resolver:ListResolverEndpoints

Amazon S3

s3:ListAllMyBuckets

Amazon S3 (built-in)

s3:ListAllMyBuckets

Amazon SageMaker Batch Transform Jobs

Amazon SageMaker Endpoint Instances

sagemaker:ListEndpoints

Amazon SageMaker Endpoints

sagemaker:ListEndpoints

Amazon SageMaker Ground Truth

Amazon SageMaker Processing Jobs

Amazon SageMaker Training Jobs

AWS Service Catalog

Amazon Simple Email Service (SES)

Amazon Simple Notification Service (SNS)

sns:ListTopics

Amazon Simple Queue Service (SQS)

sqs:ListQueues

AWS Systems Manager - Run Command

AWS Step Functions

AWS Storage Gateway

storagegateway:ListGateways

Amazon SWF

swf:ListDomains

Amazon Textract

AWS IoT Things Graph

AWS Transfer Family

transfer:ListServers

AWS Transit Gateway

ec2:DescribeTransitGateways

Amazon Translate

AWS Trusted Advisor

AWS API Usage

AWS Site-to-Site VPN

ec2:DescribeVpnConnections

AWS WAF Classic

AWS WAF

Amazon WorkMail

workmail:ListOrganizations

Amazon WorkSpaces

workspaces:DescribeWorkspaces

Example of JSON policy for one single service.

JSON policy for Amazon API Gateway
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "VisualEditor0",
"Effect": "Allow",
"Action": [
"apigateway:GET",
"cloudwatch:GetMetricData",
"cloudwatch:GetMetricStatistics",
"cloudwatch:ListMetrics",
"sts:GetCallerIdentity",
"tag:GetResources",
"tag:GetTagKeys",
"ec2:DescribeAvailabilityZones"
],
"Resource": "*"
}
]
}

In this example, from the complete list of permissions you need to select

  • "apigateway:GET" for Amazon API Gateway
  • "cloudwatch:GetMetricData", "cloudwatch:GetMetricStatistics", "cloudwatch:ListMetrics", "sts:GetCallerIdentity", "tag:GetResources", "tag:GetTagKeys", and "ec2:DescribeAvailabilityZones" for All AWS cloud services.

AWS endpoints that need to be reachable from ActiveGate with corresponding AWS services

EndpointService

autoscaling.<REGION>.amazonaws.com

Amazon EC2 Auto Scaling (built-in), Amazon EC2 Auto Scaling

lambda.<REGION>.amazonaws.com

AWS Lambda (built-in), AWS Lambda

elasticloadbalancing.<REGION>.amazonaws.com

Amazon Application and Network Load Balancer (built-in), Amazon Elastic Load Balancer (ELB) (built-in)

dynamodb.<REGION>.amazonaws.com

Amazon DynamoDB (built-in), Amazon DynamoDB

ec2.<REGION>.amazonaws.com

Amazon EBS (built-in), Amazon EC2 (built-in), Amazon EBS, Amazon EC2 Spot Fleet, Amazon VPC NAT Gateways, AWS Transit Gateway, AWS Site-to-Site VPN

rds.<REGION>.amazonaws.com

Amazon RDS (built-in), Amazon Aurora, Amazon DocumentDB, Amazon Neptune, Amazon RDS

s3.<REGION>.amazonaws.com

Amazon S3 (built-in)

acm-pca.<REGION>.amazonaws.com

AWS Certificate Manager Private Certificate Authority

apigateway.<REGION>.amazonaws.com

Amazon API Gateway

apprunner.<REGION>.amazonaws.com

AWS App Runner

appstream2.<REGION>.amazonaws.com

Amazon AppStream

appsync.<REGION>.amazonaws.com

AWS AppSync

athena.<REGION>.amazonaws.com

Amazon Athena

cloudfront.amazonaws.com

Amazon CloudFront

cloudhsmv2.<REGION>.amazonaws.com

AWS CloudHSM

cloudsearch.<REGION>.amazonaws.com

Amazon CloudSearch

codebuild.<REGION>.amazonaws.com

AWS CodeBuild

datasync.<REGION>.amazonaws.com

AWS DataSync

dax.<REGION>.amazonaws.com

Amazon DynamoDB Accelerator (DAX)

dms.<REGION>.amazonaws.com

AWS Database Migration Service (AWS DMS)

directconnect.<REGION>.amazonaws.com

AWS Direct Connect

ecs.<REGION>.amazonaws.com

Amazon Elastic Container Service (ECS), Amazon ECS Container Insights

elasticfilesystem.<REGION>.amazonaws.com

Amazon Elastic File System (EFS)

eks.<REGION>.amazonaws.com

Amazon Elastic Kubernetes Service (EKS)

elasticache.<REGION>.amazonaws.com

Amazon ElastiCache (EC)

elasticbeanstalk.<REGION>.amazonaws.com

AWS Elastic Beanstalk

elastictranscoder.<REGION>.amazonaws.com

Amazon Elastic Transcoder

es.<REGION>.amazonaws.com

Amazon Elasticsearch Service (ES)

events.<REGION>.amazonaws.com

Amazon EventBridge

fsx.<REGION>.amazonaws.com

Amazon FSx

gamelift.<REGION>.amazonaws.com

Amazon GameLift

glue.<REGION>.amazonaws.com

AWS Glue

inspector.<REGION>.amazonaws.com

Amazon Inspector

kafka.<REGION>.amazonaws.com

Amazon Managed Streaming for Kafka

models.lex.<REGION>.amazonaws.com

Amazon Lex

logs.<REGION>.amazonaws.com

Amazon CloudWatch Logs

api.mediatailor.<REGION>.amazonaws.com

AWS Elemental MediaTailor

mediaconnect.<REGION>.amazonaws.com

AWS Elemental MediaConnect

mediapackage.<REGION>.amazonaws.com

AWS Elemental MediaPackage Live

mediapackage-vod.<REGION>.amazonaws.com

AWS Elemental MediaPackage Video on Demand

opsworks.<REGION>.amazonaws.com

AWS OpsWorks

qldb.<REGION>.amazonaws.com

Amazon QLDB

redshift.<REGION>.amazonaws.com

Amazon Redshift

robomaker.<REGION>.amazonaws.com

AWS RoboMaker

route53.amazonaws.com

Amazon Route 53

route53resolver.<REGION>.amazonaws.com

Amazon Route 53 Resolver

api.sagemaker.<REGION>.amazonaws.com

Amazon SageMaker Endpoints, Amazon SageMaker Endpoint Instances

sns.<REGION>.amazonaws.com

Amazon Simple Notification Service (SNS)

sqs.<REGION>.amazonaws.com

Amazon Simple Queue Service (SQS)

storagegateway.<REGION>.amazonaws.com

AWS Storage Gateway

swf.<REGION>.amazonaws.com

Amazon SWF

transfer.<REGION>.amazonaws.com

AWS Transfer Family

workmail.<REGION>.amazonaws.com

Amazon WorkMail

workspaces.<REGION>.amazonaws.com

Amazon WorkSpaces

Enable monitoring

To learn how to enable service monitoring, see Enable service monitoring.

View service metrics

You can view the service metrics in your Dynatrace environment either on the custom device overview page or on your Dashboards page.

View metrics on the custom device overview page

To access the custom device overview page

  1. Go to Technologies Technologies & Processes Classic.
  2. Filter by service name and select the relevant custom device group.
  3. Once you select the custom device group, you're on the custom device group overview page.
  4. The custom device group overview page lists all instances (custom devices) belonging to the group. Select an instance to view the custom device overview page.

View metrics on your dashboard

You can also view metrics in the Dynatrace web UI on dashboards. There is no preset dashboard available for this service, but you can create your own dashboard.

To check the availability of preset dashboards for each AWS service, see the list below.

Preset dashboard availability list

AWS servicePreset dashboard

Amazon EC2 Auto Scaling (built-in)

Not applicable

AWS Lambda (built-in)

Not applicable

Amazon Application and Network Load Balancer (built-in)

Not applicable

Amazon DynamoDB (built-in)

Not applicable

Amazon EBS (built-in)

Not applicable

Amazon EC2 (built-in)

Not applicable

Amazon Elastic Load Balancer (ELB) (built-in)

Not applicable

Amazon RDS (built-in)

Not applicable

Amazon S3 (built-in)

Not applicable

AWS Certificate Manager Private Certificate Authority

Not applicable

All monitored Amazon services

Not applicable

Amazon API Gateway

Not applicable

AWS App Runner

Not applicable

Amazon AppStream

Applicable

AWS AppSync

Applicable

Amazon Athena

Applicable

Amazon Aurora

Not applicable

Amazon EC2 Auto Scaling

Applicable

AWS Billing

Applicable

Amazon Keyspaces

Applicable

AWS Chatbot

Applicable

Amazon CloudFront

Not applicable

AWS CloudHSM

Applicable

Amazon CloudSearch

Applicable

AWS CodeBuild

Applicable

Amazon Cognito

Not applicable

Amazon Connect

Applicable

AWS DataSync

Applicable

Amazon DynamoDB Accelerator (DAX)

Applicable

AWS Database Migration Service (AWS DMS)

Applicable

Amazon DocumentDB

Applicable

AWS Direct Connect

Applicable

Amazon DynamoDB

Not applicable

Amazon EBS

Not applicable

Amazon EC2 Spot Fleet

Not applicable

Amazon EC2 API

Applicable

Amazon Elastic Container Service (ECS)

Not applicable

Amazon ECS Container Insights

Applicable

Amazon Elastic File System (EFS)

Not applicable

Amazon Elastic Kubernetes Service (EKS)

Applicable

Amazon ElastiCache (EC)

Not applicable

AWS Elastic Beanstalk

Applicable

Amazon Elastic Inference

Applicable

Amazon Elastic Transcoder

Applicable

Amazon Elastic Map Reduce (EMR)

Not applicable

Amazon Elasticsearch Service (ES)

Not applicable

Amazon EventBridge

Applicable

Amazon FSx

Applicable

Amazon GameLift

Applicable

AWS Glue

Not applicable

Amazon Inspector

Applicable

AWS Internet of Things (IoT)

Not applicable

AWS IoT Things Graph

Applicable

AWS IoT Analytics

Applicable

Amazon Managed Streaming for Kafka

Applicable

Amazon Kinesis Data Analytics

Not applicable

Amazon Data Firehose

Not applicable

Amazon Kinesis Data Streams

Not applicable

Amazon Kinesis Video Streams

Not applicable

AWS Lambda

Not applicable

Amazon Lex

Applicable

Amazon CloudWatch Logs

Applicable

AWS Elemental MediaTailor

Applicable

AWS Elemental MediaConnect

Applicable

AWS Elemental MediaConvert

Applicable

AWS Elemental MediaPackage Live

Applicable

AWS Elemental MediaPackage Video on Demand

Applicable

Amazon MQ

Applicable

Amazon VPC NAT Gateways

Not applicable

Amazon Neptune

Applicable

AWS OpsWorks

Applicable

Amazon Polly

Applicable

Amazon QLDB

Applicable

Amazon RDS

Not applicable

Amazon Redshift

Not applicable

Amazon Rekognition

Applicable

AWS RoboMaker

Applicable

Amazon Route 53

Applicable

Amazon Route 53 Resolver

Applicable

Amazon S3

Not applicable

Amazon SageMaker Batch Transform Jobs

Not applicable

Amazon SageMaker Endpoints

Not applicable

Amazon SageMaker Endpoint Instances

Not applicable

Amazon SageMaker Ground Truth

Not applicable

Amazon SageMaker Processing Jobs

Not applicable

Amazon SageMaker Training Jobs

Not applicable

AWS Service Catalog

Applicable

Amazon Simple Email Service (SES)

Not applicable

Amazon Simple Notification Service (SNS)

Not applicable

Amazon Simple Queue Service (SQS)

Not applicable

AWS Systems Manager - Run Command

Applicable

AWS Step Functions

Applicable

AWS Storage Gateway

Applicable

Amazon SWF

Applicable

Amazon Textract

Applicable

AWS Transfer Family

Applicable

AWS Transit Gateway

Applicable

Amazon Translate

Applicable

AWS Trusted Advisor

Applicable

AWS API Usage

Applicable

AWS Site-to-Site VPN

Applicable

AWS WAF Classic

Applicable

AWS WAF

Applicable

Amazon WorkMail

Applicable

Amazon WorkSpaces

Applicable

Available metrics

DomainName is the main dimension.

NameDescriptionUnitStatisticsDimensionsRecommended

2xx

Count

Sum

ClientId, DomainName

3xx

Count

Sum

ClientId, DomainName

4xx

Count

Sum

ClientId, DomainName

5xx

Count

Sum

ClientId, DomainName

AutomatedSnapshotFailure

The number of failed automated snapshots for the cluster. A value of 1 indicates that no automated snapshot of the domain has been taken for the last 36 hours.

Count

Minimum

DomainName, ClientId

AutomatedSnapshotFailure

Count

Maximum

DomainName, ClientId

CPUCreditBalance

The remaining CPU credits available for data nodes in the cluster. A CPU credit provides the performance of a full CPU core for one minute. This metric is available only for the T2 instance types.

Count

Minimum

DomainName, ClientId

CPUUtilization

The percentage of CPU usage for data nodes in the cluster. Maximum shows the node with the highest CPU usage. Average represents all nodes in the cluster. This metric is also available for individual nodes.

Percent

Average

ClientId, DomainName, NodeId

CPUUtilization

Percent

Average

DomainName, ClientId

Applicable

CPUUtilization

Percent

Maximum

ClientId, DomainName, NodeId

CPUUtilization

Percent

Maximum

DomainName, ClientId

Applicable

ClusterIndexWritesBlocked

Indicates whether your cluster is accepting or blocking incoming write requests. A value of 0 means that the cluster is accepting requests. A value of 1 means that the cluster is blocking requests.

Count

Maximum

DomainName, ClientId

ClusterStatus.green

A value of 1 indicates that all index shards are allocated to nodes in the cluster

Count

Minimum

DomainName, ClientId

Applicable

ClusterStatus.green

Count

Maximum

DomainName, ClientId

ClusterStatus.red

A value of 1 indicates that the primary and replica shards for at least one index aren't allocated to nodes in the cluster

Count

Minimum

DomainName, ClientId

ClusterStatus.red

Count

Maximum

DomainName, ClientId

Applicable

ClusterStatus.yellow

A value of 1 indicates that the primary shards for all indices are allocated to nodes in the cluster, but replica shards for at least one index aren't allocated to nodes in the cluster

Count

Minimum

DomainName, ClientId

ClusterStatus.yellow

Count

Maximum

DomainName, ClientId

Applicable

ClusterUsedSpace

The total used space for the cluster

Megabytes

Minimum

DomainName, ClientId

ClusterUsedSpace

Megabytes

Maximum

DomainName, ClientId

DeletedDocuments

The total number of documents marked for deletion across all data nodes in the cluster. These documents no longer appear in search results, but Elasticsearch only removes deleted documents from disk during segment merges. This metric increases after delete requests and decreases after segment merges.

Count

Multi

DomainName, ClientId

DiskQueueDepth

The number of pending input and output (I/O) requests for an EBS volume

Count

Multi

DomainName, ClientId

ElasticsearchRequests

The number of requests made to the Elasticsearch cluster

Count

Sum

DomainName, ClientId

Applicable

FreeStorageSpace

The free space for data nodes in the cluster

Megabytes

Multi

ClientId, DomainName, NodeId

FreeStorageSpace

Megabytes

Multi

DomainName, ClientId

Applicable

FreeStorageSpace

Megabytes

Sum

DomainName, ClientId

FreeStorageSpace

Megabytes

Sum

ClientId, DomainName, NodeId

InvalidHostHeaderRequests

The number of HTTP requests made to the Elasticsearch cluster that included an invalid (or missing) host header

Count

Sum

DomainName, ClientId

JVMMemoryPressure

The maximum percentage of the Java heap used for all data nodes in the cluster

Percent

Maximum

DomainName, ClientId

KMSKeyError

A value of 1 indicates that the KMS customer master key used to encrypt data at rest has been disabled

Count

Minimum

DomainName, ClientId

KMSKeyError

Count

Maximum

DomainName, ClientId

KMSKeyInaccessible

A value of 1 indicates that the KMS customer master key used to encrypt data at rest has been deleted or revoked its grants to Amazon ES

Count

Minimum

DomainName, ClientId

KMSKeyInaccessible

Count

Maximum

DomainName, ClientId

KibanaHealthyNodes

A health check for Kibana. A value of 1 indicates normal behavior. A value of 0 indicates that Kibana is inaccessible. In most cases, the health of Kibana mirrors the health of the cluster.

Count

Minimum

DomainName, ClientId

MasterCPUCreditBalance

The remaining CPU credits available for dedicated master nodes in the cluster. A CPU credit provides the performance of a full CPU core for one minute.

Count

Minimum

DomainName, ClientId

MasterCPUUtilization

The maximum percentage of CPU resources used by the dedicated master nodes

Percent

Average

DomainName, ClientId

Applicable

MasterJVMMemoryPressure

The maximum percentage of the Java heap used for all dedicated master nodes in the cluster

Percent

Maximum

DomainName, ClientId

MasterReachableFromNode

A health check for MasterNotDiscovered exceptions. A value of 1 indicates normal behavior. A value of 0 indicates that `/_cluster/health/`` is failing.

Count

Minimum

DomainName, ClientId

Nodes

The number of nodes in the Amazon ES cluster, including dedicated master nodes and UltraWarm nodes

Count

Multi

DomainName, ClientId

Applicable

ReadIOPS

The number of input and output (I/O) operations per second for read operations on EBS volumes

Count/Second

Multi

DomainName, ClientId

ReadLatency

The latency for read operations on EBS volumes

Seconds

Multi

DomainName, ClientId

ReadThroughput

The throughput for read operations on EBS volumes

Bytes/Second

Multi

DomainName, ClientId

RequestCount

The number of requests made to the Elasticsearch cluster

Count

Sum

DomainName, ClientId

SearchLatency

Milliseconds

Multi

ClientId, DomainName

SearchableDocuments

The total number of searchable documents across all data nodes in the cluster

Count

Multi

DomainName, ClientId

WriteIOPS

The number of input and output (I/O) operations per second for write operations on EBS volumes

Count/Second

Multi

DomainName, ClientId

WriteLatency

The latency for write operations on EBS volumes

Seconds

Multi

DomainName, ClientId

WriteThroughput

The throughput for write operations on EBS volumes

Bytes/Second

Multi

DomainName, ClientId

Related tags
Infrastructure ObservabilityAWS