Confluent Cloud (Kafka) extension
- Latest Dynatrace
- Extension
- Published Oct 27, 2025
Remotely monitor your Confluent Cloud Kafka Clusters and other resources.
Get started
Monitor your Confluent Cloud Kafka Clusters, Connectors, Schema Registries, and KSQL DB Applications. Every minute, ingest the data on your Confluent Resources performance via the Confluent-provided API.
Overview
Use cases
- This extension provides monitoring of Confluent Cloud Resources via Confluent-provided API. For more information, see Details.
- Monitor the health state and performance of their Confluent Cloud Resources.
- Support analytics for for Ops, IT and Network Admins.
- Monitor infrastructure with a comprehensive dashboard.
- Detect usage anomalies and alert on them.
Requirements
- Confluent Cloud Resource(s).
- Cloud/Cluster API Key and Secret. See Authentication.
- The metrics in the
Kafka Lag Partition MetricsandKafka Lag Consumer Group Metricsfeature sets are not provided by the Confluent API. To obtain these metrics, you need Kafka Lag Exporter. The exporter isn't supported by Dynatrace and needs to be set up and run independently from this extension. Currently, it's the only exprter supported by this extension.
Activation and setup
-
Find the extension in Dynatrace Hub and add it to your environment.
-
Create a new monitoring configuration. For more information, see Manage Prometheus extensions
In the Dynatrace monitoring configuration, the Confluent Cloud API Key and API Secret are used as the Basic Auth User (API Key) /Password (API secret) combination.
Authentication
First you will need to create either a Cloud/Cluster API Key and Secret. This can be done via the Confluent UI or via their CLI. The MetricsViewer role is required to access the Confluent API. It is suggested to use the Organization scope for this role so it can be used as clusters are created or destroyed.
Extension endpoint
The endpoint for the extension is the a URL with your resource types and IDs at the end, similar to what is shown below. This URL supports multiple resources but we recommend to have between 5 and 10 per URL.
https://api.telemetry.confluent.cloud/v2/metrics/cloud/export?resource.kafka.id=lkc-XXXXX&resource.connector.id=lcc-XXXX1&resource.connector.id=lcc-XXXX2
Base URL
https://api.telemetry.confluent.cloud/v2/metrics/cloud/export?
-
Confluent Kafka Cluster
resource.kafka.id=lkc-XXXXX
-
Confluent Kafka Schema Registry
resource.schema_registry.id=lsrc=XXXXX
-
Confluent Kafka Connector
resource.connector.id=lcc-XXXXX
-
Confluent Kafka KSQL DB Application
resource.ksql.id=lksqlc-XXXXX
-
Confluent Kafka Compute Pool
resource.compute_pool.id=lfcp-XXXXX
Details
This extension uses the Confluent Metric Export API to gather metrics.
This API has a fixed 5 minute offset for which the extension currently does not account for. This leads to metrics being out of sync by 5 minutes between Dynatrace and Confluent. For more information see the Timestamp offset in the Confluent Metric Export API documentation.
Feature sets
When activating your extension using monitoring configuration, you can limit monitoring to one of the feature sets. To work properly, the extension has to collect at least one metric after the activation.
In highly segmented networks, feature sets can reflect the segments of your environment. Then, when you create a monitoring configuration, you can select a feature set and a corresponding ActiveGate group that can connect to this particular segment.
All metrics that aren't categorized into any feature set are considered to be the default and are always reported.
A metric inherits the feature set of a subgroup, which in turn inherits the feature set of a group. Also, the feature set defined on the metric level overrides the feature set defined on the subgroup level, which in turn overrides the feature set defined on the group level.
Flink Statement Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Flink Num Records In | confluent_flink_num_records_in | Total number of records this statement has received. |
| Confluent Flink Num Records Out | confluent_flink_num_records_out | Total number of records this task statement emitted. |
| Confluent Flink Pending Records | confluent_flink_pending_records | Total amount of available records after the consumer offset in a Kafka partition across all operators |
| Confluent Flink Current Input Watermark Milliseconds | confluent_flink_current_input_watermark_milliseconds | The last watermark this statement has received (in milliseconds) for the given table. |
| Confluent Flink Current Output Watermark Milliseconds | confluent_flink_current_output_watermark_milliseconds | The last watermark this statement has produced (in milliseconds) to the given table. |
| Confluent Flink Max Input Lateness Milliseconds | confluent_flink_max_input_lateness_milliseconds | The maximum observed lateness across all records processed in the last minute. A record is considered late if it has a timestamp less than or equal to the current watermark. |
| Confluent Flink Num Late Records In | confluent_flink_num_late_records_in | Total number of input records classified as late events. These are records whose timestamp is less than or equal to the current watermark. |
| Confluent Flink Num Records In From Files | confluent_flink_num_records_in_from_files | Total number of records this statement has read from Tableflow files. |
| Confluent Flink Num Records In From Topics | confluent_flink_num_records_in_from_topics | Total number of records this statement has read from Kafka topics. |
| Confluent Flink Operator State Size Bytes | confluent_flink_operator_state_size_bytes | The size in bytes of this operator state |
| Confluent Flink Statement Utilization CFU Minutes Consumed | confluent_flink_statement_utilization_cfu_minutes_consumed | The number of how many CFUs consumed since the last measurement |
| Confluent Flink Statement Utilization Current CFUS | confluent_flink_statement_utilization_current_cfus | The absolute number of CFUs at a given moment |
Compute Pool Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Flink Compute Pool Utilization Current CFUs | confluent_flink_compute_pool_utilization_current_cfus | The absolute number of CFUs at a given moment |
| Confluent Flink Compute Pool Utilization CFU Minutes Consumed | confluent_flink_compute_pool_utilization_cfu_minutes_consumed | The number of how many CFUs consumed since the last measurement |
| Confluent Flink Compute Pool Utilization CFU Limit | confluent_flink_compute_pool_utilization_cfu_limit | The possible max number of CFUs for the pool |
| Confluent Flink Materialized Table Utilization CFU Minutes Consumed | confluent_flink_materialized_table_utilization_cfu_minutes_consumed | The number of how many CFUs consumed since the last measurement |
| Confluent Flink Materialized Table Utilization Current CFUS | confluent_flink_materialized_table_utilization_current_cfus | The absolute number of CFUs at a given moment |
Connector Postgres CDC Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Connect Postgres CDC Source Connector Lag Milliseconds | confluent_kafka_connect_postgres_cdc_source_connector_lag_milliseconds | It is applicable only for Postgres CDC source V2 connector. It represents the number of milliseconds between the last change event's timestamp and the connector processing it. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Snapshot Aborted | confluent_kafka_connect_postgres_cdc_source_connector_snapshot_aborted | It is applicable only for Postgres CDC source connector. It represents whether the Snapshot is aborted. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Snapshot Completed | confluent_kafka_connect_postgres_cdc_source_connector_snapshot_completed | It is applicable only for Postgres CDC source connector. It represents whether the Snapshot is completed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Snapshot Milliseconds Since Last Event | confluent_kafka_connect_postgres_cdc_source_connector_snapshot_milliseconds_since_last_event | It is applicable only for Postgres CDC source connector. It represents the number of milliseconds since the last snapshot event was recorded. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Snapshot Paused Duration In Seconds | confluent_kafka_connect_postgres_cdc_source_connector_snapshot_paused_duration_in_seconds | It is applicable only for Postgres CDC source connector. It represents the total paused duration of the snapshot in seconds. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Snapshot Running | confluent_kafka_connect_postgres_cdc_source_connector_snapshot_running | It is applicable only for Postgres CDC source connector. It represents whether the Snapshot is running. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Snapshot Total Number Of Events Seen | confluent_kafka_connect_postgres_cdc_source_connector_snapshot_total_number_of_events_seen | It is applicable only for Postgres CDC source connector. It represents the total number of events that this connector has seen since last started or reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Streaming Number Of Committed Transactions | confluent_kafka_connect_postgres_cdc_source_connector_streaming_number_of_committed_transactions | It is applicable only for Postgres CDC source connector. It represents the number of processed transactions that were committed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect Postgres CDC Source Connector Streaming Total Number Of Events Seen | confluent_kafka_connect_postgres_cdc_source_connector_streaming_total_number_of_events_seen | It is applicable only for Postgres CDC source connector. It represents the total number of data change events reported by the source database since the last connector start, or since a metrics reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
Server Principal ID Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Cluster Request Bytes | confluent_kafka_server_request_bytes | The delta count of total request bytes from the specified request types sent over the network. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds. |
| Kafka Cluster Response Bytes | confluent_kafka_server_response_bytes | The delta count of total response bytes from the specified response types sent over the network. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds. |
| Kafka Cluster Active Connection Count | confluent_kafka_server_active_connection_count.gauge | The count of active authenticated connections. |
| Kafka Cluster Request Count | confluent_kafka_server_request_count.gauge | The number of requests received over the network. |
| Kafka Cluster Successful Authentication Count | confluent_kafka_server_successful_authentication_count.gauge | The number of successful authentications. |
Kafka Lag Consumer Group Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Consumer Group Group Topic Sum Lag | kafka_consumergroup_group_topic_sum_lag | Sum of group offset lag across topic partitions |
| Kafka Consumer Group Poll Time (ms) | kafka_consumergroup_poll_time_ms | Group poll time |
| Kafka Consumer Group Group Offset | kafka_consumergroup_group_offset | Last group consumed offset of a partition |
| Kafka Consumer Group Group Sum Lag | kafka_consumergroup_group_sum_lag | Sum of group offset lag |
| Kafka Consumer Group Group Lag | kafka_consumergroup_group_lag | Group offset lag of a partition |
| Kafka Consumer Group Group Lag Seconds | kafka_consumergroup_group_lag_seconds | Group time lag of a partition |
| Kafka Consumer Group Group Max Lag | kafka_consumergroup_group_max_lag | Max group offset lag |
| Kafka Consumer Group Group Max Lag Seconds | kafka_consumergroup_group_max_lag_seconds | Max group time lag |
Streams Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Streams Block Cache Usage | confluent_kafka_streams_block_cache_usage | The percentage of RocksDB block cache usage |
| Confluent Kafka Streams Commit Ratio | confluent_kafka_streams_commit_ratio | The amount of time the thread spent committing records |
| Confluent Kafka Streams Estimate Num Keys | confluent_kafka_streams_estimate_num_keys | The estimate of the number of keys |
| Confluent Kafka Streams Kafka Streams Client State | confluent_kafka_streams_kafka_streams_client_state | The current state of a KafkaStreams client. |
| Confluent Kafka Streams Node E2e Latency Max | confluent_kafka_streams_node_e2e_latency_max | The maximum end-to-end latency of a processor node. |
| Confluent Kafka Streams Node E2e Latency Min | confluent_kafka_streams_node_e2e_latency_min | The minimum end-to-end latency of a processor node. |
| Confluent Kafka Streams Poll Ratio | confluent_kafka_streams_poll_ratio | The amount of time the thread spent polling records |
| Confluent Kafka Streams Process Ratio | confluent_kafka_streams_process_ratio | The amount of time the thread spent processing records |
| Confluent Kafka Streams Punctuate Ratio | confluent_kafka_streams_punctuate_ratio | The amount of time the thread spent executing punctuators |
| Confluent Kafka Streams Recording Level | confluent_kafka_streams_recording_level | The metrics recording level for a KafkaStreams client. |
| Confluent Kafka Streams Size All Mem Tables Bytes | confluent_kafka_streams_size_all_mem_tables_bytes | The size of all RocksDB mem tables in bytes |
| Confluent Kafka Streams Thread Thread State | confluent_kafka_streams_thread_thread_state | The current state of a StreamThread. |
Connector MySQL CDC Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Connect MySQL CDC Source Connector Lag Milliseconds | confluent_kafka_connect_mysql_cdc_source_connector_lag_milliseconds | It is applicable only for MySQL CDC source V2 connector. It represents the number of milliseconds between the last change event's timestamp and the connector processing it. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Schema History Status | confluent_kafka_connect_mysql_cdc_source_connector_schema_history_status | It is applicable only for MySQL CDC source connector. It represents the status of the schema history of the connector. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Snapshot Aborted | confluent_kafka_connect_mysql_cdc_source_connector_snapshot_aborted | It is applicable only for MySQL CDC source V2 connector. It represents whether the Snapshot is aborted. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Snapshot Completed | confluent_kafka_connect_mysql_cdc_source_connector_snapshot_completed | It is applicable only for MySQL CDC source connector. It represents whether the Snapshot is completed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Snapshot Milliseconds Since Last Event | confluent_kafka_connect_mysql_cdc_source_connector_snapshot_milliseconds_since_last_event | It is applicable only for MySQL CDC source V2 connector. It represents the number of milliseconds since the last snapshot event was recorded. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Snapshot Paused Duration In Seconds | confluent_kafka_connect_mysql_cdc_source_connector_snapshot_paused_duration_in_seconds | It is applicable only for MySQL CDC source V2 connector. It represents the total paused duration of the snapshot in seconds. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Snapshot Running | confluent_kafka_connect_mysql_cdc_source_connector_snapshot_running | It is applicable only for MySQL CDC source connector. It represents whether the Snapshot is running. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Snapshot Total Number Of Events Seen | confluent_kafka_connect_mysql_cdc_source_connector_snapshot_total_number_of_events_seen | It is applicable only for MySQL CDC source V2 connector. It represents the total number of events that this connector has seen since last started or reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Streaming Number Of Committed Transactions | confluent_kafka_connect_mysql_cdc_source_connector_streaming_number_of_committed_transactions | It is applicable only for MySQL CDC source V2 connector. It represents the number of processed transactions that were committed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Streaming Number Of Disconnects | confluent_kafka_connect_mysql_cdc_source_connector_streaming_number_of_disconnects | It is applicable only for MySQL CDC source V2 connector. It represents the number of disconnects by the connector. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Streaming Number Of Large Transactions | confluent_kafka_connect_mysql_cdc_source_connector_streaming_number_of_large_transactions | It is applicable only for MySQL CDC source V2 connector. It represents the number of transactions that have not fit into the look-ahead buffer. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Streaming Number Of Rolled Back Transactions | confluent_kafka_connect_mysql_cdc_source_connector_streaming_number_of_rolled_back_transactions | It is applicable only for MySQL CDC source V2 connector. It represents the number of processed transactions that were rolled back and not streamed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Streaming Number Of Skipped Events | confluent_kafka_connect_mysql_cdc_source_connector_streaming_number_of_skipped_events | It is applicable only for MySQL CDC source V2 connector. It represents the number of events that have been skipped by the connector. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MySQL CDC Source Connector Streaming Total Number Of Events Seen | confluent_kafka_connect_mysql_cdc_source_connector_streaming_total_number_of_events_seen | It is applicable only for MySQL CDC source V2 connector. It represents the total number of data change events reported by the source database since the last connector start, or since a metrics reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
KSQL Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Ksql Streaming Unit Count | confluent_kafka_ksql_streaming_unit_count.gauge | The count of Confluent Streaming Units (CSUs) for this KSQL instance. The implicit time aggregation for this metric is MAX. |
| Kafka Ksql Query Saturation | confluent_kafka_ksql_query_saturation | The maximum saturation for a given ksqlDB query across all nodes. Returns a value between 0 and 1, a value close to 1 indicates that ksqlDB query processing is bottlenecked on available resources. |
| Kafka Ksql Task Stored Bytes | confluent_kafka_ksql_task_stored_bytes | The size of a given task's state stores in bytes. |
| Kafka Ksql Storage Utilization | confluent_kafka_ksql_storage_utilization | The total storage utilization for a given ksqlDB application. |
| Confluent Kafka Ksql Committed Offset Lag | confluent_kafka_ksql_committed_offset_lag | The current lag between the committed offset and end offset for a given query/task/topic/offset. |
| Confluent Kafka Ksql Consumed Total Bytes | confluent_kafka_ksql_consumed_total_bytes | The delta count of bytes consumed from Kafka by continuous queries over the requested period |
| Confluent Kafka Ksql Node Query Saturation | confluent_kafka_ksql_node_query_saturation | The saturation for a given ksqlDB query on this ksqlDB node. Returns a value between 0 and 1, a value close to 1 indicates that ksqlDB query processing is bottlenecked on available resources. |
| Confluent Kafka Ksql Offsets Processed Total | confluent_kafka_ksql_offsets_processed_total | The delta count of offsets processed by a given query/task/topic/offset. |
| Confluent Kafka Ksql Processing Errors Total | confluent_kafka_ksql_processing_errors_total | Delta count of the number of record processing errors of a query over the requested period |
| Confluent Kafka Ksql Produced Total Bytes | confluent_kafka_ksql_produced_total_bytes | The delta count of bytes produced to Kafka by continuous queries over the requested period |
| Confluent Kafka Ksql Query Restarts | confluent_kafka_ksql_query_restarts | Delta count of the number of failures that cause a query to restart over the requested period |
Connector Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Connect Sent Records | confluent_kafka_connect_sent_records | The delta count of total number of records sent from the transformations and written to Kafka for the source connector. Each sample is the number of records sent since the previous data point. |
| Kafka Connect Received Records | confluent_kafka_connect_received_records | The delta count of total number of records received by the sink connector. Each sample is the number of records received since the previous data point. |
| Kafka Connect Sent Bytes | confluent_kafka_connect_sent_bytes | The delta count of total bytes sent from the transformations and written to Kafka for the source connector. Each sample is the number of bytes sent since the previous data point. |
| Kafka Connect Received Bytes | confluent_kafka_connect_received_bytes | The delta count of total bytes received by the sink connector. Each sample is the number of bytes received since the previous data point. |
| Kafka Connect Dead Letter Queue Records | confluent_kafka_connect_dead_letter_queue_records | The delta count of dead letter queue records written to Kafka for the sink connector. |
| Confluent Kafka Connect Connector Status | confluent_kafka_connect_connector_status | This metric monitors the status of a connector within the system. Its value is always set to 1, signifying the connector's presence. The connector's current operational state is identified through the metric.status tag. |
| Confluent Kafka Connect Connector Task Batch Size Avg | confluent_kafka_connect_connector_task_batch_size_avg | Monitors the average batch size (measured by record count) per minute. For a source connector, it indicates the average batch size sent to Kafka. For a sink connector, it indicates the average batch size read by the sink task. |
| Confluent Kafka Connect Connector Task Batch Size Max | confluent_kafka_connect_connector_task_batch_size_max | Monitors the maximum batch size (measured by record count) per minute. For a source connector, it indicates the max batch size sent to Kafka. For a sink connector, it indicates the max batch size read by the sink task. |
| Confluent Kafka Connect Connector Task Status | confluent_kafka_connect_connector_task_status | This metric monitors the status of a connector's task within the system. Its value is always set to 1, signifying the connector task's presence. The connector's current operational state is identified through the metric.status tag. |
| Confluent Kafka Connect Records Lag Max | confluent_kafka_connect_records_lag_max | The max number of records the sink connector is behind among all partitions. The count is sampled every 60 seconds. |
| Confluent Kafka Connect Sink Task Put Batch Avg Time Milliseconds | confluent_kafka_connect_sink_task_put_batch_avg_time_milliseconds | The average time it takes to put a batch of records to the sink. The average is calculated per minute. |
| Confluent Kafka Connect Sink Task Put Batch Max Time Milliseconds | confluent_kafka_connect_sink_task_put_batch_max_time_milliseconds | The maximum time it takes to put a batch of records to the sink. The max is calculated per minute. |
Server Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Cluster Received Bytes | confluent_kafka_server_received_bytes | The number of bytes of the customer's data received from the network. |
| Kafka Cluster Sent Bytes | confluent_kafka_server_sent_bytes | The number of bytes of the customer's data sent over the network. |
| Kafka Cluster Received Records | confluent_kafka_server_received_records | The number of records received. |
| Kafka Cluster Sent Records | confluent_kafka_server_sent_records | The number of records sent. |
| Kafka Cluster Retained Bytes | confluent_kafka_server_retained_bytes | The current number of bytes retained by the cluster. |
| Kafka Cluster Partition Count | confluent_kafka_server_partition_count.gauge | The number of partitions. |
| Kafka Cluster Load Raw | confluent_kafka_server_cluster_load_percent | A measure of the utilization of the cluster. The value is between 0.0 and 1.0. |
| Confluent Kafka Server Cluster Load Percent Avg | confluent_kafka_server_cluster_load_percent_avg | A measure of the average utilization across the cluster. The value is between 0.0 and 1.0. This metric is applicable for only Dedicated SKU clusters. |
| Confluent Kafka Server Cluster Load Percent Max | confluent_kafka_server_cluster_load_percent_max | A measure of the maximum broker utilization across the cluster. The value is between 0.0 and 1.0. This metric is applicable for only Dedicated SKU clusters. |
| Confluent Kafka Server Connection Info | confluent_kafka_server_connection_info | Client connection metadata. |
| Confluent Kafka Server Created Acls Count Per Tenant | confluent_kafka_server_created_acls_count_per_tenant | The number of acls created by a tenant. The count is sampled every 60 seconds. The implicit time aggregation for this metric is MAX. |
| Confluent Kafka Server Dedicated CKU Count | confluent_kafka_server_dedicated_cku_count_gauge | CKU count of a dedicated cluster. This metric is applicable for only Dedicated SKU clusters. |
| Confluent Kafka Server Elastic CKU Count | confluent_kafka_server_elastic_cku_count_gauge | Elastic CKU count. This metric is applicable for all clusters except Dedicated SKU clusters. |
| Confluent Kafka Server Deprecated Request Count | confluent_kafka_server_deprecated_request_count_gauge | The delta count of deprecated requests received over the network. Each sample is the number of requests received since the previous data point. The count is sampled every 60 seconds. |
| Confluent Kafka Server Hot Partition Egress | confluent_kafka_server_hot_partition_egress | An indicator of the presence of a hot partition caused by egress throughput. The value is 1.0 when a hot partition is detected, and empty when there is no hot partition detected |
| Confluent Kafka Server Hot Partition Ingress | confluent_kafka_server_hot_partition_ingress | An indicator of the presence of a hot partition caused by ingress throughput. The value is 1.0 when a hot partition is detected, and empty when there is no hot partition detected |
| Confluent Kafka Server Producer Latency Avg Milliseconds | confluent_kafka_server_producer_latency_avg_milliseconds | The average latency of client producer request. |
| Confluent Kafka Server Rest Produce Request Bytes | confluent_kafka_server_rest_produce_request_bytes | The delta count of total request bytes from Kafka REST produce calls sent over the network requested by Kafka REST. |
Cluster Link Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Server Cluster Link Destination Response Bytes | confluent_kafka_server_cluster_link_destination_response_bytes | The delta count of cluster linking response bytes from all request types. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds. |
| Kafka Server Cluster Link Source Response Bytes | confluent_kafka_server_cluster_link_source_response_bytes | The delta count of cluster linking source response bytes from all request types. Each sample is the number of bytes sent since the previous data point. The count is sampled every 60 seconds. |
| Kafka Server Cluster Link Count | confluent_kafka_server_cluster_link_count.gauge | The current count of cluster links. The count is sampled every 60 seconds. The implicit time aggregation for this metric is MAX. |
| Kafka Server Cluster Link Mirror Topic Count | confluent_kafka_server_cluster_link_mirror_topic_count.gauge | The cluster linking mirror topic count for a link. The count is sampled every 60 seconds. |
| Kafka Server Cluster Link Mirror Topic Offset Lag | confluent_kafka_server_cluster_link_mirror_topic_offset_lag | The cluster linking mirror topic offset lag maximum across all partitions. The lag is sampled every 60 seconds. |
| Kafka Server Cluster Link Mirror Topic Bytes | confluent_kafka_server_cluster_link_mirror_topic_bytes | The delta count of cluster linking mirror topic bytes. The count is sampled every 60 seconds. |
| Confluent Kafka Server Cluster Link Mirror Transition In Error | confluent_kafka_server_cluster_link_mirror_transition_in_error | The cluster linking mirror topic state transition error count for a link. The count is sampled every 60 seconds. |
| Confluent Kafka Server Cluster Link Task Count | confluent_kafka_server_cluster_link_task_count_gauge | The current count of cluster links tasks. The count is sampled every 60 seconds. The implicit time aggregation for this metric is MAX. |
Connector Oracle CDC Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Connect Oracle CDC Source Connector Lag Milliseconds | confluent_kafka_connect_oracle_cdc_source_connector_lag_milliseconds | It is applicable only for Oracle CDC source connector. It represents the number of milliseconds between the last change event's timestamp and the connector processing it. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
Kafka Lag Partition Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Partition Earliest Offset | kafka_partition_earliest_offset | Earliest offset of a partition |
| Kafka Partition Latest Offset | kafka_partition_latest_offset | Latest offset of a partition |
Connector SQL Server CDC Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Connect SQL Server CDC Source Connector Lag Milliseconds | confluent_kafka_connect_sql_server_cdc_source_connector_lag_milliseconds | It is applicable only for SQL Server CDC source V2 connector. It represents the number of milliseconds between the last change event's timestamp and the connector processing it. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Schema History Status | confluent_kafka_connect_sql_server_cdc_source_connector_schema_history_status | It is applicable only for SQL Server CDC source connector. It represents the status of the schema history of the connector. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Snapshot Aborted | confluent_kafka_connect_sql_server_cdc_source_connector_snapshot_aborted | It is applicable only for SQL Server CDC source V2 connector. It represents whether the Snapshot is aborted. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Snapshot Completed | confluent_kafka_connect_sql_server_cdc_source_connector_snapshot_completed | It is applicable only for SQL Server CDC source connector. It represents whether the Snapshot is completed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Snapshot Milliseconds Since Last Event | confluent_kafka_connect_sql_server_cdc_source_connector_snapshot_milliseconds_since_last_event | It is applicable only for SQL Server CDC source V2 connector. It represents the number of milliseconds since the last snapshot event was recorded. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Snapshot Paused Duration In Seconds | confluent_kafka_connect_sql_server_cdc_source_connector_snapshot_paused_duration_in_seconds | It is applicable only for SQL Server CDC source V2 connector. It represents the total paused duration of the snapshot in seconds. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Snapshot Running | confluent_kafka_connect_sql_server_cdc_source_connector_snapshot_running | It is applicable only for SQL Server CDC source connector. It represents whether the Snapshot is running. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Snapshot Total Number Of Events Seen | confluent_kafka_connect_sql_server_cdc_source_connector_snapshot_total_number_of_events_seen | It is applicable only for SQL Server CDC source V2 connector. It represents the total number of events that this connector has seen since last started or reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Streaming Number Of Committed Transactions | confluent_kafka_connect_sql_server_cdc_source_connector_streaming_number_of_committed_transactions | It is applicable only for SQL Server CDC source V2 connector. It represents the number of processed transactions that were committed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect SQL Server CDC Source Connector Streaming Total Number Of Events Seen | confluent_kafka_connect_sql_server_cdc_source_connector_streaming_total_number_of_events_seen | It is applicable only for SQL Server CDC source V2 connector. It represents the total number of data change events reported by the source database since the last connector start, or since a metrics reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
Server Consumer Lag Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Server Consumer Lag Offsets | confluent_kafka_server_consumer_lag_offsets | The lag between a group member's committed offset and the partition's high watermark |
| Kafka Server Share Lag Offsets | confluent_kafka_server_share_lag_offsets | The number of offsets in a partition that are not delivery complete. |
| Confluent Kafka Server Max Pending Rebalance Time Milliseconds | confluent_kafka_server_max_pending_rebalance_time_milliseconds | The maximum pending rebalance time in ms among all members of a consumer group. |
Flink Statement Status
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Flink Statement Status | confluent_flink_statement_status | This metric monitors the status of a statement within the system. Its value is always set to 1, signifying the statement's presence. The statement's current operational state is identified through the metric.status tag. |
Connector DynamoDB CDC Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Connect DynamoDB CDC Source Connector Lag Milliseconds | confluent_kafka_connect_dynamodb_cdc_source_connector_lag_milliseconds | It is applicable only for DynamoDB CDC source connector. It represents the number of milliseconds between the last change event's timestamp and the connector processing it. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
Connector MariaDB CDC Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Confluent Kafka Connect MariaDB CDC Source Connector Snapshot Aborted | confluent_kafka_connect_mariadb_cdc_source_connector_snapshot_aborted | It is applicable only for MariaDB CDC source V2 connector. It represents whether the Snapshot is aborted. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Snapshot Milliseconds Since Last Event | confluent_kafka_connect_mariadb_cdc_source_connector_snapshot_milliseconds_since_last_event | It is applicable only for MariaDB CDC source V2 connector. It represents the number of milliseconds since the last snapshot event was recorded. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Snapshot Paused Duration In Seconds | confluent_kafka_connect_mariadb_cdc_source_connector_snapshot_paused_duration_in_seconds | It is applicable only for MariaDB CDC source V2 connector. It represents the total paused duration of the snapshot in seconds. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Snapshot Total Number Of Events Seen | confluent_kafka_connect_mariadb_cdc_source_connector_snapshot_total_number_of_events_seen | It is applicable only for MariaDB CDC source V2 connector. It represents the total number of events that this connector has seen since last started or reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Streaming Number Of Committed Transactions | confluent_kafka_connect_mariadb_cdc_source_connector_streaming_number_of_committed_transactions | It is applicable only for MariaDB CDC source V2 connector. It represents the number of processed transactions that were committed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Streaming Number Of Disconnects | confluent_kafka_connect_mariadb_cdc_source_connector_streaming_number_of_disconnects | It is applicable only for MariaDB CDC source V2 connector. It represents the number of disconnects by the connector. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Streaming Number Of Large Transactions | confluent_kafka_connect_mariadb_cdc_source_connector_streaming_number_of_large_transactions | It is applicable only for MariaDB CDC source V2 connector. It represents the number of transactions that have not fit into the look-ahead buffer. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Streaming Number Of Rolled Back Transactions | confluent_kafka_connect_mariadb_cdc_source_connector_streaming_number_of_rolled_back_transactions | It is applicable only for MariaDB CDC source V2 connector. It represents the number of processed transactions that were rolled back and not streamed. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Streaming Number Of Skipped Events | confluent_kafka_connect_mariadb_cdc_source_connector_streaming_number_of_skipped_events | It is applicable only for MariaDB CDC source V2 connector. It represents the number of events that have been skipped by the connector. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
| Confluent Kafka Connect MariaDB CDC Source Connector Streaming Total Number Of Events Seen | confluent_kafka_connect_mariadb_cdc_source_connector_streaming_total_number_of_events_seen | It is applicable only for MariaDB CDC source V2 connector. It represents the total number of data change events reported by the source database since the last connector start, or since a metrics reset. The values will incorporate any differences between the clocks on the machines where the database server and the connector are running. |
Schema Registry Metrics
| Metric name | Metric key | Description |
|---|---|---|
| Kafka Schema Registry Schema Count | confluent_kafka_schema_registry_schema_count.gauge | The number of registered schemas. |
| Kafka Schema Registry Request Count | confluent_kafka_schema_registry_request_count.gauge | The delta count of requests received by the schema registry server. Each sample is the number of requests received since the previous data point. The count sampled every 60 seconds. |
| Confluent Kafka Schema Registry Exporter Starting Progress | confluent_kafka_schema_registry_exporter_starting_progress | The progress of the schema registry exporter in the starting phase. The value is between 0 and 100, representing the measure of the exporter's job progress. |
| Confluent Kafka Schema Registry Exporter Tasks | confluent_kafka_schema_registry_exporter_tasks | The number of schema exporters, based on their status - one of RUNNING, STARTING or PAUSED. |
| Confluent Kafka Schema Registry Num Deks | confluent_kafka_schema_registry_num_deks | The number of data encryption keys. |
| Confluent Kafka Schema Registry Num Keks | confluent_kafka_schema_registry_num_keks | The number of key encryption keys. |
| Confluent Kafka Schema Registry Num Keks Shared | confluent_kafka_schema_registry_num_keks_shared | The number of key encryption keys shared with Confluent. |
| Confluent Kafka Schema Registry Schema Operations Count | confluent_kafka_schema_registry_schema_operations_count_gauge | The delta count of schema related operations (create, delete and read). Each sample is the number of requests received since the previous data point. The count sampled every 60 seconds. |
| Confluent Kafka Schema Registry Schema Transfer Success Total | confluent_kafka_schema_registry_schema_transfer_success_total | The count/number of successful schemas registered by each exporter. Each sample represents the cumulative number of schemas transferred. The count is sampled every 60 seconds. |
Related tags
ApplicationPrometheusStreaming platformConfluentApplication Observability