Try it free

Cloud provider log forwarding

  • Latest Dynatrace
  • Tutorial
  • 4-min read

You can configure cloud log forwarding to stream the following log data to Dynatrace using API:

  • Amazon Web Services
    Stream or forward your logs from Amazon CloudWatch, AWS S3 or other AWS sources.

  • Microsoft Azure
    Forward Azure logs to Dynatrace via Azure Event Hubs with the serverless integration.

  • Google Cloud
    After running the deployment script in Google Cloud Shell, you'll get metrics, logs, dashboards, and alerts for your configured services in Dynatrace.

Amazon Web Services

Stream or forward your logs from Amazon CloudWatch, AWS S3 or other AWS sources.

Serverless CloudWatch Logs integration

Our guided flow allows you to create an AWS connection. In this process, the CloudFormation stack creates a Firehose stream per enabled monitored AWS region.

Amazon Data Firehose allows you to create a fully managed, serverless log pipeline that sends logs to the Dynatrace OpenPipeline. This architecture:

  • Allows swift registration of AWS log producers with little effort.
  • Auto-scales to meet log throughput demand and can efficiently handle back-pressure with configurable buffers and a smart retry policy.

For more details, see AWS logs.

Serverless S3 Log Forwarder

The Dynatrace S3 log forwarder ships logs to Dynatrace directly from one or more Amazon S3 buckets using an event-driven AWS Lambda function that you deploy in your own AWS account. It supports CloudTrail, VPC Flow Logs, ELB, CloudFront, and more, with automatic entity linking.

For more details, see Ingest AWS logs from Amazon S3.

Stream logs via Amazon Data Firehose

Dynatrace integration with Amazon Data Firehose provides a simple and safe way to ingest AWS logs.

To enable AWS log forwarding,

  1. Create Amazon Data Firehose instance.
  2. Configure it with your Dynatrace environment as a destination.
  3. Connect your CloudWatch log groups by creating a subscription filter or send logs directly to Firehose from services that support it (for example, VPC Flow Logs). Firehose and other created cloud resources incur AWS costs according to the standard AWS billing policy.

Microsoft Azure

Serverless Azure logs integration

The new Azure log and event ingest solution is a SaaS-based approach for collecting Azure platform logs.

While onboarding your Azure environment for Dynatrace monitoring, we deploy the required Azure Event Hubs used by Microsoft for log and event forwarding. Dynatrace automatically discovers and connects to these Azure Event Hubs and starts to pull logs and events, removing the need to host, scale, or maintain any custom function code.

For more details, see Forward Azure logs.

Google Cloud

To set up Google Cloud monitoring for metrics and logs, you'll run the deployment script in Google Cloud Shell. During setup, a new Pub/Sub subscription will be created. GKE will run two containers: a metric forwarder and a log forwarder. After installation, you'll get metrics, logs, dashboards, and alerts for your configured services in Dynatrace. Instructions will depend on the location where you want the deployment script to run:

  • On a new GKE Autopilot cluster created automatically. Recommended
  • On an existing GKE standard or GKE Autopilot cluster.

Depending on where you want log ingestion to be performed, you may need additional resources. For example, for Managed deployments, there is a possibility to use an AG for log ingestion. But you have to do it manually since the installation script does not deploy it.

For all log ingestion options, see Log ingestion.

Related topics

  • Log Analytics overview (DPS)
Related tags
Log Analytics