Dynatrace Managed release notes version 1.172

New features and enhancements

Receive notifications when your quota of Digital Experience Monitoring (DEM) units runs low

We want to make sure that monitoring of your applications’ digital experience isn’t stopped due to your license running short of DEM units. Dynatrace Managed now notifies you when you’ve consumed 90% of your licensed DEM unit quota. With this approach, your cluster administrator can pro-actively adjust your licensed monthly or annual DEM unit quota. See example notification below, stating that 90% of the allotted DEM units have been consumed

DEM nearly exhausted

Once the quota limit is reached, the notification changes, letting you know that DEM has been disabled:

DEM license exhausted and DEM disabled

Once the quota has been adjusted, notifications for all affected users are removed automatically. Note that these notifications are only triggered for DEM licenses. Notifications for other monitoring unit types, such as host units, custom metrics, and Log Analytics, will be added in future releases.

Configuration changes are now listed in audit log files

Transparency and traceability of configuration changes are key to managing large Dynatrace installations and enabling multiple teams to collaborate effectively. Dynatrace provides a set of audit logs that help you understand all configuration changes that have been made to each Dynatrace cluster.

Dynatrace Managed already exposes configuration changes via the Cluster Management Console. As of version 1.172, all changes made to a cluster configuration or an environment setting are stored to an audit log file. This enables processing by log management tools or automated scripts so that proper notifications can be set up.

Audit logs are stored at the cluster nodes where system changes are executed. To see the complete picture of all changes that have occurred across all nodes, you need to process audit logs from all nodes. Audit logs are available on individual nodes at DATASTORE_PATH/log/server.

In Dynatrace Managed 1.172, we introduce yet another set of audit logs: Configuration changes. See the audit log example below that shows a change of maintenance window:

audit.config.change.0.0.log

2019-06-20 04:49:09 UTC {"eventType":"CONFIG_UPDATE","tenantId":"xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx","userId":"unknown","userIdType":"USER_NAME","userOrigination":"unknown","sessionId":null,"identity":"ConfigIdentifier{configType=ONPREM_AUTOMATIC_UPDATES, identifier=ONPREM_AUTOMATIC_UPDATES}","identityCategory":"CONFIG_UPDATE","success":true,"timestamp":1561006149672,"message":"{\"jsonPatch\":\"[{\\\"op\\\":\\\"replace\\\",\\\"path\\\":\\\"/scheduledAutomaticUpgradeTime\\\",\\\"value\\\":1561006149661}]\"}"}

Audit logs open up a whole new set of use cases for custom notifications with log monitoring tools. We’ll describe some of these use cases in an upcoming blog post.

Improved cluster resilience and lower disk space requirements

Dynatrace can optimize the processing of monitored data to improve scaling, automatically control performance of OneAgents, or enable new features when all running OneAgents versions are capable of supporting them. From now on, Dynatrace will independently adjust its configuration to enable these features.

Based on OneAgent activity for the past 30 days, the configuration is adjusted for each monitoring environment that runs on your cluster. Additionally, OneAgent installation packages that are no longer in use will be removed and the disk space will be freed up (which means that earlier OneAgent versions won’t be able to connect or send data).

Other improvements

  • To improve cluster resilience and shorten upgrade time, Cassandra and Elasticsearch will only be restarted in case of configuration changes or binary upgrades. During the upgrade to Managed version 1.172, only Cassandra won’t be restarted
  • We now use standardized HTTP response codes for more robust downloading of update packages sent via URL in email notifications
  • Manual upgrade using --upgrade now upgrades all components including NodeKeeper
  • 3rd part libraries and dependencies were updated. See the THIRDPARTYLICENSEREADME.txt file available at each node's root installation directory
  • Elasticsearch has been updated to version 6.2.4 that improves performance and resilience mainly around user sessions
  • License-related email notifications were updated with language fixes and footer content,

See additional steps required for manual update to Dynatrace Managed version 1.172.

All new features introduced with Dynatrace SaaS version 1.171 and version 1.172 are now also supported by Dynatrace Managed.

Resolved issues

Dynatrace Managed General Availability (Build .172)

The Dynatrace Managed .172 GA release contains 22 resolved issues.

Cluster

  • Environment ID not appearing in the URL. (APM-177194)

ON-PREM Installer

  • If a backup path becomes empty e.g. backup disabled, that value is not imported by the installer and it thinks that this path is still set. (APM-178070)
  • Nodekeeper upgrade failure should be reported as an error instead of a warning. (APM-178273)
  • Misconfigured symlink to /opt/dynatrace/oneagent that points to /opt/dynatrace directory might remove Dynatrace installation files. (APM-179857)
  • Typos in Managed installation output. (APM-180282)
  • Elasticsearch backups failed - path.repo not being populated. (APM-184086)
  • Config directory should be added to backup archive creation procedure. (APM-184124)
  • Upgrade with custom settings fails if nothing was customized. (APM-184256)
  • Cassandra restore is not working. (APM-184827)
  • Custom settings should be applied to current version of config files instead of the default one. (APM-184936)

ON-PREM

  • Groups with no permissions assigned that were colored dark gray are now same color as other groups. (APM-177570)
  • Synthetic quota limit for an environment should be hidden if synthetic is not licensed at all. (APM-178684)
  • All labels for Log Monitoring upload volume were updated to "GiB" instead of "GB" to mark that base for calculation is 1024. (APM-179461)
  • All disk utilization values in Node details page should be calculated with 1024 base. (APM-179539)
  • LDAP group names validation was improved so it supports names with only non-latin characters. (APM-179858)
  • Technical Difficulties Page should no longer appear when triggering upgrade manually from UI page. (APM-180577)
  • UI pages should now be refreshed even if an error was returned to load the data. (APM-181400)
  • Managed cluster expired - warning messages on tenants. (APM-184629)
  • When Mission Control was under maintenance all update packages were re-downloaded. (APM-181189)

ON-PREM Console

  • When a cluster was down for some time it might have happened that it missed to download some updates. They were downloaded after some time. (APM-179605)
  • When downloading manually update packages from URLs received via e-mail, you can hit HTTP 429 error in case our server is too busy to serve that resource. In that case, try again later. (APM-179986)
  • Synthetic module update packages should not be downloaded in version higher than ActiveGate. (APM-178861)

Dynatrace SaaS General Availability (Build .171)

The Dynatrace SaaS .171 GA release contains 120 resolved issues.

Cluster

  • DB Insights Early Access Program: Oracle database monitoring would leak memory into Oracle PGA at a rate of 1 MB / 15 minutes, possibly indefinitely. This fix resolves the memory leak by recreating JDBC connections as soon as the leaking V$SQLAREA query was used. The issue is caused by Oracle V$SQLAREA implementation. Implemented fix which causes the JDBC connection to be closed as soon as the leaking views are invoked. Thus the memory is freed immediately and no leak appears. (APM-177552)
  • DB Insights Early Access Program: SQL query parameters are masked out with a [L] (L for 'Literal') symbol. This prevents inadvertant display of sensitive data, like customer ids and others. (APM-170914)
  • HTTP monitor indicates availability issue instead of performance threshold. (APM-174306)
  • Synthetic Http Monitor Request body change does not trigger Save Button. (APM-177637)
  • While HTTP monitor configuration can not delete all headers from a request. (APM-178239)
  • Azure - add switch to disable auto tags. (APM-179431)
  • Citrix PG - type name displays "Other". (APM-177488)
  • Remove beta from AIX oneAgent install page. (APM-179761)
  • Add a PHP NG Beta switch to the "New Agent Features" page. (APM-174171)
  • Enable monitoring overview index usage. (APM-177504)
  • Deployment status - improve performance with filtering based on indexes. (APM-167789)
  • Network overview - use indexes. (APM-167776)
  • Hypervisor Details page - "Smartscape view" button sometimes is moved to context menu. (APM-177023)
  • New Technology overview: inconsistent wording of custom device groups (group vs. process group). (APM-177094)
  • Show alerts on Azure Dashboard - section's tab coloring improvement. (APM-177410)
  • Technologies Overview page is empty. (APM-177491)
  • Issue with downloading oneAgent version 1.167.176 when global settings have a different standard version. (APM-177642)
  • TDP after expanding a process (Cannot read property 'Rfc' of undefined). (APM-177697)
  • No processes listed after drilling down from CF dashboard. (APM-178026)
  • SmartScape - Azure VM link leads to Azure Dashboard. (APM-178831)
  • Investigate high number of queried host instances in StartScreenTileStateProvider. (APM-178685)
  • AWS Relational Database Services Connections metric is unusable. (APM-178756)
  • Docker images and services tables - broken tab header. (APM-178829)
  • Duplicate AWS credentials. (APM-178788)
  • Use label and icon for known technology in CDG details when plugin tech matches known one. (APM-178811)
  • Prepare docker overview for large number of entities. (APM-178611)
  • Technology tiles not longer marked as affected. (APM-178902)
  • Monitoring overview filter suggestions missing timeframe. (APM-179029)
  • Deployment REST API (/agents) returns 500 in some cases. (APM-179035)
  • PGI dashboard - rename go metric "502 responses" as "bad gateway". (APM-179072)
  • PHP NG always presented as OFF on global settings page. (APM-179535)
  • MZ for AWS instances- Dashboard tile do not react of MZ limitations. (APM-179766)
  • MZ for AWS instances – AWS account list is empty for limited data. (APM-179767)
  • MZ for AWS instances – Access to EC2 instances not blocked. (APM-179769)
  • Network overview always says that no network is monitored. (APM-179887)
  • NotExistingCredentialsLabelValidator mixes tenants. (APM-180296)
  • Monitored technologies: "PHP" (Service insights) switch was turned off after cluster update from 1.170 to 1.171. (APM-180515)
  • Two other validators mix tenants. (APM-180833)
  • OneAgent updates: Manually triggering OneAgent update (via webUI) doesn't have an effect (to update to Agent 1.171.x). (APM-180937)
  • Sample JSON download in User Session REST Export settings should be formatted exactly like it is actually sent. (APM-175095)
  • Fixed issue regarding missing edit option for synthetic monitors. (APM-177224)
  • Fixed issue where cursor used to jump to end of line when editing recorded clickpath events. (APM-178392)
  • Adopt global timeframe selectors in the Problem API. (APM-173810)
  • Rework NextPageKey serialization to be independent of the query message. (APM-179250)
  • Synthetic Problem Root Cause Link is Broken. (APM-177201)
  • Alerting profile: Adding tags is very slow, and configuration fails to save. (APM-177971)
  • relativeTime=month does not return full moth for problems API. (APM-177293)
  • Notifications not being sent according to severity rules in alerting profile. (APM-179346)
  • Symbolication Service: improved support for 3rd party library symbols. (APM-177498)
  • Monitoring via browser extension view incorrectly shows "Waiting for user actions". (APM-179321)
  • Cannot tranfer Application data via transfer button to an existing Application. (APM-179305)
  • Improved user session tagging. (APM-177162)
  • Improved browser monitor session end reason. (APM-178329)
  • Minor improvements for the applications/web rest API. (APM-177972)
  • Bulking for Interserver Messages. (APM-175319)
  • Migrate HTTP Requests in UpdatesMasterDownloadServiceImpl to GlobalHttpRequestService. (APM-165083)
  • Rename locations to Network zones in all visible parts of the system. (APM-177107)
  • Cannot download file via Configuration REST API. (APM-176858)
  • Create REST interface for available versions for agent installer download from cluster. (APM-166691)
  • Bulkhead executor service. (APM-174337)
  • Migrate HTTP Requests in SyntheticAPIDataAccessServiceImpl to GlobalHttpRequestService. (APM-164722)
  • Untangle unnecessary dependencies from AG code to high level platform code. (APM-168952)
  • Server / Platform: autoupdate linux s390. (APM-176224)
  • Server / Platform / AutoUpdate: add support for synthetic Windows modules. (APM-177424)
  • Agent Communication Heath Check: remove multiline entry in feature log. (APM-179283)
  • Custom metrics licensing: Disable custom metrics overage if Mission Control is not reachable for more than one week. (APM-179454)
  • Custom charting of imported appmon metrics doesn't work because of incorrect config handling. (APM-177196)

ON-PREM

  • Can create synthetic with cluster license set to 0. (APM-174902)

Other

  • monitoring overview, hosts and pgs - add limits and simple filtering. (APM-167784)
  • include option to download and install AG + RPM on "Deploy Dynatrace" screen. (APM-172438)
  • Linux s390 - add to UI. (APM-168550)
  • Fast-check when first supporting services metric is added. (APM-178944)
  • Replace graphics in new technology overview. (APM-179225)
  • Optimize OS configuration for high-latency Multi-DC setups. (APM-178661)
  • Extend remote environment config by tenant uuid. (APM-177433)
  • Linux PPC BE - Add to Server Rest Interface. (APM-168544)
  • Linux s390 - Add to Server Rest Interface. (APM-168545)
  • Avoid direct calls to several FileStore methods because of a known JDK bug. (APM-176924)
  • Make swagger gradle tasks cacheable. (APM-177776)
  • Collector / Memory Dumps: check current implementation of tracking of deleted dumps. (APM-178620)

Code-Level

  • Research better session storage (de)compression strategies. (APM-173937)
  • Improve CE periodic worker self monitoring. (APM-174309)
  • Correlation Engine optimize request naming rules evaluation. (APM-176813)
  • Correlation Engine optimize request attribute capturing rule evaluation. (APM-175913)
  • Count nodes below / nodes of path/tree at the root. (APM-175930)
  • Improvements to "unexpected service" detection. (APM-173305)
  • Prepare session storage for multi-threaded writing. (APM-176336)
  • Server side sampling: Sampling based on CE periodic task duration. (APM-176915)
  • Service detection rules API refactoring - WebServices. (APM-177063)
  • Service detection rules API refactoring - additional transformations. (APM-177495)
  • Request naming rule: Fix "not exists" condition. (APM-178060)
  • Transaction Storage: React faster to license changes. (APM-178229)
  • Request Attributes: Align length limit for postprocessing test string in UI and backend algorithm. (APM-179099)
  • Method hotspots show proper info when no data is available. (APM-177690)
  • Service details: The response time distribution chart for service instances now properly handles missing data. (APM-178149)

RUM

  • Showing known units also in tooltips of charts. (APM-177068)
  • Show units in table visualization. (APM-177071)
  • Showing known units on single value visualization. (APM-177073)
  • Propagate tile specific settings when cloning a tile. (APM-177075)
  • Fixed validation for uploaded R8 mapping files. (APM-181073)

Session Replay

  • Some browsers are reporting negative coordinates for mouse clicks and scroll events. Sessions recorded under those circumstances can be replayed properly. (APM-178782)
  • Sessions recorded with previous versions could stop working after introducing management zones support for session replay. (APM-177380)
  • The sessions were closed suddenly preventing them from appearing in the session list. (APM-176997)
  • Session replay can be enabled in case of not having received data from agents with a version lower than 157 in the last 8 hours. (APM-175153)
  • Replay events (mouse moves, clicks, ...) were not visible during session replay. (APM-181113)
  • Alert when missing resources are detected on replay. (APM-171089)
  • Alert when replay cannot be performed due to SSL being misconfigured on a tenant's Dynatrace UI. (APM-173857)
  • SVG files loaded by the extension are not being displayed. (APM-179500)
  • Playback of inline SVG trees will execute their <script> nodes. (APM-180404)

Core UI

  • Deployment Achievements: hide progress bar in the top bar if page is not visited for 30 days. (APM-173440)
  • Opening URL of a deleted Dashboard leads first to LLSHBM page, and after refresh to TDP. (APM-177367)
  • Using two square brackets causes results corruption (hash spam). (APM-178997)

Cluster

  • Activate config jmx by default. (APM-178642)
  • Improve readability of deserialized config and audit history in debugui. (APM-162096)
  • Provide internal REST endpoint for feature flag config. (APM-173807)
  • Log configuration audit data to the audit log. (APM-177503)
  • Introduce new debug state STT optimized for for row size. (APM-160486)
  • {6.4} Editing and deleting Api token of other users. (APM-179025)
  • MinAgentServiceWorker should be trigger-able using DebugUI. (APM-179183)
  • Replace ExistingHostGroupValidator.findHostGroupByName with name index lookup. (APM-179312)

Dynatrace SaaS General Availability (Build .172)

The Dynatrace SaaS .172 GA release contains 54 resolved issues.

Code-Level

  • Misleading "Not enough disk space" notification when session replay is located on different disk than transaction storage. (APM-178444)
  • Minor UI issues on global request naming settings page. (APM-180028)
  • Error detection is not order agnostic for multiple request attribute values. (APM-181233)
  • Cloud provider information missing for database services. (APM-181530)

RUM

  • Fixed update of the USQL query in the url every time it is run. (APM-179901)
  • Fixed styling when USQL's pie chart legend labels are too large. (APM-179904)
  • Fixed ordering of USQL's pie chart categories to be descending. (APM-180263)

Synthetic

  • HTTP Monitor Suddenly Stopped Showing Data without any Outages. (APM-175457)

Cluster

  • API call for anomaly detection failing. (APM-179882)
  • AWS dashboard - there is no indicator which service is affected even though tile is red. (APM-180175)
  • AWS custom alerts - Alerting scope is not persistent. (APM-180225)
  • Heatfield is not working correctly when end timestamp is undefined. (APM-180431)
  • WebUI: Linux agent install page: when copy-pasting install command manually contains line break (firefox). (APM-180707)
  • OneAgent updates: Manually triggering OneAgent update (via webUI) doesn't have an effect (to update to Agent 1.171.x). (APM-180937)
  • Because of this issue removed custom devices were still visible on technology overview. (APM-181049)
  • Deploy Dynatrace - Linux: UI glitch using e.g Edge. (APM-181172)
  • Global Search: should be possible also searching for PG. (APM-177111)
  • Repeated "Waiting for server response" error messages when viewing dashboards even though there is a connection to the server. (APM-174543)
  • Pin to Dashboard - Empty selection when the user has no write permissions to the dashboard. (APM-181194)
  • Allow to test User Session REST Export also while it is disabled. (APM-181188)
  • Alerting profile: Adding tags is very slow, and configuration fails to save. (APM-177971)
  • Using wrong application id in "Get application baseline" Rest Api call, code 200 is returned. (APM-179255)
  • Topology API showing invalid restartRequired values for GET request on all entities. (APM-179571)
  • AWS custom alerts - Thresholds values are wrongly displayed on Problem details. (APM-180019)
  • Throw exception for unfetched details. (APM-178210)
  • API not returning the same data-set every time. Few entries are omitted in some responses but present in other. (APM-181225)
  • FDI2 change point detection: Filtering of service instances with sparse data does not work. (APM-181602)
  • Events REST API does not return a custom property. (APM-181688)
  • Customer is unable to change the sensitivity for Anomaly detection on service RentalAgreement. Possible UI Bug. (APM-182527)
  • RDS monitoring shows multiple restarts and failovers at the same time. (APM-180938)
  • Different timing on the same waterfall on different time frames. (APM-179265)

Cluster

  • org.owasp:csrfguard:3.1.0. (APM-178315)
  • BulkheadExecutor using global thread pool for Cluster REST APIs. (APM-179246)
  • AWS credentials are executed on two AGs. (APM-179894)
  • {5.0}[DebugUI] csrf possible - no checks of the referer-header/no x-csrf header. (APM-142757)
  • Migrate HTTP Requests in DocumentationCenterSearchPluginImpl to GlobalHttpRequestService. (APM-164640)
  • Split TokenStore between Server/AG and shared stuff. (APM-179559)
  • Make Auto-sizing of String/Metadata Cache configurable. (APM-180433)
  • AG to AG traffic should also use the new location concept. (APM-158424)
  • Reminder: autoupdate: finalize synthetic windows module as soon installer types (build units) are provided by mc. (APM-178157)
  • OneAgent cannot update due to pending. (APM-179355)
  • Wiki / Cookbooks: support info. (APM-179482)
  • remove "dadoo" from process agent blocklist. (APM-179688)
  • Affected API: /api/v1/browserextension/config Now the following headers are set: - Cache-control: no-store, no-transform - Pragma: no-cache. (APM-180387)
  • Global changes in anomaly detection settings propagate to host level anomaly settings. Use global anomaly detection is disabled by default. (APM-180906)
  • Clarify if zRemote and remotePlugin agents will respect configured network zone on AG. (APM-181151)

Log Analytics

  • Single CloudTrail event shows up 4x in Log Analytics. (APM-178250)

Other

  • Validate that metric is an availability.percent metric if parameter considerMaintenanceWindowsForAvailability is used for Metrics API v1. (APM-180420)

User Assistance

  • Impact analysis not showing correct/coherent figures. (APM-179528)

Session Replay

  • Accessing Session Replay site from IE gives a TDP. (APM-183687)
  • Scroll position may be misplaced after jumping to a point in the timeline. (APM-180354)
  • HTTP resources linked from stylesheets not properly retrieved at replay. (APM-180578)
  • Pointers for errors and annoyances not painted correctly in the timeline. (APM-181326)
  • Pointers for load events in the timeline are misplaced on top of user interactions. (APM-182221)