Dynatrace Managed release notes version 1.170
New features and enhancements
- New filtering capabilities for large service lists in your monitoring environment
- How to use the token management API to rotate your secrets!
Cluster events audit logging
From a compliance perspective, audit traces are an absolute necessity. There are many legal concerns that must be adhered to, and audit logs serve as an official record that can be provided when an auditor asks for proof of compliance. Security is another area in which audit logs can be invaluable.
Audit logs are stored at the cluster nodes where system changes are executed. To see the complete picture of all changes that have occurred across all nodes, you need to process audit logs from all nodes. Audit logs are available on individual nodes at DATASTORE_PATH/log/server
.
Cluster event audit logs are available as of Dynatrace Managed version 1.170. See audit log example below:
audit.cluster.event.log
12019-05-29 09:29:42 UTC {"eventType":"CREATE","tenantId":"unknown","userId":"Cluster event service","userIdType":"SERVICE_NAME","userOrigination":"Cluster event (Internal)","sessionId":null,"identity":null,"identityCategory":"CLUSTER_EVENT","success":true,"timestamp":1559122182775,"message":"{\"clusterEvent\":{\"clusterEventType\":\"SERVER_LIFECYCLE\",\"timestamp\":1559122182775,\"summary\":\"Server 1 shutdown initiated.\",\"description\":\"ShutdownDescriptor [exitCode=0, caller=com.compuware.apm.server.core.ServerShutdownRunner, reason=Shutdown due to VM shutdown hook., restart=false, expected=true]\",\"userId\":\"com.compuware.apm.server.core.ServerShutdownRunner\",\"notification\":\"NONE\",\"clusterEventSeverity\":\"INFO\"}}"}
Additional audit log files will be made available in upcoming releases. Audit logs open up a whole new set of use cases for custom notifications using log monitoring tools. We’ll describe some of these use cases in an upcoming blog post.
Dynamic JVM memory settings update
Previously, to apply a RAM update on a cluster node host, you were required to perform an "in-place" upgrade or wait until the next scheduled upgrade. Starting with version 1.170, hardware updates are applied automatically when services are restarted. With this change, Dynatrace Managed deployment is now more resilient and more quickly adapts to your needs. To restart all services, run the following:
1/PRODUCT_PATH/launcher/dynatrace.sh restart
Minimum free disk space requirements were updated
To better address real-world scenarios, we've increased the required free space for new installations to the following:
- Binaries
PRODUCT_PATH
(/opt/dynatrace-managed
): 6 GB (was 4 GB)
- Logs
LOG_PATH
(/var/opt/dynatrace-managed/log
): 2 GB (was 1 GB)
- OneAgent updates
AGENT_BUILD_UNITS_PATH
(/var/opt/dynatrace-managed/agents
): 20 GB (was 3 GB)
- Data directory
DATASTORE_PATH
(/var/opt/dynatrace-managed
): 24 GB (was 3 GB)
There are also now separate values for new installations and upgrades. The previous, lower values are still used during upgrades for backward compatibility. The new, higher values are applied for fresh installations. Before each upgrade, we perform sanity checks for Cassandra, Elasticsearch, and transaction datastores to ensure that they have at least 1 GB of free space available.
Other improvements
Invitation emails now include a list of all purchased license items. Limits and overage details are included for each monitoring-unit type.
License update emails are sent in place of invitation emails when license settings are changed.
- The Cluster Nodes Configuration REST API has been extended to expose operation status under the
/status
endpoint. - The Cluster Nodes Configuration REST API is now included as a cluster node resource on individual nodes. An
agent
field is provided for enabling/disabling OneAgent traffic on individual nodes. To improve usability for complex configurations, the Environments table on user group details pages has been extended to display 100 rows.
Cluster events are now generated for remote access events. The reason for the access and other details are displayed for auditing purposes.
Additionally, all new features introduced with Dynatrace SaaS version 1.169 and version 1.170 are now also supported by Dynatrace Managed.
Resolved issues
Dynatrace Managed General Availability (Build .170)
The Dynatrace Managed .170 GA release contains 27 resolved issues.
Component | Resolved issues |
---|---|
ON-PREM Installer | 8 |
ON-PREM | 17 |
ON-PREM Console | 2 |
ON-PREM Installer
- JVM settings for Cluster processes should be updated on process restart. (APM-167581)
- When remote NFS volume is used for our binaries it can happen that some files are locked by NFS server because the server thinks that they are still used by our processes. (APM-164171)
- Minimal disk space requirements should be updated. (APM-164252)
- Restore from backup - permission issues with custom datastore location and server file permissions. Fixed owner username and path to Cassandra datastore directory. (APM-174165)
- Multiple errors due to systemd logged in the install log but upgrade was successful. (APM-174639)
- After upgrade Cassandra service cannot be started. (APM-174838)
- SELinux issues with starting Cassandra at Cluster node. (APM-176370)
- One of the node could not be upgraded due to permission denied error. (APM-178273)
ON-PREM
- Cluster Nodes Configuration REST API should be extended to expose operation status under /status endpoint. (APM-177786)
- Cluster Nodes Configuration REST API should be moved to Cluster Nodes resource and it should support "agent" field. (APM-170867)
- OpenLDAP without memberOf support matched users only by usernames, but should also match by user DN. (APM-173604)
- Test e-mail send status was not displayed. (APM-173699)
- Conversion from trial environment to a standard one did not work. (APM-173963)
- Increase rows count to 100 on Environments Table at User Group Details page. (APM-174022)
- Enabling automatic update also enables automatic download of updates from Mission Control. (APM-174071)
- Admin permission is not granted to a group when group is created or updated via REST API. (APM-174583)
- Cluster Events should be logged in audit.cluster.event log. (APM-164326)
- Display reason and notes in Cluster Event generated for remote access. (APM-164327)
- DEM disabled for Environment even though usage limit not met. (APM-174953)
- SAML integration created duplicate email address for different user. (APM-174984)
- Cloud-infrastracture monitoring mode is disabled when license's host units are 0 but overage is enabled. (APM-175032)
- Manual trigger of cluster upgrade leads to Technical Difficulties Page, but upgrade is triggered. (APM-175607)
- Country codes are not set for new environments until a license gets updated. (APM-175746)
- Created a new environment on a cluster but it has been changed to expired trial. (APM-176254)
- Table row for synthetic monitors should be hidden only if synthetic is not licensed at all. (APM-178684)
ON-PREM Console
- Include list with all billing categories in the Invitation Email, for each billing category show limit and if overage is enabled show whether it's limited (and what's the limit) or not. (APM-114963)
- Offline license now includes synthetic monitors and new type of e-mail with updated license settings is sent. (APM-161308)
Dynatrace SaaS General Availability (Build .169)
The Dynatrace SaaS .169 GA release contains 98 resolved issues.
Component | Resolved issues |
---|---|
Cluster | 21 |
Other | 6 |
RUM | 7 |
Session Replay | 12 |
Synthetic | 1 |
Core UI | 4 |
Cluster | 36 |
Log Analytics | 6 |
Autonomous Cloud | 5 |
Cluster
- Azure UI - support no subscription links to azure elements. (APM-174025)
- Deployment status for AG - UI adjustments. (APM-174024)
- CPU Load not fetched and displayed for SOLARIS. (APM-174405)
- Network overview - no last values for connectivity, retransmissions and any network interface's timeseries. (APM-175674)
- Host plugins - add experimental support. (APM-174162)
- PGI dashboard plugins - improve finding running plugins. (APM-173935)
- REST API - AWS Anomaly - Add High CPU Saturation alerting for EC2. (APM-171176)
- Extend P2P view to signal unmonitored host-level communication. (APM-159960)
- Azure Sql server metrics chart doesn't work. (APM-174344)
- Enable new technology overview FF. (APM-175054)
- network overview tiles - add limits for number of entities. (APM-167777)
- Azure Smartscape links don't work if there is no selected entity. (APM-173083)
- TDP when drilling to instance. (APM-173419)
- Deploy Dynatrace - old link for MSI package. (APM-174104)
- AWS RDS Freeable memory chart should not use SUM aggregation. (APM-174411)
- OneAgent updates screen allows to trigger update to the same version. (APM-174659)
- PG counts do not match in new technology overview in table and in tile. (APM-175084)
- Sometimes performance is low when drilling down to entities. (APM-175087)
- New technology overview: TDP when CF foundation filter applied. (APM-175569)
- Tag Filters not saving the Alerting Profiles. (APM-173661)
- Remove technologies dashboard tile. (APM-171580)
Other
- Enhance number of tags for credentials filtering. (APM-170067)
- Disable automatic monitoring for Varnish Cache - UI part. (APM-169117)
- Confusing full-stack advertisement message. (APM-172759)
- Remove "Group Policy deployment" from "Deploy Dynatrace" screen. (APM-169428)
- Add Cloud foundry foundation relationship filter to new technology overview. (APM-170912)
- Remove usages of UPT in Infrastructure monitoring views. (APM-172367)
RUM
- User sessions query table is not duplicated anymore when the tile is updated. (APM-174914)
- Browser monitors UI - show failed and pending resources in waterfall. (APM-174517)
- User session export settings UI - improved management zone selection. (APM-172246)
- User tag rule settings UI - move up/down functionality fixed. (APM-173235)
- OS family filter is applied to geographic regions in mobile app overview. (APM-174620)
- Deleted info is displayed for removed mobile apps. (APM-170684)
- Calculation of request time in mobile provider breakdown was improved. (APM-176736)
Session Replay
- session replay duration calculation considers start time of binary beacons rather than end time. Replay duration shown during session replay could be shorter. (APM-174559)
- Exclude session replay beacons generated by bots. (APM-173038)
- Session Replay: Player should disable Play button if there is no frame data. (APM-172027)
- Change default value for overload prevention multiplier for Session Replay. (APM-174971)
- Ignore oldest supported agent version needed by cluster to be able to enable Session Replay. (APM-173487)
- Remove Beta label for session replay feature. (APM-172012)
- Chrome autocompletes input elements on replay. (APM-171757)
- Pop-up overlay remains open when navigating out of the session replay page. (APM-171143)
- dtrum.enableSessionReplay opt-in public method allows bypassing the cost control settings. (APM-169494)
- Timeline should not be disabled when renderer is loading resources. (APM-164080)
- Skip inactivity areas between events. (APM-171715)
- Pop-up overlay doesn't disappear when "Next event" button is disabled. (APM-175033)
Synthetic
- Sequence number exposed instead of eventId. (APM-175139)
Core UI
- Global search (search bar) should be able to search by an entity ID. (APM-173207)
- Dropdown is covered by the menu bar on low height screens. (APM-159141)
- After doing a setup change, notification content does not show up. (APM-173637)
- Intercom chat is not positioned correctly. (APM-176122)
Cluster
- Usersession REST Export: Observe Management Zone in the query for sample/test export. (APM-171973)
- Limit entity IDs before reading MEInstances. (APM-162902)
- Add auditinfo to migrated configurations. (APM-162841)
- Clarify ConfigEvent vs ConfigurationChangeListener. (APM-133457)
- Configuration read stats for uncached access. (APM-163026)
- ApplicationDetectionConfig/DatabaseServiceDetectionConfig cleanup. (APM-153119)
- Create Framework for generic config providers. (APM-160645)
- Add a way to check if a configType is a singletonConfig. (APM-142233)
- Evaluate existing metrics related to config updates. (APM-174246)
- Smoke Test for Token API Rest Endpoint. (APM-173776)
- Token API goes GA. (APM-172623)
- Evaluate system with large amounts of tokens. (APM-171501)
- Token API documentation. (APM-167699)
- API Token search REST API. (APM-169650)
- Create a DurationDto for Rest API. (APM-172836)
- Change timestamps back to milliseconds on Token REST Api. (APM-173981)
- Performance improvements in UI / token removal. (APM-174463)
- Recently created environments rarely experience configuration data loss on first cluster upgrade after creation. (APM-176193)
- Collector / Memory Dumps: mv collector.core -> collector.memorydump project. (APM-170852)
- Server / Platform: Disable automatic monitoring for Varnish Cache. (APM-169317)
- Server / Platform: nginx supported on linux ppcle starting with agent version 1.169?. (APM-172763)
- Introduce configurable host unit capping on Cluster side for Managed cluster. (APM-170268)
- HostUnitsCapping: Add hasContainers to HostUsageDto. (APM-170847)
- Beta release Notification Config API. (APM-175316)
- Keep a history of openApi specs. (APM-157976)
- Separate QoS filter for Control API and convert async requests to sync. (APM-150670)
- Migrate HTTP Requests in ConcreteSyntheticWebCheckService to GlobalHttpRequestService. (APM-164158)
- Migrate HTTP Requests in UserLogoutServiceOIDC to GlobalHttpRequestService. (APM-164942)
- Migrate HTTP Requests in OidcAbstractSessionState to GlobalHttpRequestService. (APM-164943)
- Migrate HTTP Requests in SsoOidcUtil to GlobalHttpRequestService. (APM-164944)
- Migrate HTTP Requests in MobileAppDistributor to GlobalHttpRequestService. (APM-164674)
- dt managed server re-writes config.properties on initial startup, duplicating some entries. (APM-171243)
- swaggerUI try-out requests are sent with api-token in URL. (APM-173006)
- Optimize compression rate in BoshReleaseTarballBuilder. (APM-173328)
- Self-monitoring agent was not connected to target tenant after managed cluster upgrade. (APM-174158)
- AG updates are triggered multiple times on all servers across cluster. (APM-174352)
Log Analytics
- Provide simple facade class for log fetching mechanism. (APM-168555)
- Adapt log events to use the correct description field. (APM-172427)
- Enable/disable log custom metrics in API. (APM-169066)
- Log custom metric data for host log occurrences. (APM-169069)
- UX improvement for log entries shortening. (APM-174167)
- Detection scope not populating when creating events based on log patterns. (APM-174808)
Autonomous Cloud
- Tooltip is scaled weirdly on left part of graphs. (APM-173526)
- Node analysis screen: Filter for problematic nodes. (APM-174847)
- Limit filter suggestions of Kubernetes labels to visible cluster. (APM-168852)
- Introduce toggle for pausing Kubernetes integration in UI and Config API. (APM-166349)
- Enable management zones for Kubernetes overview. (APM-173263)
Dynatrace SaaS General Availability (Build .170)
The Dynatrace SaaS .170 GA release contains 99 resolved issues.
Component | Resolved issues |
---|---|
Synthetic | 4 |
Cluster | 43 |
Other | 8 |
RUM | 4 |
Core UI | 2 |
User Assistance | 1 |
Code-Level | 18 |
Log Analytics | 4 |
Autonomous Cloud | 2 |
Cluster | 10 |
Session Replay | 3 |
Synthetic
- Wrong problem time frame. (APM-163613)
- Private synthetic locations - 1 monitor no image. (APM-175671)
- Metrics for HTTP multi request monitors should be enabled on FF. (APM-176982)
- Images for Clickpath not shown. (APM-176865)
Cluster
- Network overview - no last values for connectivity, retransmissions and any network interface's timeseries. (APM-175674)
- Technology overview: metric names from many different sources should be distinguishable. (APM-175444)
- Technology overview: data is missing sometimes ([UIA] UI Test: "verifyTechnologyOverview" - failed). (APM-175490)
- New technology overview: TDP when CF foundation filter applied. (APM-175569)
- Table style broken after navigating to PG screen. (APM-176073)
- Technology Overview - It's not clear if technology name should be uppercase or camelcase (UI Test: "verifyCustomActiveGatePluginOnMonitoredTechnologies" - failed). (APM-176470)
- Unlikely argument warning in AgentManager. (APM-176282)
- Technology overview - Process group record is expandalble only by clicking on icon despite the fact that the pointer suggests that action for whole record. (APM-176367)
- Missing of the Disk space usage data intermittently for host monitoring. (APM-176745)
- Technologies Overview page is empty. (APM-177491)
- TDP after expanding a process (Cannot read property 'Rfc' of undefined). (APM-177697)
- No processes listed after drilling down from CF dashboard. (APM-178026)
- Use mimetype application/x-ndjson when exporting JSON to Elasticsearch. (APM-174967)
- Fix custom alert handling. (APM-176668)
- Unify open problem count logic in ProblemCenter. (APM-175458)
- Build event limiting functionality to ensure that event explosions do not end up in high GCs. (APM-171430)
- Provide feature flag to disable FDI Problme generation. (APM-174875)
- As a UI developer I want to consume the ProblemResourceV2 REST in the problem details to show the impact analyzes. (APM-174216)
- Dynatrace blasting out notifications for "monitoring interruptions" to all integrations. (APM-174919)
- Provide access to availability excluding maintenance windows via Metrics API v1. (APM-176213)
- Evaluate forced periodic worker shutdown handling for ME. (APM-165295)
- Tag added to Maintenance Window expects value, though value was removed. (APM-174987)
- Improve Merge Analysis UI. (APM-176466)
- Change 2 ServiceNow ITOM integration event fields. (APM-170739)
- Problem seems to changed the problemid over time. (APM-175336)
- Migrate HTTP Requests in FileDownloadServiceImpl to GlobalHttpRequestService. (APM-164939)
- Native SSL in Jetty using Conscrypt. (APM-172995)
- Framework improvement: Handle catch-up behavior of threadpool. (APM-173254)
- Rename ExternalCluster config+api to RemoteEnvironment. (APM-175408)
- New Injection Status of Java Agent for Broken Class Sharing. (APM-176536)
- Linux PPC BE - Monitoring State Merger Adaptation. (APM-168547)
- Linux s390 - Monitoring State Merger Adaptation. (APM-168546)
- Enable/Disable system Z agents according to license state. (APM-170625)
- Server / Platform: Missing Monitoring Information: server side handling. (APM-164526)
- Server / Platform: add switchToPhpAgentNG to RuxitAgentProcSectionsConfig, debugui, test ... (APM-175842)
- Add NodeJs 12 to supported versions. (APM-175304)
- Cluster: Introduce HostUnitsCappingConfig for tenant LicenseConfig. (APM-175114)
- Cluster: Use HostUnitsCappingConfig for hostunits calculation for Saas deployment. (APM-175115)
- StandAlone agents/Host Paas memory limit without VendorType support for HostUnits system. (APM-175376)
- Abort long REST API requests. (APM-170883)
- Upgrade to OpenAPI 3.0 in Gradle builds additionally to OpenAPI 2.0. (APM-175446)
- Get rid of unnecessary internal VersionFormatExceptions - improve object churn and reduce overhead. (APM-176562)
- Move delete action from custom device list to the custom device details view. (APM-175875)
Other
- Plugins running on CDG details should display name instead of plugin ID. (APM-176837)
- Extend PG screen with Technology-specific metrics for Technology 'Cloud Foundry Auctioneer'. (APM-175330)
- Extend PGI screen to show Cloud Foundry Auctioneer metrics under 'Further details'. (APM-175326)
- Extend PG screen with Technology-specific metrics for Technology Go. (APM-136931)
- Allow custom alerts for available AWS metrics. (APM-174928)
- monitoring overview, hosts and pgs - add limits and simple filtering. (APM-167784)
- Show alerts on Azure Dashboard - research UI. (APM-166919)
- Respect management zones in AWS infographic. (APM-174438)
RUM
- Added support for showing known units in the User Sessions Queries table. (APM-157544)
- Improved network performance summary on mobile app overview. (APM-166238)
- Improved geolocation handling in custom charts for mobile apps. (APM-176684)
- Fixed mobile app configs containing web server beacon endpoints. (APM-176847)
Core UI
- Display info to the user when we cannot perform user verification or there is a chat loading problem. (APM-169043)
- Intercom chat is not positioned correctly. (APM-176122)
User Assistance
- Cannot enable user in alerting profile. (APM-175861)
Code-Level
- Research better session storage (de)compression strategies. (APM-173937)
- Improvement to background service detection. (APM-173303)
- Revisit CE top tenant contributor values for multiple CEs. (APM-164285)
- Keep and sanitize legacy timeseries needed for metric registry. (APM-175195)
- Request Attribute for IIB Nodes. (APM-164752)
- Support File Compression for Synthetic Data. (APM-174350)
- Research multi-threaded session storage writing. (APM-170590)
- Service detection rules API - refactor to improve usability. (APM-172408)
- Fixed request attribute method data source get, since not all instrumented methods were contained. (APM-175608)
- Fixed request attribute REST API get for method rules, filenames were sometimes set to empty string, which subsequently caused validation error upon POST and or PUT. (APM-176284)
- Fixed condition matching, conditions always used masked values for matching of conditions, whether global masking was enabled or not. (APM-177027)
- Transaction Storage: React faster to license changes. (APM-178229)
- Do not distinguish between async and sync calls on service flow in throughput mode. (APM-171669)
- Support monitoring of containerd containers. (APM-175704)
- Explain missing comparison data on response time hotspots and failure analysis view. (APM-169895)
- Explain missing data on service Multi-level analysis view if requests are rarely occuring. (APM-174631)
- Show exact values on the service dashboard tile in case of very low load (instead of 0). (APM-177146)
- Allow source code download based on management zone permissions (falsely required tenant-wide permissions). (APM-178236)
Log Analytics
- Provide simple facade class for log fetching mechanism. (APM-168555)
- Apply LAQL to log custom metric data. (APM-169071)
- Handle errors related to log custom metric creation on Log viewer. (APM-169054)
- Log viewer not working. (APM-176275)
Autonomous Cloud
- Improve URL sanitization for Cloud Foundry. (APM-175996)
- Show average minimum and maximum CPU & memory usage values in Kubernetes node analysis. (APM-174026)
Cluster
- Enable FW4 Tags automatically. (APM-171750)
- Check whether to use ServiceType.isUsedForPresentation. (APM-162788)
- Clean up outdated traffic control flags from agentruntimesettings. (APM-147664)
- Consolidate TokenAuthenticableAction and TokenScope. (APM-155790)
- Missing REST token scopes from tenant "create token" endpoint. (APM-175934)
- Allow TenantManagement API to create unlimited TenantManagementTokens. (APM-176170)
- Recently created environments rarely experience configuration data loss on first cluster upgrade after creation. (APM-176193)
- Token scope "RestRequestForwarding" can't be mapped using API endpoint. (APM-176313)
- Revert TokenScope removal. (APM-176404)
- Replace some existing solutions with new ConfigProvider. (APM-174960)
Session Replay
- Player to skip playback of inactivity periods longer than 3 seconds. (APM-172077)
- Timeline skipping is slow when a page contains huge inline or dynamic stylesheets. (APM-176194)
- Playback of SVG trees will execute their <script> nodes. (APM-180404)