Migrating your OpenPipeline configuration from OpenPipeline Configurations API to Settings API facilitates configuration management on a larger scale. This is achieved through a fine-grained approach to permissions. It introduces a hierarchical split of configurations for enterprises with many teams, giving teams flexibility in ingesting and processing data according to their needs while maintaining adaptable control by monitoring and SRE teams.
With configuration via Settings API, you get:
The OpenPipeline Configurations API is replaced by the Settings API and the schemas for each data type
builtin:openpipeline.<data.type>:routing
)builtin:openpipeline.<data.type>:pipelines
)builtin:openpipeline.<data.type>:ingest-sources
)The migration affects endpoint URLs, query parameters, and response/request body parameters, as well as the scope of the token for the request.
new Settings 2.0 | old OpenPipeline Configurations API |
---|---|
/api/v2/settings | /api/platform/openpipeline/v1/configurations |
new Settings 2.0 | old OpenPipeline Configurations API |
---|---|
Read settings (settings.read )Write settings ( settings.write ) | Read configuration (openpipeline:configurations:read )Write configuration ( openpipeline:configurations:write ) |
To learn about new query/body parameters, see the documentation of individual requests in the Settings 2.0 - Available schemas.
In the Settings 2.0 framework, OpenPipeline routing for each data type, individual pipelines, and individual ingest sources are represented by a settings object. An object contains some metadata (like the scope or creation timestamp) and its configuration, encapsulated in the value
object. To learn about the parameters of routing, pipelines, and ingest sources, query the related schema with a GET request.
The new Settings API schemas for routing, pipelines, and ingest sources have dedicated permissions as described in the table below.
new Settings 2.0 | old OpenPipeline Configurations API |
---|---|
settings:objects:read | openpipeline:configurations:read |
settings:objects:write | openpipeline:configurations:write |
Additionally, the pipeline and ingest source schemas have object owners and accessors.
The first user to store the object. Owners have read and write access to the objects they create and can delete it or share it with other users.
One or multiple users who can access an object shared by an owner.
Therefore a pipeline or ingest source can be accessed by a user that is one of the following:
settings:objects:read
or settings:objects:write
).Administrators with settings:objects:admin
permissions have unlimited read and write access to all objects. Administrators can also share access to objects that have an owner and change the owner.
The migration won't affect
openpipeline:configurations: read
and openpipeline:configurations:write
remain valid for the above endpoints.We recommend that you back up your existing configuration before starting the migration.
The following permissions are required:
openpipeline:configurations:write
settings:objects:admin
app-settings:objects:admin
To ensure a seamless transition, adapt your existing policies based on the OpenPipeline Configurations API before migrating to the new Settings API schemas.
Go to Account Management > Identity and Access Management
Update the existing policies.
To allow users to read and write OpenPipeline configurations with the Settings API schemas make sure the following permissions are in use
For standard users, settings:objects:read
(read access) and settings:objects:write
(write access)
For administrators, settings:objects:admin
(read and write access)
Review the integrations that use the OpenPipeline Configurations API endpoints, such as API calls, scripts, configurations-as-code files, or third-party integrations. Make sure to use the new Settings API schemas instead.
To migrate your OpenPipeline configuration to the new API
Go to Settings > Process and contextualize > OpenPipeline and select any data type.
This process will migrate all data types, regardless of which one you select.
In the upper part of the data type page, select Migrate in the dedicated banner.
The migration process will start automatically. It will take a few minutes to complete.
When them migration completes successfully, a Migration successful message appears. Configurations for all data types have been migrated to the new API.
The following endpoints can no longer be used:
GET /platform/openpipeline/v1/configurations
GET /platform/openpipeline/v1/configurations/{id}
PUT /platform/openpipeline/v1/configurations/{id}
If you are not using configuration as code, you can skip this step.
Dynatrace has migrated the OpenPipeline Configurations API to the Settings API schema automatically for you, therefore you don't need to manually look into the configuration files.
To complete the migration,
Download and create new configuration-as-code files containing the new configuration.
export
utility.download
command. To learn more about how Settings 2.0 objects are handled, see Special configuration typesModify all necessary configuration files containing the old schema ID with the new schema ID.
Delete the old configurations files.
Set up Owner-based access control to start handing-over the configuration reponsibility for pipelines to the individual teams who own the data.
Preview You can enroll in the Preview program with higher configuration limits, up to 2,000 pipelines. To enroll in the program, contact a Dynatrace product expert via live chat.