Settings API - Allows you to add custom LLM-as-Judge evaluation methods schema table

Published Jul 06, 2026

Allows you to add custom LLM-as-Judge evaluation methods (`app:dynatrace.genai.observability:custom-evaluation-method)`

Schema ID	Schema groups	Scope
`app:dynatrace.genai.observability:custom-evaluation-method`	-	`environment`

Retrieve schema via Settings API


GET	Managed	`https://{your-domain}/e/{your-environment-id}/api/v2/settings/schemas/app:dynatrace.genai.observability:custom-evaluation-method`
GET	SaaS	`https://{your-environment-id}.live.dynatrace.com/api/v2/settings/schemas/app:dynatrace.genai.observability:custom-evaluation-method`
GET	Environment ActiveGate	`https://{your-activegate-domain}/e/{your-environment-id}/api/v2/settings/schemas/app:dynatrace.genai.observability:custom-evaluation-method`

Authentication

To execute this request, you need an access token with Read settings (settings.read) scope. To learn how to obtain and use it, see Tokens and authentication.

Parameters

Property	Type	Description	Required
Name `name`	text	A name for this evaluation method	Required
Description `description`	text	A short description of what this method evaluates	Optional
System prompt `prompt`	text	The LLM-as-Judge evaluation prompt. Use variables (i.e., {{input}}, {{output}}, {{context}}) as placeholders.	Required