Keep the current judge prompt over an optimized candidate
Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.
POST
/
metrics
/
{id}
/
decline-optimization
Keep the current judge prompt over an optimized candidate
API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (gsk_*) and legacy (gsk-) API keys are accepted, e.g. Authorization: Bearer gsk_... or Authorization: Bearer gsk-....
Path Parameters
id
string
required
Optimization candidate metric ID
Minimum string length: 1
Response
The declined candidate
id
string
required
Example:
"metric_123"
metricGroupId
string
required
read-only
Identifier shared by every metric in the same revision family. Server-managed — derived from parentMetricId on create (or generated for roots). Cannot be set by the caller.
Example:
"metric_123"
parentMetricId
string | null
required
Id of the direct parent metric. On create, providing this value turns the new metric into a revision: it joins the parent's family and (if the parent is active) flips the parent to legacy. Omit or null to create a root metric in a fresh group. On responses, this is the recorded parent edge (null for roots).
Example:
"metric_122"
organizationId
string | null
required
Example:
"org_123"
userId
string | null
required
Example:
"user_123"
name
string
required
Example:
"Accuracy"
evaluationParams
string[]
required
Ordered list of trace fields the evaluator needs, written in snake_case (e.g. input, actual_output, expected_output, retrieval_context). Determines which data the evaluation engine extracts from each trace. Full list of accepted values: https://docs.galtea.ai/concepts/metric/evaluation-parameters
Example:
["input", "actual_output", "expected_output"]
source
enum<string> | null
required
Evaluation method for the metric. FULL_PROMPT is deprecated for creation — POST /metrics rejects it with a 400. Use PARTIAL_PROMPT for new AI Evaluation metrics. The value remains in the enum because existing FULL_PROMPT metrics are still returned by reads and filters. CLASSIFIER is the Classifier (Jev) judge, accepted only where the deployment enables it.
Available options:
SELF_HOSTED,
FULL_PROMPT,
PARTIAL_PROMPT,
HUMAN_EVALUATION,
GEVAL,
DEEPEVAL,
DETERMINISTIC,
CLASSIFIER
Example:
"PARTIAL_PROMPT"
judgePrompt
string | null
required
Example:
"Evaluate the accuracy of the response"
tags
string[]
required
Example:
["accuracy", "quality"]
description
string | null
required
Example:
"Measures the accuracy of responses"
documentationUrl
string | null
required
Example:
"https://docs.example.com/metrics/accuracy"
evaluatorModelName
string | null
required
Example:
"GPT-4"
areEvalParamsTop
boolean | null
required
When true, evaluationParams are injected at the top level of the evaluator prompt instead of nested inside the conversation context.
isBeingOptimized
boolean
required
read-only
Whether the metric is currently being optimized.
optimizationStatus
enum<string> | null
required
read-only
Where an optimization attempt stands. Null for a metric that did not come from an optimization. A candidate waiting for review is legacy until it is activated.
Available options:
OPTIMIZING,
READY_FOR_REVIEW,
FAILED,
NO_IMPROVEMENT,
DECLINED,
ACTIVATED
Example:
"READY_FOR_REVIEW"
judgeGenerationSettings
object | null
required
The generation settings this metric's judge runs with. Null runs the platform defaults. Immutable: changing one creates a revision.
Show child attributes
passThreshold
number
required
Score from 0 to 1 at or above which an evaluation of this metric passes. Immutable: changing it creates a revision.
Required range: 0 <= x <= 1
Example:
0.7
applicabilityScope
enum<string>
required
Which sessions get the applicability check before this metric is judged. NONE for a metric the platform does not score. A metric that scores traces is never checked, so it takes NONE and refuses any other value. A FULL_PROMPT metric whose judge prompt reads traces but does not list it in evaluationParams is stored as checked, yet the evaluator judges it without the check. Immutable: changing it creates a revision. The check runs only where the deployment enables it.
Available options:
NONE,
DEVELOPMENT,
PRODUCTION,
ALL
Example:
"PRODUCTION"
applicabilityThreshold
number | null
required
The lowest probability that the metric applies to a session at which it is judged. Null means the platform default, 0.5. Immutable: changing it creates a revision.
Required range: 0 <= x <= 1
Example:
0.7
classifierQuestion
object
required
The one question of a CLASSIFIER metric; null for every other source.
Show child attributes
optimizationValidation
object | null
required
read-only
How an optimization attempt was validated: the held-out evaluations and, once the optimizer reported, both prompts scored on the search rows and on the held-out rows. Set on an optimization attempt only, and null for any other metric, for an attempt that predates it, and for an attempt copied from another organization.
Show child attributes
optimizationRun
object | null
required
read-only
What an optimization attempt ran: the strategies, the step budget and the steps used. Null while the attempt runs, and when it was not reported: an attempt from before the report existed, one run by an older optimizer, a failed run, an attempt copied from another organization, or a metric that is not an optimization attempt. Null never means a run of 0 steps.
Show child attributes
specificationIds
string[]
required
Specifications linked to this metric. A READER or HUMAN_EVALUATOR caller sees only the specifications of the products it can read.
Example:
["spec_123"]
userGroupIds
string[]
required
Example:
["ug_123"]
createdAt
string<date-time>
required
legacyAt
string<date-time> | null
required
read-only
Earliest non-null of this metric's own legacy date and its evaluator model's unselectableAt, so a model no longer selectable makes every metric linked to it report as legacy even though the metric row itself is untouched. Present only once that date has passed: a scheduled future cutoff reports null, because the metric is still active until then. Unlike disabledAt, this field never carries a future date.
disabledAt
string<date-time> | null
required
read-only
Earliest non-null of this metric's own disabled date and its evaluator model's disabledAt — a disabled model makes every metric linked to it report as disabled even though the metric row itself is untouched.
excludedFromAnalyticsAt
string<date-time> | null
required
read-only
When set, results produced by this metric revision do not feed analytics.
excludedByUserId
string | null
required
read-only
User who last excluded this metric revision from analytics.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Galtea Docs","colors":{"primary":"#5286FF","light":"#A9E3FE","dark":"#171717"},"logo":{"light":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5","dark":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/dark.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=0ea251446a97e2cd0bb0e9de1b049412"},"favicon":"https://mintcdn.com/galtea/sKxmtq77X98SiOSi/favicon.png?fit=max\u0026auto=format\u0026n=sKxmtq77X98SiOSi\u0026q=85\u0026s=a297a4f88e5dd07d7858dc2998dfe3ce","appearance":{"default":"system","strict":false},"background":{"color":{"light":"#f6f6f5","dark":"#09090a"}},"navbar":{"links":[{"href":"mailto:support@galtea.ai","label":"Support"}],"primary":{"type":"button","label":"Dashboard","href":"https://platform.galtea.ai"}},"footer":{"socials":{"linkedin":"https://linkedin.com/company/galtea-ai","website":"https://galtea.ai"}},"fonts":{"family":"Geist"},"icons":{"library":"fontawesome"},"styling":{"eyebrows":"breadcrumbs","codeblocks":"system","latex":true},"integrations":{"posthog":{"apiKey":"phc_5hcYhBTteqSv1mp9ObS5j28EKEA1HV6sog9EZHikgcF","apiHost":"https://t.galtea.ai","sessionRecording":false}},"contextual":{"options":["copy","view","chatgpt","claude","perplexity","mcp","cursor","vscode"],"display":"header"},"navigation":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"galtea","hasAudioNarration":false,"actualSubdomain":"galtea","customDomains":["docs.galtea.ai"],"gitSource":{"type":"github","owner":"galtea-ai","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{},"buildId":"6afc354e44ba07be7352fb3b","clientVersion":"0.0.4177","searchFilterCounts":[{"language":"default","tag":"Concepts","count":3896},{"language":"default","tag":"REST API","count":1987},{"language":"default","tag":"Endpoints","count":1760},{"language":"default","tag":"SDK","count":1413},{"language":"default","tag":"Metrics","count":387},{"language":"default","tag":"Guides","count":330},{"language":"default","tag":"Deployment","count":180},{"language":"default","tag":"evaluations","count":180},{"language":"default","tag":"monitors","count":180},{"language":"default","tag":"metrics","count":177}]},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"starter-pricing","enabled":true,"variant":{"name":"treatment","enabled":true,"payload":{"type":"string","value":"treatment"},"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":true},"customCss":[],"page":{"pagePath":"v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","slug":"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","pageMetadata":{"title":"Keep the current judge prompt over an optimized candidate","description":"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/{id}/decline-optimization","href":"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","autogeneratedByOpenApi":true},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,p:`p`,..._provideComponents(),...props.components},{Warning}=_components;if(!Warning)_missingMdxReference(`Warning`,true);return _jsx(Warning,{children:_jsxs(_components.p,{children:[`You are reading the docs of Galtea 5.13. `,_jsx(_components.a,{href:`/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate`,children:`Read this page in the latest version`}),`.`]})})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"codeStyling":"system","config":{},"pageMetadata":{"title":"Keep the current judge prompt over an optimized candidate","description":"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/{id}/decline-optimization","href":"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","autogeneratedByOpenApi":true}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[],"codeExamples":{}},"jsLinks":["/_mintlify/custom/galtea/d232846d89fbe5a1/galtea-assistant.js"],"openApiReferenceData":{"operation":{"operationId":"declineMetricOptimization","tags":["metrics"],"summary":"Keep the current judge prompt over an optimized candidate","description":"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.","security":["79e8d50e-c6db-49ed-8cd4-5125747b4167"],"x-cli-name":"decline-optimization","parameters":["d8c1b825-77fd-4ab3-a343-97f3ce015f3c"],"responses":{"200":"761d4f09-7119-4ed1-9fc6-cd2b8f103b47","400":"d89ca9fc-957e-4a8a-bb59-74449352ba35","401":"8ad4de88-5266-44a6-8e94-e0eef73579bf","403":"dbb8bbf9-6067-4c9e-855f-c0ee47a81aaf"},"x-mint":{"content":"\u003cWarning>\n You are reading the docs of Galtea 5.13. [Read this page in the latest version](/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate).\n\u003c/Warning>\n"},"method":"post","type":"path","servers":["b802bc4d-c7c2-47e8-8ccd-283b787d3e40"],"path":"/metrics/{id}/decline-optimization","baseUrlOptions":["https://api.galtea.ai"],"title":"Keep the current judge prompt over an optimized candidate","codeSamples":[],"requiredOnlyExamples":false,"requestExampleType":"generated","responseExampleType":"generated"},"dependencies":{"parameters":{"d8c1b825-77fd-4ab3-a343-97f3ce015f3c":{"schema":{"type":"string","minLength":1,"description":"Optimization candidate metric ID","isRequired":true,"uniqueKey":"","typeLabel":"string"},"required":true,"description":"Optimization candidate metric ID","name":"id","in":"path"}},"responses":{"761d4f09-7119-4ed1-9fc6-cd2b8f103b47":{"description":"The declined candidate","content":{"application/json":{"schema":{"type":"object","properties":{"id":{"type":"string","example":"metric_123","isRequired":true,"uniqueKey":"id","typeLabel":"string"},"metricGroupId":{"type":"string","readOnly":true,"example":"metric_123","description":"Identifier shared by every metric in the same revision family. Server-managed — derived from `parentMetricId` on create (or generated for roots). Cannot be set by the caller.","isRequired":true,"uniqueKey":"metricGroupId","typeLabel":"string"},"parentMetricId":{"oneOf":[{"type":"string","example":"metric_122","description":"Id of the direct parent metric. On create, providing this value turns the new metric into a revision: it joins the parent's family and (if the parent is active) flips the parent to legacy. Omit or null to create a root metric in a fresh group. On responses, this is the recorded parent edge (null for roots).","isRequired":true,"uniqueKey":"parentMetricId.oneOf.0","typeLabel":"string"},{"type":"null","example":"metric_122","description":"Id of the direct parent metric. On create, providing this value turns the new metric into a revision: it joins the parent's family and (if the parent is active) flips the parent to legacy. Omit or null to create a root metric in a fresh group. On responses, this is the recorded parent edge (null for roots).","isRequired":true,"uniqueKey":"parentMetricId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"parentMetricId","typeLabel":"string | null"},"organizationId":{"oneOf":[{"type":"string","example":"org_123","isRequired":true,"uniqueKey":"organizationId.oneOf.0","typeLabel":"string"},{"type":"null","example":"org_123","isRequired":true,"uniqueKey":"organizationId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"organizationId","typeLabel":"string | null"},"userId":{"oneOf":[{"type":"string","example":"user_123","isRequired":true,"uniqueKey":"userId.oneOf.0","typeLabel":"string"},{"type":"null","example":"user_123","isRequired":true,"uniqueKey":"userId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"userId","typeLabel":"string | null"},"name":{"type":"string","example":"Accuracy","isRequired":true,"uniqueKey":"name","typeLabel":"string"},"evaluationParams":{"type":"array","items":{"type":"string","uniqueKey":"evaluationParams.items.[INDEX]","typeLabel":"string"},"example":["input","actual_output","expected_output"],"description":"Ordered list of trace fields the evaluator needs, written in snake_case (e.g. `input`, `actual_output`, `expected_output`, `retrieval_context`). Determines which data the evaluation engine extracts from each trace. Full list of accepted values: https://docs.galtea.ai/concepts/metric/evaluation-parameters","isRequired":true,"uniqueKey":"evaluationParams","typeLabel":"string[]"},"source":{"oneOf":[{"type":"string","enum":["SELF_HOSTED","FULL_PROMPT","PARTIAL_PROMPT","HUMAN_EVALUATION","GEVAL","DEEPEVAL","DETERMINISTIC","CLASSIFIER"],"example":"PARTIAL_PROMPT","description":"Evaluation method for the metric. `FULL_PROMPT` is deprecated for creation — `POST /metrics` rejects it with a 400. Use `PARTIAL_PROMPT` for new AI Evaluation metrics. The value remains in the enum because existing FULL_PROMPT metrics are still returned by reads and filters. `CLASSIFIER` is the Classifier (Jev) judge, accepted only where the deployment enables it.","isRequired":true,"uniqueKey":"source.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["SELF_HOSTED","FULL_PROMPT","PARTIAL_PROMPT","HUMAN_EVALUATION","GEVAL","DEEPEVAL","DETERMINISTIC","CLASSIFIER"],"example":"PARTIAL_PROMPT","description":"Evaluation method for the metric. `FULL_PROMPT` is deprecated for creation — `POST /metrics` rejects it with a 400. Use `PARTIAL_PROMPT` for new AI Evaluation metrics. The value remains in the enum because existing FULL_PROMPT metrics are still returned by reads and filters. `CLASSIFIER` is the Classifier (Jev) judge, accepted only where the deployment enables it.","isRequired":true,"uniqueKey":"source.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"source","typeLabel":"enum\u003cstring> | null"},"judgePrompt":{"oneOf":[{"type":"string","example":"Evaluate the accuracy of the response","isRequired":true,"uniqueKey":"judgePrompt.oneOf.0","typeLabel":"string"},{"type":"null","example":"Evaluate the accuracy of the response","isRequired":true,"uniqueKey":"judgePrompt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"judgePrompt","typeLabel":"string | null"},"tags":{"type":"array","items":{"type":"string","uniqueKey":"tags.items.[INDEX]","typeLabel":"string"},"example":["accuracy","quality"],"isRequired":true,"uniqueKey":"tags","typeLabel":"string[]"},"description":{"oneOf":[{"type":"string","example":"Measures the accuracy of responses","isRequired":true,"uniqueKey":"description.oneOf.0","typeLabel":"string"},{"type":"null","example":"Measures the accuracy of responses","isRequired":true,"uniqueKey":"description.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"description","typeLabel":"string | null"},"documentationUrl":{"oneOf":[{"type":"string","example":"https://docs.example.com/metrics/accuracy","isRequired":true,"uniqueKey":"documentationUrl.oneOf.0","typeLabel":"string"},{"type":"null","example":"https://docs.example.com/metrics/accuracy","isRequired":true,"uniqueKey":"documentationUrl.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"documentationUrl","typeLabel":"string | null"},"evaluatorModelName":{"oneOf":[{"type":"string","example":"GPT-4","isRequired":true,"uniqueKey":"evaluatorModelName.oneOf.0","typeLabel":"string"},{"type":"null","example":"GPT-4","isRequired":true,"uniqueKey":"evaluatorModelName.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"evaluatorModelName","typeLabel":"string | null"},"areEvalParamsTop":{"oneOf":[{"type":"boolean","description":"When true, evaluationParams are injected at the top level of the evaluator prompt instead of nested inside the conversation context.","isRequired":true,"uniqueKey":"areEvalParamsTop.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"When true, evaluationParams are injected at the top level of the evaluator prompt instead of nested inside the conversation context.","isRequired":true,"uniqueKey":"areEvalParamsTop.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"areEvalParamsTop","typeLabel":"boolean | null"},"isBeingOptimized":{"type":"boolean","readOnly":true,"description":"Whether the metric is currently being optimized.","isRequired":true,"uniqueKey":"isBeingOptimized","typeLabel":"boolean"},"optimizationStatus":{"oneOf":[{"type":"string","enum":["OPTIMIZING","READY_FOR_REVIEW","FAILED","NO_IMPROVEMENT","DECLINED","ACTIVATED"],"readOnly":true,"example":"READY_FOR_REVIEW","description":"Where an optimization attempt stands. Null for a metric that did not come from an optimization. A candidate waiting for review is legacy until it is activated.","isRequired":true,"uniqueKey":"optimizationStatus.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["OPTIMIZING","READY_FOR_REVIEW","FAILED","NO_IMPROVEMENT","DECLINED","ACTIVATED"],"readOnly":true,"example":"READY_FOR_REVIEW","description":"Where an optimization attempt stands. Null for a metric that did not come from an optimization. A candidate waiting for review is legacy until it is activated.","isRequired":true,"uniqueKey":"optimizationStatus.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationStatus","typeLabel":"enum\u003cstring> | null"},"judgeGenerationSettings":{"oneOf":[{"type":"object","properties":{"temperature":{"oneOf":[{"type":"number","minimum":0,"example":0.3,"uniqueKey":"judgeGenerationSettings.oneOf.0.temperature.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"example":0.3,"uniqueKey":"judgeGenerationSettings.oneOf.0.temperature.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.temperature","typeLabel":"number | null"},"topP":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.9,"uniqueKey":"judgeGenerationSettings.oneOf.0.topP.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.9,"uniqueKey":"judgeGenerationSettings.oneOf.0.topP.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.topP","typeLabel":"number | null"},"maxOutputTokens":{"oneOf":[{"type":"integer","minimum":1,"example":512,"uniqueKey":"judgeGenerationSettings.oneOf.0.maxOutputTokens.oneOf.0","typeLabel":"integer"},{"type":"null","minimum":1,"example":512,"uniqueKey":"judgeGenerationSettings.oneOf.0.maxOutputTokens.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.maxOutputTokens","typeLabel":"integer | null"},"reasoningEffort":{"oneOf":[{"type":"string","example":"low","uniqueKey":"judgeGenerationSettings.oneOf.0.reasoningEffort.oneOf.0","typeLabel":"string"},{"type":"null","example":"low","uniqueKey":"judgeGenerationSettings.oneOf.0.reasoningEffort.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.reasoningEffort","typeLabel":"string | null"}},"additionalProperties":false,"description":"The generation settings this metric's judge runs with. Null runs the platform defaults. Immutable: changing one creates a revision.","isRequired":true,"uniqueKey":"judgeGenerationSettings.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"temperature":{"oneOf":[{"type":"number","minimum":0,"example":0.3},{"type":"null","minimum":0,"example":0.3}]},"topP":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.9},{"type":"null","minimum":0,"maximum":1,"example":0.9}]},"maxOutputTokens":{"oneOf":[{"type":"integer","minimum":1,"example":512},{"type":"null","minimum":1,"example":512}]},"reasoningEffort":{"oneOf":[{"type":"string","example":"low"},{"type":"null","example":"low"}]}},"additionalProperties":false,"description":"The generation settings this metric's judge runs with. Null runs the platform defaults. Immutable: changing one creates a revision.","isRequired":true,"uniqueKey":"judgeGenerationSettings.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"judgeGenerationSettings","typeLabel":"object | null"},"passThreshold":{"type":"number","minimum":0,"maximum":1,"example":0.7,"description":"Score from 0 to 1 at or above which an evaluation of this metric passes. Immutable: changing it creates a revision.","isRequired":true,"uniqueKey":"passThreshold","typeLabel":"number"},"applicabilityScope":{"type":"string","enum":["NONE","DEVELOPMENT","PRODUCTION","ALL"],"example":"PRODUCTION","description":"Which sessions get the applicability check before this metric is judged. `NONE` for a metric the platform does not score. A metric that scores `traces` is never checked, so it takes `NONE` and refuses any other value. A FULL_PROMPT metric whose judge prompt reads `traces` but does not list it in evaluationParams is stored as checked, yet the evaluator judges it without the check. Immutable: changing it creates a revision. The check runs only where the deployment enables it.","isRequired":true,"uniqueKey":"applicabilityScope","typeLabel":"enum\u003cstring>"},"applicabilityThreshold":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.7,"description":"The lowest probability that the metric applies to a session at which it is judged. Null means the platform default, 0.5. Immutable: changing it creates a revision.","isRequired":true,"uniqueKey":"applicabilityThreshold.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.7,"description":"The lowest probability that the metric applies to a session at which it is judged. Null means the platform default, 0.5. Immutable: changing it creates a revision.","isRequired":true,"uniqueKey":"applicabilityThreshold.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"applicabilityThreshold","typeLabel":"number | null"},"classifierQuestion":{"type":"object","description":"The one question of a CLASSIFIER metric; null for every other source.","required":["type","instructions"],"properties":{"type":{"type":"string","enum":["yes_no","scale"],"isRequired":true,"uniqueKey":"classifierQuestion.type","typeLabel":"enum\u003cstring>"},"instructions":{"type":"string","isRequired":true,"uniqueKey":"classifierQuestion.instructions","typeLabel":"string"},"goodAnswer":{"type":"string","enum":["yes","no"],"uniqueKey":"classifierQuestion.goodAnswer","typeLabel":"enum\u003cstring>"},"criteria":{"oneOf":[{"type":"object","properties":{"yes":{"oneOf":[{"type":"string","isRequired":true,"uniqueKey":"classifierQuestion.criteria.oneOf.0.yes.oneOf.0","typeLabel":"string"},{"type":"null","isRequired":true,"uniqueKey":"classifierQuestion.criteria.oneOf.0.yes.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"classifierQuestion.criteria.oneOf.0.yes","typeLabel":"string | null"},"no":{"oneOf":[{"type":"string","isRequired":true,"uniqueKey":"classifierQuestion.criteria.oneOf.0.no.oneOf.0","typeLabel":"string"},{"type":"null","isRequired":true,"uniqueKey":"classifierQuestion.criteria.oneOf.0.no.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"classifierQuestion.criteria.oneOf.0.no","typeLabel":"string | null"}},"required":["yes","no"],"uniqueKey":"classifierQuestion.criteria.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"yes":{"oneOf":[{"type":"string"},{"type":"null"}]},"no":{"oneOf":[{"type":"string"},{"type":"null"}]}},"required":["yes","no"],"uniqueKey":"classifierQuestion.criteria.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.criteria","typeLabel":"object | null"},"levels":{"type":"array","items":{"type":"object","properties":{"description":{"type":"string","isRequired":true,"uniqueKey":"classifierQuestion.levels.items.[INDEX].description","typeLabel":"string"},"score":{"type":"number","isRequired":true,"uniqueKey":"classifierQuestion.levels.items.[INDEX].score","typeLabel":"number"}},"required":["description","score"],"uniqueKey":"classifierQuestion.levels.items.[INDEX]","typeLabel":"object"},"uniqueKey":"classifierQuestion.levels","typeLabel":"object[]"},"doesNotApply":{"oneOf":[{"type":"string","uniqueKey":"classifierQuestion.doesNotApply.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"classifierQuestion.doesNotApply.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.doesNotApply","typeLabel":"string | null"}},"isRequired":true,"uniqueKey":"classifierQuestion","typeLabel":"object"},"optimizationValidation":{"oneOf":[{"type":"object","properties":{"used":{"type":"boolean","description":"Whether any evaluation was held out for validation. False when none was: too few annotated evaluations and no session kept from an earlier attempt, or no session was eligible for the hold-out.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.used","typeLabel":"boolean"},"heldOutEvaluationIds":{"type":"array","items":{"type":"string","uniqueKey":"optimizationValidation.oneOf.0.heldOutEvaluationIds.items.[INDEX]","typeLabel":"string"},"description":"Evaluations held out of the search. Empty when no validation set was used.","example":["evaluation_123"],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.heldOutEvaluationIds","typeLabel":"string[]"},"results":{"oneOf":[{"type":"object","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.rowsScored","typeLabel":"integer"},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.rowsTotal","typeLabel":"integer"},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.source","typeLabel":"object"},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate","typeLabel":"object"}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.optimization","typeLabel":"object"},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.rowsScored","typeLabel":"integer"},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.rowsTotal","typeLabel":"integer"},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.source.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.source.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.source.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.source.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.source","typeLabel":"object"},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate","typeLabel":"object"}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0.validation","typeLabel":"object"}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.results","typeLabel":"object | null"},"rows":{"oneOf":[{"type":"array","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].evaluationId","typeLabel":"string"},"humanScore":{"type":"number","description":"The human label.","example":1,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].humanScore","typeLabel":"number"},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].sourceScore.oneOf.0","typeLabel":"number"},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].sourceScore.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].sourceScore","typeLabel":"number | null"},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].candidateScore.oneOf.0","typeLabel":"number"},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1,"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].candidateScore.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].candidateScore","typeLabel":"number | null"}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX]","typeLabel":"object"},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.0","typeLabel":"object[]"},{"type":"null","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123"},"humanScore":{"type":"number","description":"The human label.","example":1},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0}]},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1}]}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0.rows","typeLabel":"object[] | null"}},"required":["used","heldOutEvaluationIds","results","rows"],"additionalProperties":false,"readOnly":true,"description":"How an optimization attempt was validated: the held-out evaluations and, once the optimizer reported, both prompts scored on the search rows and on the held-out rows. Set on an optimization attempt only, and null for any other metric, for an attempt that predates it, and for an attempt copied from another organization.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"used":{"type":"boolean","description":"Whether any evaluation was held out for validation. False when none was: too few annotated evaluations and no session kept from an earlier attempt, or no session was eligible for the hold-out."},"heldOutEvaluationIds":{"type":"array","items":{"type":"string"},"description":"Evaluations held out of the search. Empty when no validation set was used.","example":["evaluation_123"]},"results":{"oneOf":[{"type":"object","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing."},{"type":"null","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing."}]},"rows":{"oneOf":[{"type":"array","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123"},"humanScore":{"type":"number","description":"The human label.","example":1},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0}]},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1}]}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing."},{"type":"null","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123"},"humanScore":{"type":"number","description":"The human label.","example":1},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0}]},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1}]}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing."}]}},"required":["used","heldOutEvaluationIds","results","rows"],"additionalProperties":false,"readOnly":true,"description":"How an optimization attempt was validated: the held-out evaluations and, once the optimizer reported, both prompts scored on the search rows and on the held-out rows. Set on an optimization attempt only, and null for any other metric, for an attempt that predates it, and for an attempt copied from another organization.","isRequired":true,"uniqueKey":"optimizationValidation.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationValidation","typeLabel":"object | null"},"optimizationRun":{"oneOf":[{"type":"object","properties":{"strategies":{"type":"array","items":{"type":"string","enum":["FIX_FALSE_POSITIVES","FIX_FALSE_NEGATIVES","ADD_RUBRIC","SIMPLIFY","BROADEN"],"uniqueKey":"optimizationRun.oneOf.0.strategies.items.[INDEX]","typeLabel":"enum\u003cstring>"},"description":"The strategies the run wrote candidates with.","example":["ADD_RUBRIC","SIMPLIFY"],"isRequired":true,"uniqueKey":"optimizationRun.oneOf.0.strategies","typeLabel":"enum\u003cstring>[]"},"maxSteps":{"type":"integer","minimum":1,"description":"The run's step budget, after the optimizer applied its own ceiling.","example":6,"isRequired":true,"uniqueKey":"optimizationRun.oneOf.0.maxSteps","typeLabel":"integer"},"stepsUsed":{"type":"integer","minimum":0,"description":"The search steps the run took. 0 when the source prompt already met the target.","example":4,"isRequired":true,"uniqueKey":"optimizationRun.oneOf.0.stepsUsed","typeLabel":"integer"}},"required":["strategies","maxSteps","stepsUsed"],"additionalProperties":false,"readOnly":true,"description":"What an optimization attempt ran: the strategies, the step budget and the steps used. Null while the attempt runs, and when it was not reported: an attempt from before the report existed, one run by an older optimizer, a failed run, an attempt copied from another organization, or a metric that is not an optimization attempt. Null never means a run of 0 steps.","isRequired":true,"uniqueKey":"optimizationRun.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"strategies":{"type":"array","items":{"type":"string","enum":["FIX_FALSE_POSITIVES","FIX_FALSE_NEGATIVES","ADD_RUBRIC","SIMPLIFY","BROADEN"]},"description":"The strategies the run wrote candidates with.","example":["ADD_RUBRIC","SIMPLIFY"]},"maxSteps":{"type":"integer","minimum":1,"description":"The run's step budget, after the optimizer applied its own ceiling.","example":6},"stepsUsed":{"type":"integer","minimum":0,"description":"The search steps the run took. 0 when the source prompt already met the target.","example":4}},"required":["strategies","maxSteps","stepsUsed"],"additionalProperties":false,"readOnly":true,"description":"What an optimization attempt ran: the strategies, the step budget and the steps used. Null while the attempt runs, and when it was not reported: an attempt from before the report existed, one run by an older optimizer, a failed run, an attempt copied from another organization, or a metric that is not an optimization attempt. Null never means a run of 0 steps.","isRequired":true,"uniqueKey":"optimizationRun.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"optimizationRun","typeLabel":"object | null"},"specificationIds":{"type":"array","items":{"type":"string","uniqueKey":"specificationIds.items.[INDEX]","typeLabel":"string"},"description":"Specifications linked to this metric. A READER or HUMAN_EVALUATOR caller sees only the specifications of the products it can read.","example":["spec_123"],"isRequired":true,"uniqueKey":"specificationIds","typeLabel":"string[]"},"userGroupIds":{"type":"array","items":{"type":"string","uniqueKey":"userGroupIds.items.[INDEX]","typeLabel":"string"},"example":["ug_123"],"isRequired":true,"uniqueKey":"userGroupIds","typeLabel":"string[]"},"createdAt":{"type":"string","format":"date-time","isRequired":true,"uniqueKey":"createdAt","typeLabel":"string\u003cdate-time>"},"legacyAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"Earliest non-null of this metric's own legacy date and its evaluator model's `unselectableAt`, so a model no longer selectable makes every metric linked to it report as legacy even though the metric row itself is untouched. Present only once that date has passed: a scheduled future cutoff reports null, because the metric is still active until then. Unlike `disabledAt`, this field never carries a future date.","isRequired":true,"uniqueKey":"legacyAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"Earliest non-null of this metric's own legacy date and its evaluator model's `unselectableAt`, so a model no longer selectable makes every metric linked to it report as legacy even though the metric row itself is untouched. Present only once that date has passed: a scheduled future cutoff reports null, because the metric is still active until then. Unlike `disabledAt`, this field never carries a future date.","isRequired":true,"uniqueKey":"legacyAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"legacyAt","typeLabel":"string\u003cdate-time> | null"},"disabledAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"Earliest non-null of this metric's own disabled date and its evaluator model's `disabledAt` — a disabled model makes every metric linked to it report as disabled even though the metric row itself is untouched.","isRequired":true,"uniqueKey":"disabledAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"Earliest non-null of this metric's own disabled date and its evaluator model's `disabledAt` — a disabled model makes every metric linked to it report as disabled even though the metric row itself is untouched.","isRequired":true,"uniqueKey":"disabledAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"disabledAt","typeLabel":"string\u003cdate-time> | null"},"excludedFromAnalyticsAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"When set, results produced by this metric revision do not feed analytics.","isRequired":true,"uniqueKey":"excludedFromAnalyticsAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"When set, results produced by this metric revision do not feed analytics.","isRequired":true,"uniqueKey":"excludedFromAnalyticsAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"excludedFromAnalyticsAt","typeLabel":"string\u003cdate-time> | null"},"excludedByUserId":{"oneOf":[{"type":"string","readOnly":true,"description":"User who last excluded this metric revision from analytics.","isRequired":true,"uniqueKey":"excludedByUserId.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"description":"User who last excluded this metric revision from analytics.","isRequired":true,"uniqueKey":"excludedByUserId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"excludedByUserId","typeLabel":"string | null"}},"required":["id","metricGroupId","parentMetricId","organizationId","userId","name","evaluationParams","source","judgePrompt","tags","description","documentationUrl","evaluatorModelName","areEvalParamsTop","isBeingOptimized","optimizationStatus","judgeGenerationSettings","passThreshold","applicabilityScope","applicabilityThreshold","classifierQuestion","optimizationValidation","optimizationRun","specificationIds","userGroupIds","createdAt","legacyAt","disabledAt","excludedFromAnalyticsAt","excludedByUserId"],"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"id":"metric_123","metricGroupId":"metric_123","parentMetricId":"metric_122","organizationId":"org_123","userId":"user_123","name":"Accuracy","evaluationParams":["input","actual_output","expected_output"],"source":"PARTIAL_PROMPT","judgePrompt":"Evaluate the accuracy of the response","tags":["accuracy","quality"],"description":"Measures the accuracy of responses","documentationUrl":"https://docs.example.com/metrics/accuracy","evaluatorModelName":"GPT-4","areEvalParamsTop":true,"isBeingOptimized":true,"optimizationStatus":"READY_FOR_REVIEW","judgeGenerationSettings":{"temperature":0.3,"topP":0.9,"maxOutputTokens":512,"reasoningEffort":"low"},"passThreshold":0.7,"applicabilityScope":"PRODUCTION","applicabilityThreshold":0.7,"classifierQuestion":{"type":"yes_no","instructions":"\u003cstring>","goodAnswer":"yes","criteria":{"yes":"\u003cstring>","no":"\u003cstring>"},"levels":[{"description":"\u003cstring>","score":123}],"doesNotApply":"\u003cstring>"},"optimizationValidation":{"used":true,"heldOutEvaluationIds":["evaluation_123"],"results":{"optimization":{"rowsScored":25,"rowsTotal":25,"source":{"correct":20,"alignment":0.71},"candidate":{"correct":20,"alignment":0.71}},"validation":{"rowsScored":25,"rowsTotal":25,"source":{"correct":20,"alignment":0.71},"candidate":{"correct":20,"alignment":0.71}}},"rows":[{"evaluationId":"evaluation_123","humanScore":1,"sourceScore":0,"candidateScore":1}]},"optimizationRun":{"strategies":["ADD_RUBRIC","SIMPLIFY"],"maxSteps":6,"stepsUsed":4},"specificationIds":["spec_123"],"userGroupIds":["ug_123"],"createdAt":"2023-11-07T05:31:56Z","legacyAt":"2023-11-07T05:31:56Z","disabledAt":"2023-11-07T05:31:56Z","excludedFromAnalyticsAt":"2023-11-07T05:31:56Z","excludedByUserId":"\u003cstring>"}}},"exampleType":"generated"}},"exampleType":"generated"},"d89ca9fc-957e-4a8a-bb59-74449352ba35":{"description":"Bad request","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"8ad4de88-5266-44a6-8e94-e0eef73579bf":{"description":"Unauthorized","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"dbb8bbf9-6067-4c9e-855f-c0ee47a81aaf":{"description":"Forbidden","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"}},"security":{"79e8d50e-c6db-49ed-8cd4-5125747b4167":{"bearerAuth":{"type":"http","scheme":"bearer","description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","scopes":[],"schemeName":"bearerAuth"}}},"servers":{"b802bc4d-c7c2-47e8-8ccd-283b787d3e40":{"url":"https://api.galtea.ai"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"http","scheme":"bearer","description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","scopes":[],"schemeName":"bearerAuth"},"schema":{"title":"Bearer Auth","type":"string","isRequired":true,"description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","format":"bearer","typeLabel":"string\u003cbearer>","deprecated":false},"schemeName":"bearerAuth","name":"Authorization"}],"title":"bearerAuth"}]},"originalFileLocation":"v5.13/openapi.json"},"subdomain":"galtea","siteName":"Galtea Docs","title":"Keep the current judge prompt over an optimized candidate - Galtea Docs","navMaps":{"firstHrefInVersion":{"5.18":{"href":"/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.17":{"href":"/v5.17/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.16":{"href":"/v5.16/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.15":{"href":"/v5.15/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.14":{"href":"/v5.14/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.13":{"href":"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":0},"5.12":{"href":"/v5.12/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.11":{"href":"/v5.11/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1},"5.10":{"href":"/v5.10/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate","matchLevel":1}},"firstHrefInLanguage":{}},"lastModified":"2026-11-17T11:07:40.098Z","originalFileLocation":"v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Keep the current judge prompt over an optimized candidate - Galtea Docs\">\u003cmeta data-mint-head property=\"og:description\" content=\"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Galtea Docs\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=metrics\u0026amp;title=Keep+the+current+judge+prompt+over+an+optimized+candidate\u0026amp;description=Leaves+the+source+metric+unchanged+and+keeps+this+optimization+candidate+in+revision+history+as+not+activated.+Another+optimization+can+then+be+started+from+the\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=1810986588efcabc7ec6c2adf8a63f51fa76e0f3f9c16a886e2ed7279e84012a\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Keep the current judge prompt over an optimized candidate - Galtea Docs\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=metrics\u0026amp;title=Keep+the+current+judge+prompt+over+an+optimized+candidate\u0026amp;description=Leaves+the+source+metric+unchanged+and+keeps+this+optimization+candidate+in+revision+history+as+not+activated.+Another+optimization+can+then+be+started+from+the\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=1810986588efcabc7ec6c2adf8a63f51fa76e0f3f9c16a886e2ed7279e84012a\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#5286FF\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.galtea.ai/#organization\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.galtea.ai#website\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate#webpage\",\"url\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate\",\"name\":\"Keep the current judge prompt over an optimized candidate\",\"description\":\"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.\",\"dateModified\":\"2026-11-17T11:07:40.098Z\",\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Endpoints\",\"item\":\"https://docs.galtea.ai/v5.13/api-reference/health-check\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"metrics\",\"item\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/get-metrics\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Keep the current judge prompt over an optimized candidate\",\"item\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate#apireference\",\"headline\":\"Keep the current judge prompt over an optimized candidate\",\"name\":\"Keep the current judge prompt over an optimized candidate\",\"description\":\"Leaves the source metric unchanged and keeps this optimization candidate in revision history as not activated. Another optimization can then be started from the source. Repeating it on a candidate already declined returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was activated or is otherwise not waiting for review.\",\"url\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate\",\"mainEntityOfPage\":{\"@id\":\"https://docs.galtea.ai/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate#webpage\"},\"dateModified\":\"2026-11-17T11:07:40.098Z\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Galtea Docs\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Galtea Docs\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate.md","siteName":"Galtea Docs","nav":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"versions":[{"version":"5.18","default":true,"tag":"Latest","pages":[{"title":"5.18","href":"/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.17","pages":[{"title":"5.17","href":"/v5.17/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.16","pages":[{"title":"5.16","href":"/v5.16/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.15","pages":[{"title":"5.15","href":"/v5.15/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.14","pages":[{"title":"5.14","href":"/v5.14/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.13","tabs":[{"tab":"Guides","pages":[{"title":"Guides","href":"/v5.13/introduction"}]},{"tab":"Concepts","pages":[{"title":"Concepts","href":"/v5.13/concepts/overview"}]},{"tab":"Deployment","pages":[{"title":"Deployment","href":"/v5.13/deployment/executive-summary"}]},{"tab":"REST API","groups":[{"group":"Overview","pages":[{"title":"Write responses","icon":"reply","href":"/v5.13/api-reference/write-responses"},{"title":"Enum values","icon":"list","href":"/v5.13/api-reference/enum-values"}]},{"group":"Endpoints","pages":[{"group":"API Reference","pages":[{"title":"Health check","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /health","href":"/v5.13/api-reference/health-check"},{"title":"Get minimum SDK version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /minimum-sdk-version","href":"/v5.13/api-reference/get-minimum-sdk-version"},{"title":"Build info","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /build-info","href":"/v5.13/api-reference/build-info"},{"title":"Build info for every deployed service","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /build-info/services","href":"/v5.13/api-reference/build-info-for-every-deployed-service"},{"title":"Whether every deployed service can reach its dependencies","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /self-check","href":"/v5.13/api-reference/whether-every-deployed-service-can-reach-its-dependencies"}]},{"group":"api-tokens","pages":[{"title":"List API tokens","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /auth/apiTokens","href":"/v5.13/api-reference/api-tokens/list-api-tokens"},{"title":"Create API token","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /auth/apiTokens","href":"/v5.13/api-reference/api-tokens/create-api-token"},{"title":"Revoke API token","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /auth/apiTokens/{apiTokenId}","href":"/v5.13/api-reference/api-tokens/revoke-api-token"},{"title":"Rename API token","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /auth/apiTokens/{apiTokenId}","href":"/v5.13/api-reference/api-tokens/rename-api-token"},{"title":"Regenerate API token","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /auth/apiTokens/{apiTokenId}/regenerate","href":"/v5.13/api-reference/api-tokens/regenerate-api-token"}]},{"group":"auth","pages":[{"title":"Get current user","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /auth/user","href":"/v5.13/api-reference/auth/get-current-user"}]},{"group":"organizations","pages":[{"title":"Get organizations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /organizations","href":"/v5.13/api-reference/organizations/get-organizations"},{"title":"Get organization by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /organizations/{id}","href":"/v5.13/api-reference/organizations/get-organization-by-id"},{"title":"Update organization","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /organizations/{id}","href":"/v5.13/api-reference/organizations/update-organization"},{"title":"Get credit status","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /organizations/{id}/creditStatus","href":"/v5.13/api-reference/organizations/get-credit-status"}]},{"group":"user-groups","pages":[{"title":"Get user groups","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /userGroups","href":"/v5.13/api-reference/user-groups/get-user-groups"},{"title":"Create user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /userGroups","href":"/v5.13/api-reference/user-groups/create-user-group"},{"title":"Get user group by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /userGroups/{id}","href":"/v5.13/api-reference/user-groups/get-user-group-by-id"},{"title":"Delete user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /userGroups/{id}","href":"/v5.13/api-reference/user-groups/delete-user-group"},{"title":"Update user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /userGroups/{id}","href":"/v5.13/api-reference/user-groups/update-user-group"},{"title":"Link users to user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /userGroups/{id}/users","href":"/v5.13/api-reference/user-groups/link-users-to-user-group"},{"title":"Unlink users from user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /userGroups/{id}/users","href":"/v5.13/api-reference/user-groups/unlink-users-from-user-group"},{"title":"Delete multiple user groups","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /userGroups/batch","href":"/v5.13/api-reference/user-groups/delete-multiple-user-groups"},{"title":"Link metrics to user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /userGroups/{id}/metrics","href":"/v5.13/api-reference/user-groups/link-metrics-to-user-group"},{"title":"Unlink metrics from user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /userGroups/{id}/metrics","href":"/v5.13/api-reference/user-groups/unlink-metrics-from-user-group"},{"title":"Link products to user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /userGroups/{id}/products","href":"/v5.13/api-reference/user-groups/link-products-to-user-group"},{"title":"Unlink products from user group","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /userGroups/{id}/products","href":"/v5.13/api-reference/user-groups/unlink-products-from-user-group"}]},{"group":"metrics","pages":[{"title":"Get metrics","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /metrics","href":"/v5.13/api-reference/metrics/get-metrics"},{"title":"Create metric","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics","href":"/v5.13/api-reference/metrics/create-metric"},{"title":"Get metric by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /metrics/{id}","href":"/v5.13/api-reference/metrics/get-metric-by-id"},{"title":"Delete metric","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /metrics/{id}","href":"/v5.13/api-reference/metrics/delete-metric"},{"title":"Update metric","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /metrics/{id}","href":"/v5.13/api-reference/metrics/update-metric"},{"title":"Create multiple metrics","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/batch","href":"/v5.13/api-reference/metrics/create-multiple-metrics"},{"title":"Delete multiple metrics","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /metrics/batch","href":"/v5.13/api-reference/metrics/delete-multiple-metrics"},{"title":"Count replay candidates per product for a metric revision","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /metrics/{id}/replay-candidate-count","href":"/v5.13/api-reference/metrics/count-replay-candidates-per-product-for-a-metric-revision"},{"title":"Generate or complete metric configuration with AI","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/generate-config","href":"/v5.13/api-reference/metrics/generate-or-complete-metric-configuration-with-ai"},{"title":"Preview the prompt a judge configuration produces","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/preview-prompt","href":"/v5.13/api-reference/metrics/preview-the-prompt-a-judge-configuration-produces"},{"title":"Export a metric revision as a document","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /metrics/{id}/export","href":"/v5.13/api-reference/metrics/export-a-metric-revision-as-a-document"},{"title":"Get the analytics impact of a metric revision","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /metrics/{id}/analytics-exclusion-impact","href":"/v5.13/api-reference/metrics/get-the-analytics-impact-of-a-metric-revision"},{"title":"Include or exclude a metric revision from analytics","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /metrics/{id}/analytics-exclusion","href":"/v5.13/api-reference/metrics/include-or-exclude-a-metric-revision-from-analytics"},{"title":"Get human annotation count and optimization eligibility","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /metrics/{id}/human-annotation-count","href":"/v5.13/api-reference/metrics/get-human-annotation-count-and-optimization-eligibility"},{"title":"Optimize metric","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/{id}/optimize","href":"/v5.13/api-reference/metrics/optimize-metric"},{"title":"Activate an optimized judge prompt","description":"Makes this optimization candidate the active revision: it takes the source metric's name, description and tags, the source's specifications and user groups are linked to it too, and the source becomes legacy — all in one step. Repeating it on a candidate already activated returns 200 with the metric and changes nothing. Rejected with 400 if the candidate was declined or is otherwise not waiting for review, if the source changed since the candidate was created (revised, deleted, or already flipped legacy), or if the source's judge model is no longer selectable.","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/{id}/activate-optimization","href":"/v5.13/api-reference/metrics/activate-an-optimized-judge-prompt"},{"title":"Keep the current judge prompt over an optimized candidate","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/{id}/decline-optimization","href":"/v5.13/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"},{"title":"Revise metric configuration with AI (Update With AI)","description":"Given a metric config the caller already has (name, description, judge prompt, evaluation params, evaluation type) plus one line of feedback, returns a revised judge prompt, evaluation parameters, and description. Persists nothing — the caller decides whether to apply the result.","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /metrics/update-config","href":"/v5.13/api-reference/metrics/revise-metric-configuration-with-ai-update-with-ai"}]},{"group":"specifications","pages":[{"title":"Get specifications","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /specifications","href":"/v5.13/api-reference/specifications/get-specifications"},{"title":"Create specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /specifications","href":"/v5.13/api-reference/specifications/create-specification"},{"title":"Get specification by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /specifications/{id}","href":"/v5.13/api-reference/specifications/get-specification-by-id"},{"title":"Delete specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /specifications/{id}","href":"/v5.13/api-reference/specifications/delete-specification"},{"title":"Update specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /specifications/{id}","href":"/v5.13/api-reference/specifications/update-specification"},{"title":"Create multiple specifications","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /specifications/batch","href":"/v5.13/api-reference/specifications/create-multiple-specifications"},{"title":"Delete multiple specifications","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /specifications/batch","href":"/v5.13/api-reference/specifications/delete-multiple-specifications"},{"title":"Get linked metrics","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /specifications/{id}/metrics","href":"/v5.13/api-reference/specifications/get-linked-metrics"},{"title":"Link metrics to specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /specifications/{id}/metrics","href":"/v5.13/api-reference/specifications/link-metrics-to-specification"},{"title":"Unlink metrics from specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /specifications/{id}/metrics","href":"/v5.13/api-reference/specifications/unlink-metrics-from-specification"},{"title":"Get linked datasets","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /specifications/{id}/tests","href":"/v5.13/api-reference/specifications/get-linked-datasets"},{"title":"Link datasets to specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /specifications/{id}/tests","href":"/v5.13/api-reference/specifications/link-datasets-to-specification"},{"title":"Unlink datasets from specification","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /specifications/{id}/tests","href":"/v5.13/api-reference/specifications/unlink-datasets-from-specification"},{"title":"Generate specification configuration","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /specifications/generate-config","href":"/v5.13/api-reference/specifications/generate-specification-configuration"}]},{"group":"models","pages":[{"title":"Get models","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /models","href":"/v5.13/api-reference/models/get-models"},{"title":"Create model","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /models","href":"/v5.13/api-reference/models/create-model"},{"title":"Get model by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /models/{id}","href":"/v5.13/api-reference/models/get-model-by-id"},{"title":"Delete model","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /models/{id}","href":"/v5.13/api-reference/models/delete-model"},{"title":"Update model","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /models/{id}","href":"/v5.13/api-reference/models/update-model"},{"title":"Delete multiple models","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /models/batch","href":"/v5.13/api-reference/models/delete-multiple-models"}]},{"group":"products","pages":[{"title":"Get products","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /products","href":"/v5.13/api-reference/products/get-products"},{"title":"Create product","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /products","href":"/v5.13/api-reference/products/create-product"},{"title":"List distinct product tags","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /products/tags","href":"/v5.13/api-reference/products/list-distinct-product-tags"},{"title":"Delete multiple products","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /products/batch","href":"/v5.13/api-reference/products/delete-multiple-products"},{"title":"Get product by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /products/{id}","href":"/v5.13/api-reference/products/get-product-by-id"},{"title":"Delete product","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /products/{id}","href":"/v5.13/api-reference/products/delete-product"},{"title":"Update product","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /products/{id}","href":"/v5.13/api-reference/products/update-product"},{"title":"Generate product configuration using AI","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /products/generate-config","href":"/v5.13/api-reference/products/generate-product-configuration-using-ai"},{"title":"Cross-check a document against an existing product's specifications","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /products/{id}/regenerate-config","href":"/v5.13/api-reference/products/cross-check-a-document-against-an-existing-products-specifications"}]},{"group":"versions","pages":[{"title":"Get versions","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /versions","href":"/v5.13/api-reference/versions/get-versions"},{"title":"Create version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /versions","href":"/v5.13/api-reference/versions/create-version"},{"title":"Get version by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /versions/{id}","href":"/v5.13/api-reference/versions/get-version-by-id"},{"title":"Delete version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /versions/{id}","href":"/v5.13/api-reference/versions/delete-version"},{"title":"Update version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /versions/{id}","href":"/v5.13/api-reference/versions/update-version"},{"title":"List metrics annotated with compatibility for a version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /versions/{id}/compatible-metrics","href":"/v5.13/api-reference/versions/list-metrics-annotated-with-compatibility-for-a-version"},{"title":"Delete multiple versions","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /versions/batch","href":"/v5.13/api-reference/versions/delete-multiple-versions"},{"title":"Get or create version by facts","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /versions/get-or-create","href":"/v5.13/api-reference/versions/get-or-create-version-by-facts"}]},{"group":"monitors","pages":[{"title":"Get monitor results","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors/{id}/results","href":"/v5.13/api-reference/monitors/get-monitor-results"},{"title":"Delete multiple monitors","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /monitors/batch","href":"/v5.13/api-reference/monitors/delete-multiple-monitors"},{"title":"Get monitor by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors/{id}","href":"/v5.13/api-reference/monitors/get-monitor-by-id"},{"title":"Delete monitor","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /monitors/{id}","href":"/v5.13/api-reference/monitors/delete-monitor"},{"title":"Update monitor","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /monitors/{id}","href":"/v5.13/api-reference/monitors/update-monitor"},{"title":"List a monitor's alert rules","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors/{monitorId}/alert-rules","href":"/v5.13/api-reference/monitors/list-a-monitors-alert-rules"},{"title":"Create a monitor alert rule","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/{monitorId}/alert-rules","href":"/v5.13/api-reference/monitors/create-a-monitor-alert-rule"},{"title":"Get a monitor alert rule","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/v5.13/api-reference/monitors/get-a-monitor-alert-rule"},{"title":"Delete a monitor alert rule","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/v5.13/api-reference/monitors/delete-a-monitor-alert-rule"},{"title":"Update a monitor alert rule","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/v5.13/api-reference/monitors/update-a-monitor-alert-rule"},{"title":"Pause a monitor alert rule","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/pause","href":"/v5.13/api-reference/monitors/pause-a-monitor-alert-rule"},{"title":"Resume a monitor alert rule","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/resume","href":"/v5.13/api-reference/monitors/resume-a-monitor-alert-rule"},{"title":"Regenerate an alert rule's webhook signing secret","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/regenerate-webhook-secret","href":"/v5.13/api-reference/monitors/regenerate-an-alert-rules-webhook-signing-secret"},{"title":"List a monitor's alerts","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors/{monitorId}/alerts","href":"/v5.13/api-reference/monitors/list-a-monitors-alerts"},{"title":"Get a monitor alert","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors/{monitorId}/alerts/{alertId}","href":"/v5.13/api-reference/monitors/get-a-monitor-alert"},{"title":"Get monitors","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /monitors","href":"/v5.13/api-reference/monitors/get-monitors"},{"title":"Create monitor","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors","href":"/v5.13/api-reference/monitors/create-monitor"},{"title":"Preview monitor content-filter matches","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/preview","href":"/v5.13/api-reference/monitors/preview-monitor-content-filter-matches"},{"title":"Pause monitor","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/{id}/pause","href":"/v5.13/api-reference/monitors/pause-monitor"},{"title":"Resume monitor","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /monitors/{id}/resume","href":"/v5.13/api-reference/monitors/resume-monitor"}]},{"group":"endpoint-connections","pages":[{"title":"Get endpoint connections","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /endpointConnections","href":"/v5.13/api-reference/endpoint-connections/get-endpoint-connections"},{"title":"Create endpoint connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /endpointConnections","href":"/v5.13/api-reference/endpoint-connections/create-endpoint-connection"},{"title":"Get endpoint connection by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /endpointConnections/{id}","href":"/v5.13/api-reference/endpoint-connections/get-endpoint-connection-by-id"},{"title":"Delete endpoint connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /endpointConnections/{id}","href":"/v5.13/api-reference/endpoint-connections/delete-endpoint-connection"},{"title":"Update endpoint connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /endpointConnections/{id}","href":"/v5.13/api-reference/endpoint-connections/update-endpoint-connection"},{"title":"Test endpoint connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /endpointConnections/testConnection","href":"/v5.13/api-reference/endpoint-connections/test-endpoint-connection"},{"title":"Parse a cURL command into endpoint connection fields","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /endpointConnections/parse-curl","href":"/v5.13/api-reference/endpoint-connections/parse-a-curl-command-into-endpoint-connection-fields"},{"title":"Delete multiple endpoint connections","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /endpointConnections/batch","href":"/v5.13/api-reference/endpoint-connections/delete-multiple-endpoint-connections"}]},{"group":"datasets","pages":[{"title":"Get dataset types used by the organization","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /tests/types","href":"/v5.13/api-reference/datasets/get-dataset-types-used-by-the-organization"},{"title":"Extend a generated dataset with more cases","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /tests/{id}/extend","href":"/v5.13/api-reference/datasets/extend-a-generated-dataset-with-more-cases"},{"title":"Create multiple datasets","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /tests/batch","href":"/v5.13/api-reference/datasets/create-multiple-datasets"},{"title":"Delete multiple datasets","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /tests/batch","href":"/v5.13/api-reference/datasets/delete-multiple-datasets"},{"title":"Get dataset by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /tests/{id}","href":"/v5.13/api-reference/datasets/get-dataset-by-id"},{"title":"Delete dataset","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /tests/{id}","href":"/v5.13/api-reference/datasets/delete-dataset"},{"title":"Update dataset","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /tests/{id}","href":"/v5.13/api-reference/datasets/update-dataset"},{"title":"Get datasets","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /tests","href":"/v5.13/api-reference/datasets/get-datasets"},{"title":"Create dataset","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /tests","href":"/v5.13/api-reference/datasets/create-dataset"},{"title":"Generate dataset configuration from specifications","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /tests/generate-config","href":"/v5.13/api-reference/datasets/generate-dataset-configuration-from-specifications"}]},{"group":"test-cases","pages":[{"title":"Get test cases","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /testCases","href":"/v5.13/api-reference/test-cases/get-test-cases"},{"title":"Create test case","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /testCases","href":"/v5.13/api-reference/test-cases/create-test-case"},{"title":"Get test case languages","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /testCases/languages","href":"/v5.13/api-reference/test-cases/get-test-case-languages"},{"title":"Export test cases as CSV","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /testCases/export","href":"/v5.13/api-reference/test-cases/export-test-cases-as-csv"},{"title":"Get test case by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /testCases/{id}","href":"/v5.13/api-reference/test-cases/get-test-case-by-id"},{"title":"Delete test case","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /testCases/{id}","href":"/v5.13/api-reference/test-cases/delete-test-case"},{"title":"Update test case","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /testCases/{id}","href":"/v5.13/api-reference/test-cases/update-test-case"},{"title":"Delete multiple test cases","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /testCases/batch","href":"/v5.13/api-reference/test-cases/delete-multiple-test-cases"},{"title":"Augment test cases","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /generateFromFewShot/augment","href":"/v5.13/api-reference/test-cases/augment-test-cases"},{"title":"Get augmentation task status","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /generateFromFewShot/status/{taskId}","href":"/v5.13/api-reference/test-cases/get-augmentation-task-status"},{"title":"Count replay candidates per product for a test case revision","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /testCases/{id}/replay-candidate-count","href":"/v5.13/api-reference/test-cases/count-replay-candidates-per-product-for-a-test-case-revision"}]},{"group":"sessions","pages":[{"title":"List metrics annotated with compatibility for a session","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /sessions/{id}/compatible-metrics","href":"/v5.13/api-reference/sessions/list-metrics-annotated-with-compatibility-for-a-session"},{"title":"Get sessions","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /sessions","href":"/v5.13/api-reference/sessions/get-sessions"},{"title":"Create session","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /sessions","href":"/v5.13/api-reference/sessions/create-session"},{"title":"Get session by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /sessions/{id}","href":"/v5.13/api-reference/sessions/get-session-by-id"},{"title":"Delete session","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /sessions/{id}","href":"/v5.13/api-reference/sessions/delete-session"},{"title":"Update session","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /sessions/{id}","href":"/v5.13/api-reference/sessions/update-session"},{"title":"Finish session","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /sessions/{id}/finish","href":"/v5.13/api-reference/sessions/finish-session"},{"title":"Delete multiple sessions","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /sessions/batch","href":"/v5.13/api-reference/sessions/delete-multiple-sessions"},{"title":"Generate next user message","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /conversationSimulator/generateNextUserMessage","href":"/v5.13/api-reference/sessions/generate-next-user-message"},{"title":"Import sessions from a Langfuse trace export","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /sessions/import","href":"/v5.13/api-reference/sessions/import-sessions-from-a-langfuse-trace-export"}]},{"group":"traces","pages":[{"title":"Get traces","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /inferenceResults","href":"/v5.13/api-reference/traces/get-traces"},{"title":"Create trace","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /inferenceResults","href":"/v5.13/api-reference/traces/create-trace"},{"title":"Get aggregated performance data","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /inferenceResults/aggregatedData","href":"/v5.13/api-reference/traces/get-aggregated-performance-data"},{"title":"Get trace by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /inferenceResults/{id}","href":"/v5.13/api-reference/traces/get-trace-by-id"},{"title":"Delete trace","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /inferenceResults/{id}","href":"/v5.13/api-reference/traces/delete-trace"},{"title":"Update trace","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /inferenceResults/{id}","href":"/v5.13/api-reference/traces/update-trace"},{"title":"Create traces batch","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /inferenceResults/batch","href":"/v5.13/api-reference/traces/create-traces-batch"},{"title":"Delete multiple traces","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /inferenceResults/batch","href":"/v5.13/api-reference/traces/delete-multiple-traces"},{"title":"Generate traces from test cases","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /inferenceResults/generate","href":"/v5.13/api-reference/traces/generate-traces-from-test-cases"}]},{"group":"spans","pages":[{"title":"Get spans","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /traces","href":"/v5.13/api-reference/spans/get-spans"},{"title":"Create span","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /traces","href":"/v5.13/api-reference/spans/create-span"},{"title":"Get span by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /traces/{id}","href":"/v5.13/api-reference/spans/get-span-by-id"},{"title":"Delete span","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /traces/{id}","href":"/v5.13/api-reference/spans/delete-span"},{"title":"Create spans batch","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /traces/batch","href":"/v5.13/api-reference/spans/create-spans-batch"},{"title":"Delete multiple spans","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /traces/batch","href":"/v5.13/api-reference/spans/delete-multiple-spans"}]},{"group":"analytics","pages":[{"title":"Get analytics data","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /analytics","href":"/v5.13/api-reference/analytics/get-analytics-data"},{"title":"Export analytics data","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /analytics/export","href":"/v5.13/api-reference/analytics/export-analytics-data"},{"title":"Get analytics insights for a version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /analytics/insights","href":"/v5.13/api-reference/analytics/get-analytics-insights-for-a-version"},{"title":"Get cross-version analytics comparison insights","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /analytics/insights/comparison","href":"/v5.13/api-reference/analytics/get-cross-version-analytics-comparison-insights"},{"title":"Get per-version scores and the newest version, per product","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /analytics/summary","href":"/v5.13/api-reference/analytics/get-per-version-scores-and-the-newest-version-per-product"}]},{"group":"storage","pages":[{"title":"Generate upload presigned URL","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /storage/generate-put-presigned-url","href":"/v5.13/api-reference/storage/generate-upload-presigned-url"},{"title":"Generate download presigned URL","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /storage/generate-get-presigned-url","href":"/v5.13/api-reference/storage/generate-download-presigned-url"}]},{"group":"evaluator-models","pages":[{"title":"Get evaluator models","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /evaluatorModels","href":"/v5.13/api-reference/evaluator-models/get-evaluator-models"},{"title":"Check judge generation settings against the model","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluatorModels/test-generation-settings","href":"/v5.13/api-reference/evaluator-models/check-judge-generation-settings-against-the-model"}]},{"group":"jobs","pages":[{"title":"Get job status","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /jobs/{jobId}/status","href":"/v5.13/api-reference/jobs/get-job-status"},{"title":"Cancel a job","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /jobs/{jobId}/cancel","href":"/v5.13/api-reference/jobs/cancel-a-job"}]},{"group":"otel","pages":[{"title":"Validate credentials for OTel ingestion","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /otel/auth","href":"/v5.13/api-reference/otel/validate-credentials-for-otel-ingestion"},{"title":"Ingest OpenTelemetry spans (OTLP JSON)","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /otel/traces","href":"/v5.13/api-reference/otel/ingest-opentelemetry-spans-otlp-json"}]},{"group":"phone-connections","pages":[{"title":"Get phone connections","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /phoneConnections","href":"/v5.13/api-reference/phone-connections/get-phone-connections"},{"title":"Create phone connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /phoneConnections","href":"/v5.13/api-reference/phone-connections/create-phone-connection"},{"title":"Get phone connection by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /phoneConnections/{id}","href":"/v5.13/api-reference/phone-connections/get-phone-connection-by-id"},{"title":"Delete phone connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /phoneConnections/{id}","href":"/v5.13/api-reference/phone-connections/delete-phone-connection"},{"title":"Update phone connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /phoneConnections/{id}","href":"/v5.13/api-reference/phone-connections/update-phone-connection"},{"title":"Delete multiple phone connections","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /phoneConnections/batch","href":"/v5.13/api-reference/phone-connections/delete-multiple-phone-connections"}]},{"group":"web-rtc-connections","pages":[{"title":"Get WebRTC connections","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /webRtcConnections","href":"/v5.13/api-reference/web-rtc-connections/get-webrtc-connections"},{"title":"Create WebRTC connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /webRtcConnections","href":"/v5.13/api-reference/web-rtc-connections/create-webrtc-connection"},{"title":"Get WebRTC connection by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /webRtcConnections/{id}","href":"/v5.13/api-reference/web-rtc-connections/get-webrtc-connection-by-id"},{"title":"Delete WebRTC connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /webRtcConnections/{id}","href":"/v5.13/api-reference/web-rtc-connections/delete-webrtc-connection"},{"title":"Update WebRTC connection","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json patch /webRtcConnections/{id}","href":"/v5.13/api-reference/web-rtc-connections/update-webrtc-connection"},{"title":"Delete multiple WebRTC connections","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /webRtcConnections/batch","href":"/v5.13/api-reference/web-rtc-connections/delete-multiple-webrtc-connections"}]},{"group":"evaluations","pages":[{"title":"Get evaluations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /evaluations","href":"/v5.13/api-reference/evaluations/get-evaluations"},{"title":"Get evaluation count and last-evaluated date per product","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /evaluations/summary","href":"/v5.13/api-reference/evaluations/get-evaluation-count-and-last-evaluated-date-per-product"},{"title":"Get evaluation by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /evaluations/{id}","href":"/v5.13/api-reference/evaluations/get-evaluation-by-id"},{"title":"Delete evaluation","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /evaluations/{id}","href":"/v5.13/api-reference/evaluations/delete-evaluation"},{"title":"Create evaluations from session","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/fromSession","href":"/v5.13/api-reference/evaluations/create-evaluations-from-session"},{"title":"Evaluate multiple sessions in one call","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/fromSessions","href":"/v5.13/api-reference/evaluations/evaluate-multiple-sessions-in-one-call"},{"title":"Create evaluations for a single trace","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/fromInferenceResult","href":"/v5.13/api-reference/evaluations/create-evaluations-for-a-single-trace"},{"title":"Create single-turn evaluations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/singleTurn","href":"/v5.13/api-reference/evaluations/create-single-turn-evaluations"},{"title":"Retry failed evaluations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/retry","href":"/v5.13/api-reference/evaluations/retry-failed-evaluations"},{"title":"Evaluate a version","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/fromVersion","href":"/v5.13/api-reference/evaluations/evaluate-a-version"},{"title":"Replay evaluations onto a new metric revision","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/fromMetrics","href":"/v5.13/api-reference/evaluations/replay-evaluations-onto-a-new-metric-revision"},{"title":"Replay evaluations onto a new test case revision","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/fromTestCases","href":"/v5.13/api-reference/evaluations/replay-evaluations-onto-a-new-test-case-revision"},{"title":"Delete multiple evaluations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /evaluations/batch","href":"/v5.13/api-reference/evaluations/delete-multiple-evaluations"},{"title":"Get pending human evaluations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /evaluations/human/pending","href":"/v5.13/api-reference/evaluations/get-pending-human-evaluations"},{"title":"Get completed human evaluations","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /evaluations/human/completed","href":"/v5.13/api-reference/evaluations/get-completed-human-evaluations"},{"title":"Claim an evaluation for human review or annotation","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/{id}/claim","href":"/v5.13/api-reference/evaluations/claim-an-evaluation-for-human-review-or-annotation"},{"title":"Release a claimed evaluation or annotation","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/{id}/release","href":"/v5.13/api-reference/evaluations/release-a-claimed-evaluation-or-annotation"},{"title":"Submit a human evaluation or annotation score","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/{id}/submit","href":"/v5.13/api-reference/evaluations/submit-a-human-evaluation-or-annotation-score"},{"title":"Edit a submitted human evaluation","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /evaluations/{id}/edit-human","href":"/v5.13/api-reference/evaluations/edit-a-submitted-human-evaluation"},{"title":"Remove a human annotation","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /evaluations/{id}/human-annotation","href":"/v5.13/api-reference/evaluations/remove-a-human-annotation"}]},{"group":"comments","pages":[{"title":"Create comment","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /comments","href":"/v5.13/api-reference/comments/create-comment"},{"title":"List distinct comment labels","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /comments/tags","href":"/v5.13/api-reference/comments/list-distinct-comment-labels"},{"title":"Delete comment","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /comments/{commentId}","href":"/v5.13/api-reference/comments/delete-comment"}]},{"group":"runs","pages":[{"title":"Get runs","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /runs","href":"/v5.13/api-reference/runs/get-runs"},{"title":"Create run","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /runs","href":"/v5.13/api-reference/runs/create-run"},{"title":"Close run","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /runs/{id}/close","href":"/v5.13/api-reference/runs/close-run"},{"title":"Run a run again","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /runs/{id}/relaunch","href":"/v5.13/api-reference/runs/run-a-run-again"},{"title":"Cancel run","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json post /runs/{id}/cancel","href":"/v5.13/api-reference/runs/cancel-run"},{"title":"Get run metric summary","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /runs/{id}/metric-summary","href":"/v5.13/api-reference/runs/get-run-metric-summary"},{"title":"Get run by ID","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json get /runs/{id}","href":"/v5.13/api-reference/runs/get-run-by-id"},{"title":"Delete run","deprecated":null,"version":null,"openapi":"/v5.13/openapi.json delete /runs/{id}","href":"/v5.13/api-reference/runs/delete-run"}]}]}]}]},{"version":"5.12","pages":[{"title":"5.12","href":"/v5.12/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.11","pages":[{"title":"5.11","href":"/v5.11/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]},{"version":"5.10","pages":[{"title":"5.10","href":"/v5.10/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"}]}]},"basePath":"","title":"Keep the current judge prompt over an optimized candidate - Galtea Docs","deploymentId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","buildId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","dynamics":["c2aa737661","2b790eda92","b0f84f53ff","a9bb46feb3"],"chunks":["OpenApiReferenceProvider-jJHA3WSo.js","utils-DbZn3Mjn.js","cloneDeep-CnBnaSyy.js","_Uint8Array-CMQtTgBR.js","isObject-FP1Yky1u.js","utils-Bl2DvzOJ.js","addUniqueKeysToSchema-BwOLo9p1.js","snippetPresets-BBiPpKa-.js","style-to-object-BY3JEAdk.js","v4-DIgz8zy6.js","conditional-requirements-CFM0id0Q.js","ApiExamples-C0px4Tml.js","isEqual-zAyttAAO.js","usePlaygroundInputsStore-Dell6dGw.js","shallow-0VKqkSqN.js","getApiPlaygroundDisplay-CP_ctPEB.js","CodeSnippet-5L35ic0s.js","CodeSnippets-DOXbNhJw.js","Page-DRLI_2Ue.js","getPastedJson-VhzT9m2P.js","icon-CD8_AtCO.js","MethodPill-DGgOMftG.js","DuplicateIcon-DZ6A_EtN.js","createIcon-DUl4oM5f.js","DynamicMarkdown-BGHukeRM.js","SectionHeading-ChrEUs8u.js","axios-vUo_bRtp.js","Markdown-Dj-na-_-.js","dist-C5gjFYHe.js","lib-DuNMoZ05.js","lib-B8HbPgcC.js","katex-YMM-FMeD.js","html-void-elements-mCSPHezU.js","marked.esm-CZWythHk.js","AssistantPageLink-DEBW87tT.js"]}