List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric’s name. See Metrics.
API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (gsk_*) and legacy (gsk-) API keys are accepted, e.g. Authorization: Bearer gsk_... or Authorization: Bearer gsk-....
Query Parameters
metricId
string
required
The metric whose revisions to list.
Minimum string length: 1
includeLegacy
boolean
Also list the legacy revisions. Defaults to true.
sort
string[]
Sort instructions (field and direction pairs). The only field is createdAt.
limit
integer
default:10000
Maximum number of results
Required range: 0 <= x <= 9007199254740991
offset
integer
default:0
Number of results to skip
Required range: x >= 0
Response
Revisions retrieved successfully
id
string
required
Revision ID.
Example:
"revision_123"
metricId
string
required
The metric this revision belongs to.
Example:
"metric_123"
number
integer
required
The revision number within its metric, allocated once when the revision is created and never reused. The revision shows as "R" followed by this number, so 3 is "R3".
Required range: x > 0
Example:
3
parentRevisionId
string | null
required
The revision this one was revised from. Null for the first revision of a metric.
Example:
"revision_122"
name
string | null
required
The name this revision was saved under, when it differs from its metric's name. Null otherwise: read the metric for its name.
Example:
"Accuracy (strict judge)"
isActive
boolean
required
read-only
Whether this is the active revision of its metric: its own legacy date is unset, it is not deleted and it is not being optimized.
legacyAt
string<date-time> | null
required
read-only
Earliest non-null of this revision's own legacy date and its evaluator model's unselectableAt, once that date has passed.
disabledAt
string<date-time> | null
required
read-only
Earliest non-null of the metric's disabled date and this revision's evaluator model's disabledAt.
definition
string | null
required
Name of the built-in evaluator the metric runs, for example json_field_match. Null when the metric names none.
judgePrompt
string | null
required
Example:
"Evaluate the accuracy of the response"
evaluatorModelName
string | null
required
Example:
"gpt-4"
evaluationParams
string[]
required
Ordered list of trace fields the evaluator needs, written in snake_case (e.g. input, actual_output, expected_output, retrieval_context). Determines which data the evaluation engine extracts from each trace. Full list of accepted values: https://docs.galtea.ai/concepts/metric/evaluation-parameters
Example:
["input", "actual_output", "expected_output"]
areEvalParamsTop
boolean | null
required
When true, evaluationParams are injected at the top level of the evaluator prompt instead of nested inside the conversation context.
judgeGenerationSettings
object | null
required
The generation settings this metric's judge runs with. Null runs the platform defaults. Immutable: changing one creates a revision.
Show child attributes
passThreshold
number
required
Score from 0 to 1 at or above which an evaluation of this metric passes. Immutable: changing it creates a revision.
Required range: 0 <= x <= 1
Example:
0.7
applicabilityScope
enum<string>
required
Which sessions get the applicability check before this metric is judged. NONE for a metric the platform does not score. A metric that scores only traces is never checked, so it takes NONE and refuses any other value. A metric that also scores another field is checked without traces: on each turn's input and actual output and its other fields. A FULL_PROMPT metric with empty evaluationParams whose judge prompt reads only traces is stored as checked, yet the evaluator judges it without the check. A FULL_PROMPT metric whose evaluationParams list only traces takes NONE even when its judge prompt reads another field: list that field in evaluationParams to get the check. Immutable: changing it creates a revision. The check runs only where the deployment enables it.
Available options:
NONE,
DEVELOPMENT,
PRODUCTION,
ALL
Example:
"PRODUCTION"
applicabilityThreshold
number | null
required
The lowest probability that the metric applies to a session at which it is judged. Null means the platform default, 0.5. Immutable: changing it creates a revision.
Required range: 0 <= x <= 1
Example:
0.7
classifierQuestion
object
required
The one question of a CLASSIFIER metric; null for every other source.
Show child attributes
isBeingOptimized
boolean
required
read-only
Whether the metric is currently being optimized.
optimizationStatus
enum<string> | null
required
read-only
Where an optimization attempt stands. Null for a metric that did not come from an optimization. A candidate waiting for review is legacy until it is activated.
Available options:
OPTIMIZING,
READY_FOR_REVIEW,
FAILED,
NO_IMPROVEMENT,
DECLINED,
ACTIVATED
Example:
"READY_FOR_REVIEW"
optimizationValidation
object | null
required
read-only
How an optimization attempt was validated: the held-out evaluations and, once the optimizer reported, both prompts scored on the search rows and on the held-out rows. Set on an optimization attempt only, and null for any other metric, for an attempt that predates it, and for an attempt copied from another organization.
Show child attributes
optimizationRun
object | null
required
read-only
What an optimization attempt ran: the strategies, the step budget and the steps used. Null while the attempt runs, and when it was not reported: an attempt from before the report existed, one run by an older optimizer, a failed run, an attempt copied from another organization, or a metric that is not an optimization attempt. Null never means a run of 0 steps.
Show child attributes
specificationIds
string[]
required
Specifications linked to this revision. A MEMBER caller sees only the specifications of the products it can read.
Example:
["spec_123"]
userGroupIds
string[]
required
User groups of the caller's organization linked to this revision.
Example:
["ug_123"]
excludedFromAnalyticsAt
string<date-time> | null
required
read-only
When this revision was excluded from analytics. Null when its results still count. The other revisions of the metric are unaffected.
excludedByUserId
string | null
required
read-only
User who excluded this revision from analytics. A repeated exclusion keeps the first user.
createdAt
string<date-time>
required
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Galtea Docs","colors":{"primary":"#5286FF","light":"#A9E3FE","dark":"#171717"},"logo":{"light":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5","dark":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/dark.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=0ea251446a97e2cd0bb0e9de1b049412"},"favicon":"https://mintcdn.com/galtea/sKxmtq77X98SiOSi/favicon.png?fit=max\u0026auto=format\u0026n=sKxmtq77X98SiOSi\u0026q=85\u0026s=a297a4f88e5dd07d7858dc2998dfe3ce","appearance":{"default":"system","strict":false},"background":{"color":{"light":"#f6f6f5","dark":"#09090a"}},"navbar":{"links":[{"href":"mailto:support@galtea.ai","label":"Support"}],"primary":{"type":"button","label":"Dashboard","href":"https://platform.galtea.ai"}},"footer":{"socials":{"linkedin":"https://linkedin.com/company/galtea-ai","website":"https://galtea.ai"}},"fonts":{"family":"Geist"},"icons":{"library":"fontawesome"},"styling":{"eyebrows":"breadcrumbs","codeblocks":"system","latex":true},"integrations":{"posthog":{"apiKey":"phc_5hcYhBTteqSv1mp9ObS5j28EKEA1HV6sog9EZHikgcF","apiHost":"https://t.galtea.ai","sessionRecording":false}},"contextual":{"options":["copy","view","chatgpt","claude","perplexity","mcp","cursor","vscode"],"display":"header"},"navigation":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"galtea","hasAudioNarration":false,"actualSubdomain":"galtea","customDomains":["docs.galtea.ai"],"gitSource":{"type":"github","owner":"galtea-ai","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{},"buildId":"6afd9a972bf917781dec84d5","clientVersion":"0.0.4177","searchFilterCounts":[{"language":"default","tag":"Concepts","count":3896},{"language":"default","tag":"REST API","count":1987},{"language":"default","tag":"Endpoints","count":1760},{"language":"default","tag":"SDK","count":1413},{"language":"default","tag":"Metrics","count":387},{"language":"default","tag":"Guides","count":330},{"language":"default","tag":"Deployment","count":180},{"language":"default","tag":"evaluations","count":180},{"language":"default","tag":"monitors","count":180},{"language":"default","tag":"metrics","count":177}]},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"starter-pricing","enabled":true,"variant":{"name":"treatment","enabled":true,"payload":{"type":"string","value":"treatment"},"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"wildcard-email-auth","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":true},"customCss":[],"page":{"pagePath":"api-reference/revisions/list-the-revisions-of-a-metric","slug":"/api-reference/revisions/list-the-revisions-of-a-metric","pageMetadata":{"title":"List the revisions of a metric","description":"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric's name. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions","href":"/api-reference/revisions/list-the-revisions-of-a-metric","autogeneratedByOpenApi":true},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx, jsxs: _jsxs} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n a: \"a\",\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsxs(_components.p, {\n children: [\"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric’s name. See \", _jsx(_components.a, {\n href: \"https://docs.galtea.ai/concepts/metric\",\n children: \"Metrics\"\n }), \".\"]\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){return _jsx(_Fragment,{})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent}","frontmatter":{},"scope":{"codeStyling":"system","config":{},"pageMetadata":{"title":"List the revisions of a metric","description":"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric's name. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions","href":"/api-reference/revisions/list-the-revisions-of-a-metric","autogeneratedByOpenApi":true}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[],"codeExamples":{}},"jsLinks":["/_mintlify/custom/galtea/d232846d89fbe5a1/galtea-assistant.js"],"openApiReferenceData":{"operation":{"operationId":"listRevisions","tags":["revisions"],"summary":"List the revisions of a metric","description":"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric's name. See [Metrics](https://docs.galtea.ai/concepts/metric).","security":["f1c9c8b9-b620-4edd-9288-1e192a789661"],"x-cli-name":"list","x-stability-level":"alpha","parameters":["52baa33e-a67a-4efd-b7fe-a7db6b48b3b5","3b64b4c4-4fa8-4735-9a3c-e79a46a100d8","2c24910c-a3e7-4d59-aff4-1d8816a52775","2dbef294-9b26-46a3-8bf0-9af98edf685a","94f66410-efb1-4602-a8be-9634f43ca83f"],"responses":{"200":"acda4c67-22f7-4611-a2cb-6aa9819d2cf1","400":"445b18a1-d221-4966-9c50-7be8901262e8","401":"50f426a4-8906-4fdb-af43-d21f08f2fed2","403":"423e6ace-64f6-4197-8ba1-b031cfb54ef1","404":"ce44ab46-6362-4577-817b-d2e830c8b6a9"},"method":"get","type":"path","servers":["5b6f56cc-f97c-491d-a9e9-d0699bff83b6"],"path":"/v2/revisions","baseUrlOptions":["https://api.galtea.ai"],"title":"List the revisions of a metric","codeSamples":[],"requiredOnlyExamples":false,"requestExampleType":"generated","responseExampleType":"generated"},"dependencies":{"parameters":{"52baa33e-a67a-4efd-b7fe-a7db6b48b3b5":{"schema":{"type":"string","minLength":1,"description":"The metric whose revisions to list.","isRequired":true,"uniqueKey":"","typeLabel":"string"},"required":true,"description":"The metric whose revisions to list.","name":"metricId","in":"query"},"3b64b4c4-4fa8-4735-9a3c-e79a46a100d8":{"schema":{"type":"boolean","description":"Also list the legacy revisions. Defaults to true.","isRequired":false,"uniqueKey":"","typeLabel":"boolean"},"required":false,"description":"Also list the legacy revisions. Defaults to true.","name":"includeLegacy","in":"query"},"2c24910c-a3e7-4d59-aff4-1d8816a52775":{"schema":{"type":"array","items":{"type":"string","uniqueKey":"items.[INDEX]","typeLabel":"string"},"description":"Sort instructions (field and direction pairs). The only field is `createdAt`.","isRequired":false,"uniqueKey":"","typeLabel":"string[]"},"required":false,"description":"Sort instructions (field and direction pairs). The only field is `createdAt`.","style":"form","explode":true,"name":"sort","in":"query"},"2dbef294-9b26-46a3-8bf0-9af98edf685a":{"schema":{"type":"integer","minimum":0,"maximum":9007199254740991,"default":10000,"description":"Maximum number of results","isRequired":false,"uniqueKey":"","typeLabel":"integer"},"required":false,"description":"Maximum number of results","name":"limit","in":"query"},"94f66410-efb1-4602-a8be-9634f43ca83f":{"schema":{"type":"integer","minimum":0,"default":0,"description":"Number of results to skip","isRequired":false,"uniqueKey":"","typeLabel":"integer"},"required":false,"description":"Number of results to skip","name":"offset","in":"query"}},"responses":{"acda4c67-22f7-4611-a2cb-6aa9819d2cf1":{"description":"Revisions retrieved successfully","headers":{"Content-Range":{"schema":{"type":"string","description":"Pagination range as `revisions \u003coffset>-\u003cupperBound>/\u003ctotal>`."},"required":true,"description":"Pagination range as `revisions \u003coffset>-\u003cupperBound>/\u003ctotal>`."}},"content":{"application/json":{"schema":{"type":"array","items":{"type":"object","properties":{"id":{"type":"string","example":"revision_123","description":"Revision ID.","isRequired":true,"uniqueKey":"items.[INDEX].id","typeLabel":"string"},"metricId":{"type":"string","example":"metric_123","description":"The metric this revision belongs to.","isRequired":true,"uniqueKey":"items.[INDEX].metricId","typeLabel":"string"},"number":{"type":"integer","minimum":0,"exclusiveMinimum":true,"example":3,"description":"The revision number within its metric, allocated once when the revision is created and never reused. The revision shows as \"R\" followed by this number, so 3 is \"R3\".","isRequired":true,"uniqueKey":"items.[INDEX].number","typeLabel":"integer"},"parentRevisionId":{"oneOf":[{"type":"string","example":"revision_122","description":"The revision this one was revised from. Null for the first revision of a metric.","isRequired":true,"uniqueKey":"items.[INDEX].parentRevisionId.oneOf.0","typeLabel":"string"},{"type":"null","example":"revision_122","description":"The revision this one was revised from. Null for the first revision of a metric.","isRequired":true,"uniqueKey":"items.[INDEX].parentRevisionId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].parentRevisionId","typeLabel":"string | null"},"name":{"oneOf":[{"type":"string","example":"Accuracy (strict judge)","description":"The name this revision was saved under, when it differs from its metric's name. Null otherwise: read the metric for its name.","isRequired":true,"uniqueKey":"items.[INDEX].name.oneOf.0","typeLabel":"string"},{"type":"null","example":"Accuracy (strict judge)","description":"The name this revision was saved under, when it differs from its metric's name. Null otherwise: read the metric for its name.","isRequired":true,"uniqueKey":"items.[INDEX].name.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].name","typeLabel":"string | null"},"isActive":{"type":"boolean","readOnly":true,"description":"Whether this is the active revision of its metric: its own legacy date is unset, it is not deleted and it is not being optimized.","isRequired":true,"uniqueKey":"items.[INDEX].isActive","typeLabel":"boolean"},"legacyAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"Earliest non-null of this revision's own legacy date and its evaluator model's `unselectableAt`, once that date has passed.","isRequired":true,"uniqueKey":"items.[INDEX].legacyAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"Earliest non-null of this revision's own legacy date and its evaluator model's `unselectableAt`, once that date has passed.","isRequired":true,"uniqueKey":"items.[INDEX].legacyAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].legacyAt","typeLabel":"string\u003cdate-time> | null"},"disabledAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"Earliest non-null of the metric's disabled date and this revision's evaluator model's `disabledAt`.","isRequired":true,"uniqueKey":"items.[INDEX].disabledAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"Earliest non-null of the metric's disabled date and this revision's evaluator model's `disabledAt`.","isRequired":true,"uniqueKey":"items.[INDEX].disabledAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].disabledAt","typeLabel":"string\u003cdate-time> | null"},"definition":{"oneOf":[{"type":"string","description":"Name of the built-in evaluator the metric runs, for example `json_field_match`. Null when the metric names none.","isRequired":true,"uniqueKey":"items.[INDEX].definition.oneOf.0","typeLabel":"string"},{"type":"null","description":"Name of the built-in evaluator the metric runs, for example `json_field_match`. Null when the metric names none.","isRequired":true,"uniqueKey":"items.[INDEX].definition.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].definition","typeLabel":"string | null"},"judgePrompt":{"oneOf":[{"type":"string","example":"Evaluate the accuracy of the response","isRequired":true,"uniqueKey":"items.[INDEX].judgePrompt.oneOf.0","typeLabel":"string"},{"type":"null","example":"Evaluate the accuracy of the response","isRequired":true,"uniqueKey":"items.[INDEX].judgePrompt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].judgePrompt","typeLabel":"string | null"},"evaluatorModelName":{"oneOf":[{"type":"string","example":"gpt-4","isRequired":true,"uniqueKey":"items.[INDEX].evaluatorModelName.oneOf.0","typeLabel":"string"},{"type":"null","example":"gpt-4","isRequired":true,"uniqueKey":"items.[INDEX].evaluatorModelName.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].evaluatorModelName","typeLabel":"string | null"},"evaluationParams":{"type":"array","items":{"type":"string","uniqueKey":"items.[INDEX].evaluationParams.items.[INDEX]","typeLabel":"string"},"example":["input","actual_output","expected_output"],"description":"Ordered list of trace fields the evaluator needs, written in snake_case (e.g. `input`, `actual_output`, `expected_output`, `retrieval_context`). Determines which data the evaluation engine extracts from each trace. Full list of accepted values: https://docs.galtea.ai/concepts/metric/evaluation-parameters","isRequired":true,"uniqueKey":"items.[INDEX].evaluationParams","typeLabel":"string[]"},"areEvalParamsTop":{"oneOf":[{"type":"boolean","description":"When true, evaluationParams are injected at the top level of the evaluator prompt instead of nested inside the conversation context.","isRequired":true,"uniqueKey":"items.[INDEX].areEvalParamsTop.oneOf.0","typeLabel":"boolean"},{"type":"null","description":"When true, evaluationParams are injected at the top level of the evaluator prompt instead of nested inside the conversation context.","isRequired":true,"uniqueKey":"items.[INDEX].areEvalParamsTop.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].areEvalParamsTop","typeLabel":"boolean | null"},"judgeGenerationSettings":{"oneOf":[{"type":"object","properties":{"temperature":{"oneOf":[{"type":"number","minimum":0,"example":0.3,"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.temperature.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"example":0.3,"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.temperature.oneOf.1","typeLabel":"null"}],"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.temperature","typeLabel":"number | null"},"topP":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.9,"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.topP.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.9,"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.topP.oneOf.1","typeLabel":"null"}],"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.topP","typeLabel":"number | null"},"maxOutputTokens":{"oneOf":[{"type":"integer","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap.","uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.maxOutputTokens.oneOf.0","typeLabel":"integer"},{"type":"null","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap.","uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.maxOutputTokens.oneOf.1","typeLabel":"null"}],"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.maxOutputTokens","typeLabel":"integer | null"},"reasoningEffort":{"oneOf":[{"type":"string","example":"low","uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.reasoningEffort.oneOf.0","typeLabel":"string"},{"type":"null","example":"low","uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.reasoningEffort.oneOf.1","typeLabel":"null"}],"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0.reasoningEffort","typeLabel":"string | null"}},"additionalProperties":false,"description":"The generation settings this metric's judge runs with. Null runs the platform defaults. Immutable: changing one creates a revision.","isRequired":true,"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"temperature":{"oneOf":[{"type":"number","minimum":0,"example":0.3},{"type":"null","minimum":0,"example":0.3}]},"topP":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.9},{"type":"null","minimum":0,"maximum":1,"example":0.9}]},"maxOutputTokens":{"oneOf":[{"type":"integer","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap."},{"type":"null","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap."}]},"reasoningEffort":{"oneOf":[{"type":"string","example":"low"},{"type":"null","example":"low"}]}},"additionalProperties":false,"description":"The generation settings this metric's judge runs with. Null runs the platform defaults. Immutable: changing one creates a revision.","isRequired":true,"uniqueKey":"items.[INDEX].judgeGenerationSettings.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].judgeGenerationSettings","typeLabel":"object | null"},"passThreshold":{"type":"number","minimum":0,"maximum":1,"example":0.7,"description":"Score from 0 to 1 at or above which an evaluation of this metric passes. Immutable: changing it creates a revision.","isRequired":true,"uniqueKey":"items.[INDEX].passThreshold","typeLabel":"number"},"applicabilityScope":{"type":"string","enum":["NONE","DEVELOPMENT","PRODUCTION","ALL"],"example":"PRODUCTION","description":"Which sessions get the applicability check before this metric is judged. `NONE` for a metric the platform does not score. A metric that scores only `traces` is never checked, so it takes `NONE` and refuses any other value. A metric that also scores another field is checked without `traces`: on each turn's input and actual output and its other fields. A FULL_PROMPT metric with empty evaluationParams whose judge prompt reads only `traces` is stored as checked, yet the evaluator judges it without the check. A FULL_PROMPT metric whose evaluationParams list only `traces` takes NONE even when its judge prompt reads another field: list that field in evaluationParams to get the check. Immutable: changing it creates a revision. The check runs only where the deployment enables it.","isRequired":true,"uniqueKey":"items.[INDEX].applicabilityScope","typeLabel":"enum\u003cstring>"},"applicabilityThreshold":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.7,"description":"The lowest probability that the metric applies to a session at which it is judged. Null means the platform default, 0.5. Immutable: changing it creates a revision.","isRequired":true,"uniqueKey":"items.[INDEX].applicabilityThreshold.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.7,"description":"The lowest probability that the metric applies to a session at which it is judged. Null means the platform default, 0.5. Immutable: changing it creates a revision.","isRequired":true,"uniqueKey":"items.[INDEX].applicabilityThreshold.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].applicabilityThreshold","typeLabel":"number | null"},"classifierQuestion":{"type":"object","description":"The one question of a CLASSIFIER metric; null for every other source.","required":["type","instructions"],"properties":{"type":{"type":"string","enum":["yes_no","scale"],"isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.type","typeLabel":"enum\u003cstring>"},"instructions":{"type":"string","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.instructions","typeLabel":"string"},"goodAnswer":{"type":"string","enum":["yes","no"],"uniqueKey":"items.[INDEX].classifierQuestion.goodAnswer","typeLabel":"enum\u003cstring>"},"criteria":{"oneOf":[{"type":"object","properties":{"yes":{"oneOf":[{"type":"string","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0.yes.oneOf.0","typeLabel":"string"},{"type":"null","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0.yes.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0.yes","typeLabel":"string | null"},"no":{"oneOf":[{"type":"string","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0.no.oneOf.0","typeLabel":"string"},{"type":"null","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0.no.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0.no","typeLabel":"string | null"}},"required":["yes","no"],"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"yes":{"oneOf":[{"type":"string"},{"type":"null"}]},"no":{"oneOf":[{"type":"string"},{"type":"null"}]}},"required":["yes","no"],"uniqueKey":"items.[INDEX].classifierQuestion.criteria.oneOf.1","typeLabel":"null"}],"uniqueKey":"items.[INDEX].classifierQuestion.criteria","typeLabel":"object | null"},"levels":{"type":"array","items":{"type":"object","properties":{"description":{"type":"string","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.levels.items.[INDEX].description","typeLabel":"string"},"score":{"type":"number","isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion.levels.items.[INDEX].score","typeLabel":"number"}},"required":["description","score"],"uniqueKey":"items.[INDEX].classifierQuestion.levels.items.[INDEX]","typeLabel":"object"},"uniqueKey":"items.[INDEX].classifierQuestion.levels","typeLabel":"object[]"},"doesNotApply":{"oneOf":[{"type":"string","uniqueKey":"items.[INDEX].classifierQuestion.doesNotApply.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"items.[INDEX].classifierQuestion.doesNotApply.oneOf.1","typeLabel":"null"}],"uniqueKey":"items.[INDEX].classifierQuestion.doesNotApply","typeLabel":"string | null"}},"isRequired":true,"uniqueKey":"items.[INDEX].classifierQuestion","typeLabel":"object"},"isBeingOptimized":{"type":"boolean","readOnly":true,"description":"Whether the metric is currently being optimized.","isRequired":true,"uniqueKey":"items.[INDEX].isBeingOptimized","typeLabel":"boolean"},"optimizationStatus":{"oneOf":[{"type":"string","enum":["OPTIMIZING","READY_FOR_REVIEW","FAILED","NO_IMPROVEMENT","DECLINED","ACTIVATED"],"readOnly":true,"example":"READY_FOR_REVIEW","description":"Where an optimization attempt stands. Null for a metric that did not come from an optimization. A candidate waiting for review is legacy until it is activated.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationStatus.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["OPTIMIZING","READY_FOR_REVIEW","FAILED","NO_IMPROVEMENT","DECLINED","ACTIVATED"],"readOnly":true,"example":"READY_FOR_REVIEW","description":"Where an optimization attempt stands. Null for a metric that did not come from an optimization. A candidate waiting for review is legacy until it is activated.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationStatus.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationStatus","typeLabel":"enum\u003cstring> | null"},"optimizationValidation":{"oneOf":[{"type":"object","properties":{"used":{"type":"boolean","description":"Whether any evaluation was held out for validation. False when none was: too few annotated evaluations and no session kept from an earlier attempt, or no session was eligible for the hold-out.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.used","typeLabel":"boolean"},"heldOutEvaluationIds":{"type":"array","items":{"type":"string","uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.heldOutEvaluationIds.items.[INDEX]","typeLabel":"string"},"description":"Evaluations held out of the search. Empty when no validation set was used.","example":["evaluation_123"],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.heldOutEvaluationIds","typeLabel":"string[]"},"results":{"oneOf":[{"type":"object","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.rowsScored","typeLabel":"integer"},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.rowsTotal","typeLabel":"integer"},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.source.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.source","typeLabel":"object"},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization.candidate","typeLabel":"object"}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.optimization","typeLabel":"object"},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.rowsScored","typeLabel":"integer"},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.rowsTotal","typeLabel":"integer"},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.source.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.source.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.source.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.source.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.source","typeLabel":"object"},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.correct","typeLabel":"integer"},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.alignment.oneOf.0","typeLabel":"number"},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.alignment.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate.alignment","typeLabel":"number | null"}},"required":["correct","alignment"],"additionalProperties":false,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation.candidate","typeLabel":"object"}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0.validation","typeLabel":"object"}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.results","typeLabel":"object | null"},"rows":{"oneOf":[{"type":"array","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].evaluationId","typeLabel":"string"},"humanScore":{"type":"number","description":"The human label.","example":1,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].humanScore","typeLabel":"number"},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].sourceScore.oneOf.0","typeLabel":"number"},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].sourceScore.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].sourceScore","typeLabel":"number | null"},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].candidateScore.oneOf.0","typeLabel":"number"},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].candidateScore.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX].candidateScore","typeLabel":"number | null"}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0.items.[INDEX]","typeLabel":"object"},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.0","typeLabel":"object[]"},{"type":"null","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123"},"humanScore":{"type":"number","description":"The human label.","example":1},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0}]},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1}]}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0.rows","typeLabel":"object[] | null"}},"required":["used","heldOutEvaluationIds","results","rows"],"additionalProperties":false,"readOnly":true,"description":"How an optimization attempt was validated: the held-out evaluations and, once the optimizer reported, both prompts scored on the search rows and on the held-out rows. Set on an optimization attempt only, and null for any other metric, for an attempt that predates it, and for an attempt copied from another organization.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"used":{"type":"boolean","description":"Whether any evaluation was held out for validation. False when none was: too few annotated evaluations and no session kept from an earlier attempt, or no session was eligible for the hold-out."},"heldOutEvaluationIds":{"type":"array","items":{"type":"string"},"description":"Evaluations held out of the search. Empty when no validation set was used.","example":["evaluation_123"]},"results":{"oneOf":[{"type":"object","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing."},{"type":"null","properties":{"optimization":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false},"validation":{"type":"object","properties":{"rowsScored":{"type":"integer","minimum":0,"description":"Rows both prompts scored. Only these rows are compared.","example":25},"rowsTotal":{"type":"integer","minimum":0,"description":"Rows in the set.","example":25},"source":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false},"candidate":{"type":"object","properties":{"correct":{"type":"integer","minimum":0,"description":"Rows where the AI verdict matches the human label. A score at or above the metric's pass threshold is a positive verdict.","example":20},"alignment":{"oneOf":[{"type":"number","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71},{"type":"null","description":"Alignment between the AI scores and the human labels on the compared rows. Null when undefined.","example":0.71}]}},"required":["correct","alignment"],"additionalProperties":false}},"required":["rowsScored","rowsTotal","source","candidate"],"additionalProperties":false}},"required":["optimization","validation"],"additionalProperties":false,"description":"Both prompts scored on the rows the search used and on the held-out rows. Null when the optimizer reported nothing."}]},"rows":{"oneOf":[{"type":"array","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123"},"humanScore":{"type":"number","description":"The human label.","example":1},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0}]},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1}]}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing."},{"type":"null","items":{"type":"object","properties":{"evaluationId":{"type":"string","example":"evaluation_123"},"humanScore":{"type":"number","description":"The human label.","example":1},"sourceScore":{"oneOf":[{"type":"number","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0},{"type":"null","description":"The source prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":0}]},"candidateScore":{"oneOf":[{"type":"number","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1},{"type":"null","description":"The optimized prompt's judge score on this row, or null when it failed. A score at or above the metric's pass threshold is a positive verdict.","example":1}]}},"required":["evaluationId","humanScore","sourceScore","candidateScore"],"additionalProperties":false},"description":"One entry per held-out row the optimizer reported; a score is null when that prompt failed on the row. Null when the optimizer reported nothing."}]}},"required":["used","heldOutEvaluationIds","results","rows"],"additionalProperties":false,"readOnly":true,"description":"How an optimization attempt was validated: the held-out evaluations and, once the optimizer reported, both prompts scored on the search rows and on the held-out rows. Set on an optimization attempt only, and null for any other metric, for an attempt that predates it, and for an attempt copied from another organization.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationValidation","typeLabel":"object | null"},"optimizationRun":{"oneOf":[{"type":"object","properties":{"strategies":{"type":"array","items":{"type":"string","enum":["FIX_FALSE_POSITIVES","FIX_FALSE_NEGATIVES","ADD_RUBRIC","SIMPLIFY","BROADEN"],"uniqueKey":"items.[INDEX].optimizationRun.oneOf.0.strategies.items.[INDEX]","typeLabel":"enum\u003cstring>"},"description":"The strategies the run wrote candidates with.","example":["ADD_RUBRIC","SIMPLIFY"],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationRun.oneOf.0.strategies","typeLabel":"enum\u003cstring>[]"},"maxSteps":{"type":"integer","minimum":1,"description":"The run's step budget, after the optimizer applied its own ceiling.","example":6,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationRun.oneOf.0.maxSteps","typeLabel":"integer"},"stepsUsed":{"type":"integer","minimum":0,"description":"The search steps the run took. 0 when the source prompt already met the target.","example":4,"isRequired":true,"uniqueKey":"items.[INDEX].optimizationRun.oneOf.0.stepsUsed","typeLabel":"integer"}},"required":["strategies","maxSteps","stepsUsed"],"additionalProperties":false,"readOnly":true,"description":"What an optimization attempt ran: the strategies, the step budget and the steps used. Null while the attempt runs, and when it was not reported: an attempt from before the report existed, one run by an older optimizer, a failed run, an attempt copied from another organization, or a metric that is not an optimization attempt. Null never means a run of 0 steps.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationRun.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"strategies":{"type":"array","items":{"type":"string","enum":["FIX_FALSE_POSITIVES","FIX_FALSE_NEGATIVES","ADD_RUBRIC","SIMPLIFY","BROADEN"]},"description":"The strategies the run wrote candidates with.","example":["ADD_RUBRIC","SIMPLIFY"]},"maxSteps":{"type":"integer","minimum":1,"description":"The run's step budget, after the optimizer applied its own ceiling.","example":6},"stepsUsed":{"type":"integer","minimum":0,"description":"The search steps the run took. 0 when the source prompt already met the target.","example":4}},"required":["strategies","maxSteps","stepsUsed"],"additionalProperties":false,"readOnly":true,"description":"What an optimization attempt ran: the strategies, the step budget and the steps used. Null while the attempt runs, and when it was not reported: an attempt from before the report existed, one run by an older optimizer, a failed run, an attempt copied from another organization, or a metric that is not an optimization attempt. Null never means a run of 0 steps.","isRequired":true,"uniqueKey":"items.[INDEX].optimizationRun.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].optimizationRun","typeLabel":"object | null"},"specificationIds":{"type":"array","items":{"type":"string","uniqueKey":"items.[INDEX].specificationIds.items.[INDEX]","typeLabel":"string"},"description":"Specifications linked to this revision. A MEMBER caller sees only the specifications of the products it can read.","example":["spec_123"],"isRequired":true,"uniqueKey":"items.[INDEX].specificationIds","typeLabel":"string[]"},"userGroupIds":{"type":"array","items":{"type":"string","uniqueKey":"items.[INDEX].userGroupIds.items.[INDEX]","typeLabel":"string"},"example":["ug_123"],"description":"User groups of the caller's organization linked to this revision.","isRequired":true,"uniqueKey":"items.[INDEX].userGroupIds","typeLabel":"string[]"},"excludedFromAnalyticsAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"When this revision was excluded from analytics. Null when its results still count. The other revisions of the metric are unaffected.","isRequired":true,"uniqueKey":"items.[INDEX].excludedFromAnalyticsAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"When this revision was excluded from analytics. Null when its results still count. The other revisions of the metric are unaffected.","isRequired":true,"uniqueKey":"items.[INDEX].excludedFromAnalyticsAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].excludedFromAnalyticsAt","typeLabel":"string\u003cdate-time> | null"},"excludedByUserId":{"oneOf":[{"type":"string","readOnly":true,"description":"User who excluded this revision from analytics. A repeated exclusion keeps the first user.","isRequired":true,"uniqueKey":"items.[INDEX].excludedByUserId.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"description":"User who excluded this revision from analytics. A repeated exclusion keeps the first user.","isRequired":true,"uniqueKey":"items.[INDEX].excludedByUserId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"items.[INDEX].excludedByUserId","typeLabel":"string | null"},"createdAt":{"type":"string","format":"date-time","isRequired":true,"uniqueKey":"items.[INDEX].createdAt","typeLabel":"string\u003cdate-time>"}},"required":["id","metricId","number","parentRevisionId","name","isActive","legacyAt","disabledAt","definition","judgePrompt","evaluatorModelName","evaluationParams","areEvalParamsTop","judgeGenerationSettings","passThreshold","applicabilityScope","applicabilityThreshold","classifierQuestion","isBeingOptimized","optimizationStatus","optimizationValidation","optimizationRun","specificationIds","userGroupIds","excludedFromAnalyticsAt","excludedByUserId","createdAt"],"uniqueKey":"items.[INDEX]","typeLabel":"object"},"uniqueKey":"","typeLabel":"object[]"},"examples":{"Example":{"title":"Example","value":[{"id":"revision_123","metricId":"metric_123","number":3,"parentRevisionId":"revision_122","name":"Accuracy (strict judge)","isActive":true,"legacyAt":"2023-11-07T05:31:56Z","disabledAt":"2023-11-07T05:31:56Z","definition":"\u003cstring>","judgePrompt":"Evaluate the accuracy of the response","evaluatorModelName":"gpt-4","evaluationParams":["input","actual_output","expected_output"],"areEvalParamsTop":true,"judgeGenerationSettings":{"temperature":0.3,"topP":0.9,"maxOutputTokens":512,"reasoningEffort":"low"},"passThreshold":0.7,"applicabilityScope":"PRODUCTION","applicabilityThreshold":0.7,"classifierQuestion":{"type":"yes_no","instructions":"\u003cstring>","goodAnswer":"yes","criteria":{"yes":"\u003cstring>","no":"\u003cstring>"},"levels":[{"description":"\u003cstring>","score":123}],"doesNotApply":"\u003cstring>"},"isBeingOptimized":true,"optimizationStatus":"READY_FOR_REVIEW","optimizationValidation":{"used":true,"heldOutEvaluationIds":["evaluation_123"],"results":{"optimization":{"rowsScored":25,"rowsTotal":25,"source":{"correct":20,"alignment":0.71},"candidate":{"correct":20,"alignment":0.71}},"validation":{"rowsScored":25,"rowsTotal":25,"source":{"correct":20,"alignment":0.71},"candidate":{"correct":20,"alignment":0.71}}},"rows":[{"evaluationId":"evaluation_123","humanScore":1,"sourceScore":0,"candidateScore":1}]},"optimizationRun":{"strategies":["ADD_RUBRIC","SIMPLIFY"],"maxSteps":6,"stepsUsed":4},"specificationIds":["spec_123"],"userGroupIds":["ug_123"],"excludedFromAnalyticsAt":"2023-11-07T05:31:56Z","excludedByUserId":"\u003cstring>","createdAt":"2023-11-07T05:31:56Z"}]}},"exampleType":"generated"}},"exampleType":"generated"},"445b18a1-d221-4966-9c50-7be8901262e8":{"description":"Invalid query parameter, a missing `metricId`, or a sort field other than `createdAt` or a sort direction other than `asc` or `desc`","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"50f426a4-8906-4fdb-af43-d21f08f2fed2":{"description":"Unauthorized","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"423e6ace-64f6-4197-8ba1-b031cfb54ef1":{"description":"The metric belongs to another organization, none of the products the caller's user groups grant uses it, or no user group of the caller lists metric.read","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"ce44ab46-6362-4577-817b-d2e830c8b6a9":{"description":"Metric not found","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"}},"security":{"f1c9c8b9-b620-4edd-9288-1e192a789661":{"bearerAuth":{"type":"http","scheme":"bearer","description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","scopes":[],"schemeName":"bearerAuth"}}},"servers":{"5b6f56cc-f97c-491d-a9e9-d0699bff83b6":{"url":"https://api.galtea.ai"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"http","scheme":"bearer","description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","scopes":[],"schemeName":"bearerAuth"},"schema":{"title":"Bearer Auth","type":"string","isRequired":true,"description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","format":"bearer","typeLabel":"string\u003cbearer>","deprecated":false},"schemeName":"bearerAuth","name":"Authorization"}],"title":"bearerAuth"}]},"originalFileLocation":"openapi.json"},"subdomain":"galtea","siteName":"Galtea Docs","title":"List the revisions of a metric - Galtea Docs","navMaps":{"firstHrefInVersion":{"5.19":{"href":"/api-reference/revisions/list-the-revisions-of-a-metric","matchLevel":0},"5.18":{"href":"/v5.18/api-reference/health-check","matchLevel":2},"5.17":{"href":"/v5.17/api-reference/health-check","matchLevel":2},"5.16":{"href":"/v5.16/api-reference/health-check","matchLevel":2},"5.15":{"href":"/v5.15/api-reference/health-check","matchLevel":2},"5.14":{"href":"/v5.14/api-reference/health-check","matchLevel":2},"5.13":{"href":"/v5.13/api-reference/health-check","matchLevel":2},"5.12":{"href":"/v5.12/api-reference/health-check","matchLevel":2},"5.11":{"href":"/v5.11/api-reference/health-check","matchLevel":2},"5.10":{"href":"/v5.10/introduction","matchLevel":4}},"firstHrefInLanguage":{}},"lastModified":"2026-11-18T12:31:48.305Z","originalFileLocation":"api-reference/revisions/list-the-revisions-of-a-metric.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric\u0026#x27;s name. See Metrics.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"List the revisions of a metric - Galtea Docs\">\u003cmeta data-mint-head property=\"og:description\" content=\"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric\u0026#x27;s name. See Metrics.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Galtea Docs\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=revisions\u0026amp;title=List+the+revisions+of+a+metric\u0026amp;description=List+the+live+revisions+of+one+metric%2C+legacy+ones+and+in-flight+optimizations+included.+A+revision+shows+its+own+name+only+when+it+differs+from+the+metric%27s+na\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=8d329fb569e2d65aeb53598c9cc9ab53097e111bcc6c04ab3c7ea74791922187\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"List the revisions of a metric - Galtea Docs\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric\u0026#x27;s name. See Metrics.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=revisions\u0026amp;title=List+the+revisions+of+a+metric\u0026amp;description=List+the+live+revisions+of+one+metric%2C+legacy+ones+and+in-flight+optimizations+included.+A+revision+shows+its+own+name+only+when+it+differs+from+the+metric%27s+na\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=8d329fb569e2d65aeb53598c9cc9ab53097e111bcc6c04ab3c7ea74791922187\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#5286FF\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/revisions/list-the-revisions-of-a-metric.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.galtea.ai/#organization\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.galtea.ai#website\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric#webpage\",\"url\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric\",\"name\":\"List the revisions of a metric\",\"description\":\"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric's name. See Metrics.\",\"dateModified\":\"2026-11-18T12:31:48.305Z\",\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Endpoints\",\"item\":\"https://docs.galtea.ai/api-reference/health-check\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"List the revisions of a metric\",\"item\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric#apireference\",\"headline\":\"List the revisions of a metric\",\"name\":\"List the revisions of a metric\",\"description\":\"List the live revisions of one metric, legacy ones and in-flight optimizations included. A revision shows its own name only when it differs from the metric's name. See Metrics.\",\"url\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric\",\"mainEntityOfPage\":{\"@id\":\"https://docs.galtea.ai/api-reference/revisions/list-the-revisions-of-a-metric#webpage\"},\"dateModified\":\"2026-11-18T12:31:48.305Z\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Galtea Docs\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Galtea Docs\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/api-reference/revisions/list-the-revisions-of-a-metric.md","siteName":"Galtea Docs","nav":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"versions":[{"version":"5.19","default":true,"tag":"Latest","tabs":[{"tab":"Guides","pages":[{"title":"Guides","href":"/introduction"}]},{"tab":"Concepts","pages":[{"title":"Concepts","href":"/concepts/overview"}]},{"tab":"Deployment","pages":[{"title":"Deployment","href":"/deployment/executive-summary"}]},{"tab":"REST API","groups":[{"group":"Overview","pages":[{"title":"Write responses","icon":"reply","href":"/api-reference/write-responses"},{"title":"Enum values","icon":"list","href":"/api-reference/enum-values"}]},{"group":"Endpoints","pages":[{"group":"API Reference","pages":[{"title":"Health check","deprecated":null,"version":null,"openapi":"/openapi.json get /health","href":"/api-reference/health-check"},{"title":"Get minimum SDK version","deprecated":null,"version":null,"openapi":"/openapi.json get /minimum-sdk-version","href":"/api-reference/get-minimum-sdk-version"},{"title":"Build info","deprecated":null,"version":null,"openapi":"/openapi.json get /build-info","href":"/api-reference/build-info"},{"title":"Build info for every deployed service","deprecated":null,"version":null,"openapi":"/openapi.json get /build-info/services","href":"/api-reference/build-info-for-every-deployed-service"},{"title":"Platform compatibility","deprecated":null,"version":null,"openapi":"/openapi.json get /platform-compatibility","href":"/api-reference/platform-compatibility"},{"title":"Whether every deployed service can reach its dependencies","deprecated":null,"version":null,"openapi":"/openapi.json get /self-check","href":"/api-reference/whether-every-deployed-service-can-reach-its-dependencies"}]},{"group":"api-tokens","pages":[{"title":"List API tokens","deprecated":null,"version":null,"openapi":"/openapi.json get /auth/apiTokens","href":"/api-reference/api-tokens/list-api-tokens"},{"title":"Create API token","deprecated":null,"version":null,"openapi":"/openapi.json post /auth/apiTokens","href":"/api-reference/api-tokens/create-api-token"},{"title":"Revoke API token","deprecated":null,"version":null,"openapi":"/openapi.json delete /auth/apiTokens/{apiTokenId}","href":"/api-reference/api-tokens/revoke-api-token"},{"title":"Rename API token","deprecated":null,"version":null,"openapi":"/openapi.json patch /auth/apiTokens/{apiTokenId}","href":"/api-reference/api-tokens/rename-api-token"},{"title":"Regenerate API token","deprecated":null,"version":null,"openapi":"/openapi.json post /auth/apiTokens/{apiTokenId}/regenerate","href":"/api-reference/api-tokens/regenerate-api-token"}]},{"group":"auth","pages":[{"title":"Get current user","deprecated":null,"version":null,"openapi":"/openapi.json get /auth/user","href":"/api-reference/auth/get-current-user"}]},{"group":"organizations","pages":[{"title":"Get organizations","deprecated":null,"version":null,"openapi":"/openapi.json get /organizations","href":"/api-reference/organizations/get-organizations"},{"title":"Get organization by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /organizations/{id}","href":"/api-reference/organizations/get-organization-by-id"},{"title":"Update organization","deprecated":null,"version":null,"openapi":"/openapi.json patch /organizations/{id}","href":"/api-reference/organizations/update-organization"},{"title":"Get credit status","deprecated":null,"version":null,"openapi":"/openapi.json get /organizations/{id}/creditStatus","href":"/api-reference/organizations/get-credit-status"}]},{"group":"user-groups","pages":[{"title":"Get user groups","deprecated":null,"version":null,"openapi":"/openapi.json get /userGroups","href":"/api-reference/user-groups/get-user-groups"},{"title":"Create user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups","href":"/api-reference/user-groups/create-user-group"},{"title":"Link users to user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups/{id}/users","href":"/api-reference/user-groups/link-users-to-user-group"},{"title":"Unlink users from user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}/users","href":"/api-reference/user-groups/unlink-users-from-user-group"},{"title":"Delete multiple user groups","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/batch","href":"/api-reference/user-groups/delete-multiple-user-groups"},{"title":"Get user group by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /userGroups/{id}","href":"/api-reference/user-groups/get-user-group-by-id"},{"title":"Delete user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}","href":"/api-reference/user-groups/delete-user-group"},{"title":"Update user group","deprecated":null,"version":null,"openapi":"/openapi.json patch /userGroups/{id}","href":"/api-reference/user-groups/update-user-group"},{"title":"List grantable user group permissions","deprecated":null,"version":null,"openapi":"/openapi.json get /userGroups/grantablePermissions","href":"/api-reference/user-groups/list-grantable-user-group-permissions"},{"title":"Link metrics to user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups/{id}/metrics","href":"/api-reference/user-groups/link-metrics-to-user-group"},{"title":"Unlink metrics from user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}/metrics","href":"/api-reference/user-groups/unlink-metrics-from-user-group"},{"title":"Link products to user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups/{id}/products","href":"/api-reference/user-groups/link-products-to-user-group"},{"title":"Unlink products from user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}/products","href":"/api-reference/user-groups/unlink-products-from-user-group"}]},{"group":"metrics","pages":[{"title":"Get metrics","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics","href":"/api-reference/metrics/get-metrics"},{"title":"Create metric","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics","href":"/api-reference/metrics/create-metric"},{"title":"Create multiple metrics","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/batch","href":"/api-reference/metrics/create-multiple-metrics"},{"title":"Delete multiple metrics","deprecated":null,"version":null,"openapi":"/openapi.json delete /metrics/batch","href":"/api-reference/metrics/delete-multiple-metrics"},{"title":"Get metric by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}","href":"/api-reference/metrics/get-metric-by-id"},{"title":"Delete metric","deprecated":null,"version":null,"openapi":"/openapi.json delete /metrics/{id}","href":"/api-reference/metrics/delete-metric"},{"title":"Update metric","deprecated":null,"version":null,"openapi":"/openapi.json patch /metrics/{id}","href":"/api-reference/metrics/update-metric"},{"title":"Count replay candidates per product for a metric revision","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/replay-candidate-count","href":"/api-reference/metrics/count-replay-candidates-per-product-for-a-metric-revision"},{"title":"Generate or complete metric configuration with AI","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/generate-config","href":"/api-reference/metrics/generate-or-complete-metric-configuration-with-ai"},{"title":"Preview the prompt a judge configuration produces","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/preview-prompt","href":"/api-reference/metrics/preview-the-prompt-a-judge-configuration-produces"},{"title":"Score a draft Classifier question on a sample","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/test-draft","href":"/api-reference/metrics/score-a-draft-classifier-question-on-a-sample"},{"title":"Create several Classifier metrics at once (classifier metrics only)","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/bulk","href":"/api-reference/metrics/create-several-classifier-metrics-at-once-classifier-metrics-only"},{"title":"Propose Classifier metrics for an LLM judge metric","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/classifier-conversion","href":"/api-reference/metrics/propose-classifier-metrics-for-an-llm-judge-metric"},{"title":"Export a metric revision as a document","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/export","href":"/api-reference/metrics/export-a-metric-revision-as-a-document"},{"title":"Get the analytics impact of a metric revision","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/analytics-exclusion-impact","href":"/api-reference/metrics/get-the-analytics-impact-of-a-metric-revision"},{"title":"Include or exclude a metric revision from analytics","deprecated":null,"version":null,"openapi":"/openapi.json patch /metrics/{id}/analytics-exclusion","href":"/api-reference/metrics/include-or-exclude-a-metric-revision-from-analytics"},{"title":"Get human annotation count and optimization eligibility","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/human-annotation-count","href":"/api-reference/metrics/get-human-annotation-count-and-optimization-eligibility"},{"title":"Optimize metric","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/optimize","href":"/api-reference/metrics/optimize-metric"},{"title":"Activate an optimized judge prompt","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/activate-optimization","href":"/api-reference/metrics/activate-an-optimized-judge-prompt"},{"title":"Keep the current judge prompt over an optimized candidate","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/decline-optimization","href":"/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"},{"title":"Revise metric configuration with AI (Update With AI)","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/update-config","href":"/api-reference/metrics/revise-metric-configuration-with-ai-update-with-ai"}]},{"group":"specifications","pages":[{"title":"Get specifications","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications","href":"/api-reference/specifications/get-specifications"},{"title":"Create specification","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications","href":"/api-reference/specifications/create-specification"},{"title":"Get specification by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications/{id}","href":"/api-reference/specifications/get-specification-by-id"},{"title":"Delete specification","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/{id}","href":"/api-reference/specifications/delete-specification"},{"title":"Update specification","deprecated":null,"version":null,"openapi":"/openapi.json patch /specifications/{id}","href":"/api-reference/specifications/update-specification"},{"title":"Create multiple specifications","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/batch","href":"/api-reference/specifications/create-multiple-specifications"},{"title":"Delete multiple specifications","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/batch","href":"/api-reference/specifications/delete-multiple-specifications"},{"title":"Get linked metrics","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications/{id}/metrics","href":"/api-reference/specifications/get-linked-metrics"},{"title":"Link metrics to specification","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/{id}/metrics","href":"/api-reference/specifications/link-metrics-to-specification"},{"title":"Unlink metrics from specification","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/{id}/metrics","href":"/api-reference/specifications/unlink-metrics-from-specification"},{"title":"Get linked datasets","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications/{id}/tests","href":"/api-reference/specifications/get-linked-datasets"},{"title":"Link datasets to specification","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/{id}/tests","href":"/api-reference/specifications/link-datasets-to-specification"},{"title":"Unlink datasets from specification","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/{id}/tests","href":"/api-reference/specifications/unlink-datasets-from-specification"},{"title":"Generate specification configuration","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/generate-config","href":"/api-reference/specifications/generate-specification-configuration"}]},{"group":"models","pages":[{"title":"Get models","deprecated":null,"version":null,"openapi":"/openapi.json get /models","href":"/api-reference/models/get-models"},{"title":"Create model","deprecated":null,"version":null,"openapi":"/openapi.json post /models","href":"/api-reference/models/create-model"},{"title":"Delete multiple models","deprecated":null,"version":null,"openapi":"/openapi.json delete /models/batch","href":"/api-reference/models/delete-multiple-models"},{"title":"Get model by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /models/{id}","href":"/api-reference/models/get-model-by-id"},{"title":"Delete model","deprecated":null,"version":null,"openapi":"/openapi.json delete /models/{id}","href":"/api-reference/models/delete-model"},{"title":"Update model","deprecated":null,"version":null,"openapi":"/openapi.json patch /models/{id}","href":"/api-reference/models/update-model"}]},{"group":"products","pages":[{"title":"Get products","deprecated":null,"version":null,"openapi":"/openapi.json get /products","href":"/api-reference/products/get-products"},{"title":"Create product","deprecated":null,"version":null,"openapi":"/openapi.json post /products","href":"/api-reference/products/create-product"},{"title":"List distinct product tags","deprecated":null,"version":null,"openapi":"/openapi.json get /products/tags","href":"/api-reference/products/list-distinct-product-tags"},{"title":"Delete multiple products","deprecated":null,"version":null,"openapi":"/openapi.json delete /products/batch","href":"/api-reference/products/delete-multiple-products"},{"title":"Get product by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /products/{id}","href":"/api-reference/products/get-product-by-id"},{"title":"Delete product","deprecated":null,"version":null,"openapi":"/openapi.json delete /products/{id}","href":"/api-reference/products/delete-product"},{"title":"Update product","deprecated":null,"version":null,"openapi":"/openapi.json patch /products/{id}","href":"/api-reference/products/update-product"},{"title":"Generate product configuration using AI","deprecated":null,"version":null,"openapi":"/openapi.json post /products/generate-config","href":"/api-reference/products/generate-product-configuration-using-ai"},{"title":"Cross-check a document against an existing product's specifications","deprecated":null,"version":null,"openapi":"/openapi.json post /products/{id}/regenerate-config","href":"/api-reference/products/cross-check-a-document-against-an-existing-products-specifications"}]},{"group":"versions","pages":[{"title":"Get versions","deprecated":null,"version":null,"openapi":"/openapi.json get /versions","href":"/api-reference/versions/get-versions"},{"title":"Create version","deprecated":null,"version":null,"openapi":"/openapi.json post /versions","href":"/api-reference/versions/create-version"},{"title":"Get version by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /versions/{id}","href":"/api-reference/versions/get-version-by-id"},{"title":"Delete version","deprecated":null,"version":null,"openapi":"/openapi.json delete /versions/{id}","href":"/api-reference/versions/delete-version"},{"title":"Update version","deprecated":null,"version":null,"openapi":"/openapi.json patch /versions/{id}","href":"/api-reference/versions/update-version"},{"title":"List metrics annotated with compatibility for a version","deprecated":null,"version":null,"openapi":"/openapi.json get /versions/{id}/compatible-metrics","href":"/api-reference/versions/list-metrics-annotated-with-compatibility-for-a-version"},{"title":"Delete multiple versions","deprecated":null,"version":null,"openapi":"/openapi.json delete /versions/batch","href":"/api-reference/versions/delete-multiple-versions"},{"title":"Get or create version by facts","deprecated":null,"version":null,"openapi":"/openapi.json post /versions/get-or-create","href":"/api-reference/versions/get-or-create-version-by-facts"}]},{"group":"monitors","pages":[{"title":"Get monitor results","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{id}/results","href":"/api-reference/monitors/get-monitor-results"},{"title":"Delete multiple monitors","deprecated":null,"version":null,"openapi":"/openapi.json delete /monitors/batch","href":"/api-reference/monitors/delete-multiple-monitors"},{"title":"Get monitor by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{id}","href":"/api-reference/monitors/get-monitor-by-id"},{"title":"Delete monitor","deprecated":null,"version":null,"openapi":"/openapi.json delete /monitors/{id}","href":"/api-reference/monitors/delete-monitor"},{"title":"Update monitor","deprecated":null,"version":null,"openapi":"/openapi.json patch /monitors/{id}","href":"/api-reference/monitors/update-monitor"},{"title":"List a monitor's alert rules","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alert-rules","href":"/api-reference/monitors/list-a-monitors-alert-rules"},{"title":"Create a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules","href":"/api-reference/monitors/create-a-monitor-alert-rule"},{"title":"Get a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/api-reference/monitors/get-a-monitor-alert-rule"},{"title":"Delete a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json delete /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/api-reference/monitors/delete-a-monitor-alert-rule"},{"title":"Update a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json patch /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/api-reference/monitors/update-a-monitor-alert-rule"},{"title":"Pause a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/pause","href":"/api-reference/monitors/pause-a-monitor-alert-rule"},{"title":"Resume a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/resume","href":"/api-reference/monitors/resume-a-monitor-alert-rule"},{"title":"Regenerate an alert rule's webhook signing secret","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/regenerate-webhook-secret","href":"/api-reference/monitors/regenerate-an-alert-rules-webhook-signing-secret"},{"title":"List a monitor's alerts","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alerts","href":"/api-reference/monitors/list-a-monitors-alerts"},{"title":"Get a monitor alert","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alerts/{alertId}","href":"/api-reference/monitors/get-a-monitor-alert"},{"title":"Get monitors","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors","href":"/api-reference/monitors/get-monitors"},{"title":"Create monitor","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors","href":"/api-reference/monitors/create-monitor"},{"title":"Preview monitor content-filter matches","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/preview","href":"/api-reference/monitors/preview-monitor-content-filter-matches"},{"title":"Pause monitor","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{id}/pause","href":"/api-reference/monitors/pause-monitor"},{"title":"Resume monitor","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{id}/resume","href":"/api-reference/monitors/resume-monitor"}]},{"group":"endpoint-connections","pages":[{"title":"Test endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json post /endpointConnections/testConnection","href":"/api-reference/endpoint-connections/test-endpoint-connection"},{"title":"Parse a cURL command into endpoint connection fields","deprecated":null,"version":null,"openapi":"/openapi.json post /endpointConnections/parse-curl","href":"/api-reference/endpoint-connections/parse-a-curl-command-into-endpoint-connection-fields"},{"title":"Delete multiple endpoint connections","deprecated":null,"version":null,"openapi":"/openapi.json delete /endpointConnections/batch","href":"/api-reference/endpoint-connections/delete-multiple-endpoint-connections"},{"title":"Get endpoint connection by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /endpointConnections/{id}","href":"/api-reference/endpoint-connections/get-endpoint-connection-by-id"},{"title":"Delete endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json delete /endpointConnections/{id}","href":"/api-reference/endpoint-connections/delete-endpoint-connection"},{"title":"Update endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json patch /endpointConnections/{id}","href":"/api-reference/endpoint-connections/update-endpoint-connection"},{"title":"Get endpoint connections","deprecated":null,"version":null,"openapi":"/openapi.json get /endpointConnections","href":"/api-reference/endpoint-connections/get-endpoint-connections"},{"title":"Create endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json post /endpointConnections","href":"/api-reference/endpoint-connections/create-endpoint-connection"}]},{"group":"datasets","pages":[{"title":"Get dataset types used by the organization","deprecated":null,"version":null,"openapi":"/openapi.json get /tests/types","href":"/api-reference/datasets/get-dataset-types-used-by-the-organization"},{"title":"Extend a generated dataset with more cases","deprecated":null,"version":null,"openapi":"/openapi.json post /tests/{id}/extend","href":"/api-reference/datasets/extend-a-generated-dataset-with-more-cases"},{"title":"Create multiple datasets","deprecated":null,"version":null,"openapi":"/openapi.json post /tests/batch","href":"/api-reference/datasets/create-multiple-datasets"},{"title":"Delete multiple datasets","deprecated":null,"version":null,"openapi":"/openapi.json delete /tests/batch","href":"/api-reference/datasets/delete-multiple-datasets"},{"title":"Get dataset by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /tests/{id}","href":"/api-reference/datasets/get-dataset-by-id"},{"title":"Delete dataset","deprecated":null,"version":null,"openapi":"/openapi.json delete /tests/{id}","href":"/api-reference/datasets/delete-dataset"},{"title":"Update dataset","deprecated":null,"version":null,"openapi":"/openapi.json patch /tests/{id}","href":"/api-reference/datasets/update-dataset"},{"title":"Get datasets","deprecated":null,"version":null,"openapi":"/openapi.json get /tests","href":"/api-reference/datasets/get-datasets"},{"title":"Create dataset","deprecated":null,"version":null,"openapi":"/openapi.json post /tests","href":"/api-reference/datasets/create-dataset"},{"title":"Generate dataset configuration from specifications","deprecated":null,"version":null,"openapi":"/openapi.json post /tests/generate-config","href":"/api-reference/datasets/generate-dataset-configuration-from-specifications"}]},{"group":"test-cases","pages":[{"title":"Get test cases","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases","href":"/api-reference/test-cases/get-test-cases"},{"title":"Create test case","deprecated":null,"version":null,"openapi":"/openapi.json post /testCases","href":"/api-reference/test-cases/create-test-case"},{"title":"Get test case languages","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases/languages","href":"/api-reference/test-cases/get-test-case-languages"},{"title":"Export test cases as CSV","deprecated":null,"version":null,"openapi":"/openapi.json post /testCases/export","href":"/api-reference/test-cases/export-test-cases-as-csv"},{"title":"Get test case by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases/{id}","href":"/api-reference/test-cases/get-test-case-by-id"},{"title":"Delete test case","deprecated":null,"version":null,"openapi":"/openapi.json delete /testCases/{id}","href":"/api-reference/test-cases/delete-test-case"},{"title":"Update test case","deprecated":null,"version":null,"openapi":"/openapi.json patch /testCases/{id}","href":"/api-reference/test-cases/update-test-case"},{"title":"Delete multiple test cases","deprecated":null,"version":null,"openapi":"/openapi.json delete /testCases/batch","href":"/api-reference/test-cases/delete-multiple-test-cases"},{"title":"Augment test cases","deprecated":null,"version":null,"openapi":"/openapi.json post /generateFromFewShot/augment","href":"/api-reference/test-cases/augment-test-cases"},{"title":"Get augmentation task status","deprecated":null,"version":null,"openapi":"/openapi.json get /generateFromFewShot/status/{taskId}","href":"/api-reference/test-cases/get-augmentation-task-status"},{"title":"Count replay candidates per product for a test case revision","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases/{id}/replay-candidate-count","href":"/api-reference/test-cases/count-replay-candidates-per-product-for-a-test-case-revision"}]},{"group":"sessions","pages":[{"title":"List metrics annotated with compatibility for a session","deprecated":null,"version":null,"openapi":"/openapi.json get /sessions/{id}/compatible-metrics","href":"/api-reference/sessions/list-metrics-annotated-with-compatibility-for-a-session"},{"title":"Get sessions","deprecated":null,"version":null,"openapi":"/openapi.json get /sessions","href":"/api-reference/sessions/get-sessions"},{"title":"Create session","deprecated":null,"version":null,"openapi":"/openapi.json post /sessions","href":"/api-reference/sessions/create-session"},{"title":"Get session by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /sessions/{id}","href":"/api-reference/sessions/get-session-by-id"},{"title":"Delete session","deprecated":null,"version":null,"openapi":"/openapi.json delete /sessions/{id}","href":"/api-reference/sessions/delete-session"},{"title":"Update session","deprecated":null,"version":null,"openapi":"/openapi.json patch /sessions/{id}","href":"/api-reference/sessions/update-session"},{"title":"Finish session","deprecated":null,"version":null,"openapi":"/openapi.json patch /sessions/{id}/finish","href":"/api-reference/sessions/finish-session"},{"title":"Delete multiple sessions","deprecated":null,"version":null,"openapi":"/openapi.json delete /sessions/batch","href":"/api-reference/sessions/delete-multiple-sessions"},{"title":"Generate next user message","deprecated":null,"version":null,"openapi":"/openapi.json post /conversationSimulator/generateNextUserMessage","href":"/api-reference/sessions/generate-next-user-message"},{"title":"Import sessions from a Langfuse trace export","deprecated":null,"version":null,"openapi":"/openapi.json post /sessions/import","href":"/api-reference/sessions/import-sessions-from-a-langfuse-trace-export"}]},{"group":"traces","pages":[{"title":"Get traces","deprecated":null,"version":null,"openapi":"/openapi.json get /inferenceResults","href":"/api-reference/traces/get-traces"},{"title":"Create trace","deprecated":null,"version":null,"openapi":"/openapi.json post /inferenceResults","href":"/api-reference/traces/create-trace"},{"title":"Get aggregated performance data","deprecated":null,"version":null,"openapi":"/openapi.json get /inferenceResults/aggregatedData","href":"/api-reference/traces/get-aggregated-performance-data"},{"title":"Get trace by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /inferenceResults/{id}","href":"/api-reference/traces/get-trace-by-id"},{"title":"Delete trace","deprecated":null,"version":null,"openapi":"/openapi.json delete /inferenceResults/{id}","href":"/api-reference/traces/delete-trace"},{"title":"Update trace","deprecated":null,"version":null,"openapi":"/openapi.json patch /inferenceResults/{id}","href":"/api-reference/traces/update-trace"},{"title":"Create traces batch","deprecated":null,"version":null,"openapi":"/openapi.json post /inferenceResults/batch","href":"/api-reference/traces/create-traces-batch"},{"title":"Delete multiple traces","deprecated":null,"version":null,"openapi":"/openapi.json delete /inferenceResults/batch","href":"/api-reference/traces/delete-multiple-traces"},{"title":"Generate traces from test cases","deprecated":null,"version":null,"openapi":"/openapi.json post /inferenceResults/generate","href":"/api-reference/traces/generate-traces-from-test-cases"}]},{"group":"spans","pages":[{"title":"Get spans","deprecated":null,"version":null,"openapi":"/openapi.json get /traces","href":"/api-reference/spans/get-spans"},{"title":"Create span","deprecated":null,"version":null,"openapi":"/openapi.json post /traces","href":"/api-reference/spans/create-span"},{"title":"Get span by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /traces/{id}","href":"/api-reference/spans/get-span-by-id"},{"title":"Delete span","deprecated":null,"version":null,"openapi":"/openapi.json delete /traces/{id}","href":"/api-reference/spans/delete-span"},{"title":"Create spans batch","deprecated":null,"version":null,"openapi":"/openapi.json post /traces/batch","href":"/api-reference/spans/create-spans-batch"},{"title":"Delete multiple spans","deprecated":null,"version":null,"openapi":"/openapi.json delete /traces/batch","href":"/api-reference/spans/delete-multiple-spans"}]},{"group":"analytics","pages":[{"title":"Get analytics data","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics","href":"/api-reference/analytics/get-analytics-data"},{"title":"Export analytics data","deprecated":null,"version":null,"openapi":"/openapi.json post /analytics/export","href":"/api-reference/analytics/export-analytics-data"},{"title":"Get analytics insights for a version","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/insights","href":"/api-reference/analytics/get-analytics-insights-for-a-version"},{"title":"Get cross-version analytics comparison insights","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/insights/comparison","href":"/api-reference/analytics/get-cross-version-analytics-comparison-insights"},{"title":"Get latency, cost and tokens per version for a product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/inference","href":"/api-reference/analytics/get-latency-cost-and-tokens-per-version-for-a-product"},{"title":"Get the average score per version and the excluded-result count for a product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/version-summary","href":"/api-reference/analytics/get-the-average-score-per-version-and-the-excluded-result-count-for-a-product"},{"title":"Get the test-case coverage per version for a product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/coverage","href":"/api-reference/analytics/get-the-test-case-coverage-per-version-for-a-product"},{"title":"Get per-version scores and the newest version, per product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/summary","href":"/api-reference/analytics/get-per-version-scores-and-the-newest-version-per-product"},{"title":"List products with their session stats for a period","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/products","href":"/api-reference/analytics/list-products-with-their-session-stats-for-a-period"},{"title":"Get the sessions of a period summed over products","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/sessions-overview","href":"/api-reference/analytics/get-the-sessions-of-a-period-summed-over-products"},{"title":"Get the estimated cost of the sessions of a period summed over products","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/cost-overview","href":"/api-reference/analytics/get-the-estimated-cost-of-the-sessions-of-a-period-summed-over-products"},{"title":"Get the estimated cost, LLM spans and tokens of a period split by model, version or end user","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/cost-breakdown","href":"/api-reference/analytics/get-the-estimated-cost-llm-spans-and-tokens-of-a-period-split-by-model-version-or-end-user"},{"title":"List the products whose share of critical failures went up","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/changes","href":"/api-reference/analytics/list-the-products-whose-share-of-critical-failures-went-up"},{"title":"List the specifications that sessions failed in a period","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/failing-specifications","href":"/api-reference/analytics/list-the-specifications-that-sessions-failed-in-a-period"},{"title":"Get the session outcomes of a product per day, week or month","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/session-outcomes-over-time","href":"/api-reference/analytics/get-the-session-outcomes-of-a-product-per-day-week-or-month"},{"title":"Get the estimated cost per session of a product per day, week or month","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/session-cost-over-time","href":"/api-reference/analytics/get-the-estimated-cost-per-session-of-a-product-per-day-week-or-month"}]},{"group":"storage","pages":[{"title":"Generate upload presigned URL","deprecated":null,"version":null,"openapi":"/openapi.json get /storage/generate-put-presigned-url","href":"/api-reference/storage/generate-upload-presigned-url"},{"title":"Generate download presigned URL","deprecated":null,"version":null,"openapi":"/openapi.json get /storage/generate-get-presigned-url","href":"/api-reference/storage/generate-download-presigned-url"}]},{"group":"jobs","pages":[{"title":"Get job status","deprecated":null,"version":null,"openapi":"/openapi.json get /jobs/{jobId}/status","href":"/api-reference/jobs/get-job-status"},{"title":"Cancel a job","deprecated":null,"version":null,"openapi":"/openapi.json post /jobs/{jobId}/cancel","href":"/api-reference/jobs/cancel-a-job"}]},{"group":"otel","pages":[{"title":"Validate credentials for OTel ingestion","deprecated":null,"version":null,"openapi":"/openapi.json post /otel/auth","href":"/api-reference/otel/validate-credentials-for-otel-ingestion"},{"title":"Ingest OpenTelemetry spans (OTLP JSON)","deprecated":null,"version":null,"openapi":"/openapi.json post /otel/traces","href":"/api-reference/otel/ingest-opentelemetry-spans-otlp-json"}]},{"group":"phone-connections","pages":[{"title":"Get phone connections","deprecated":null,"version":null,"openapi":"/openapi.json get /phoneConnections","href":"/api-reference/phone-connections/get-phone-connections"},{"title":"Create phone connection","deprecated":null,"version":null,"openapi":"/openapi.json post /phoneConnections","href":"/api-reference/phone-connections/create-phone-connection"},{"title":"Get phone connection by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /phoneConnections/{id}","href":"/api-reference/phone-connections/get-phone-connection-by-id"},{"title":"Delete phone connection","deprecated":null,"version":null,"openapi":"/openapi.json delete /phoneConnections/{id}","href":"/api-reference/phone-connections/delete-phone-connection"},{"title":"Update phone connection","deprecated":null,"version":null,"openapi":"/openapi.json patch /phoneConnections/{id}","href":"/api-reference/phone-connections/update-phone-connection"},{"title":"Delete multiple phone connections","deprecated":null,"version":null,"openapi":"/openapi.json delete /phoneConnections/batch","href":"/api-reference/phone-connections/delete-multiple-phone-connections"}]},{"group":"web-rtc-connections","pages":[{"title":"Get WebRTC connections","deprecated":null,"version":null,"openapi":"/openapi.json get /webRtcConnections","href":"/api-reference/web-rtc-connections/get-webrtc-connections"},{"title":"Create WebRTC connection","deprecated":null,"version":null,"openapi":"/openapi.json post /webRtcConnections","href":"/api-reference/web-rtc-connections/create-webrtc-connection"},{"title":"Get WebRTC connection by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /webRtcConnections/{id}","href":"/api-reference/web-rtc-connections/get-webrtc-connection-by-id"},{"title":"Delete WebRTC connection","deprecated":null,"version":null,"openapi":"/openapi.json delete /webRtcConnections/{id}","href":"/api-reference/web-rtc-connections/delete-webrtc-connection"},{"title":"Update WebRTC connection","deprecated":null,"version":null,"openapi":"/openapi.json patch /webRtcConnections/{id}","href":"/api-reference/web-rtc-connections/update-webrtc-connection"},{"title":"Delete multiple WebRTC connections","deprecated":null,"version":null,"openapi":"/openapi.json delete /webRtcConnections/batch","href":"/api-reference/web-rtc-connections/delete-multiple-webrtc-connections"}]},{"group":"evaluations","pages":[{"title":"Get evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations","href":"/api-reference/evaluations/get-evaluations"},{"title":"Get evaluation count and last-evaluated date per product","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/summary","href":"/api-reference/evaluations/get-evaluation-count-and-last-evaluated-date-per-product"},{"title":"Get evaluation by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/{id}","href":"/api-reference/evaluations/get-evaluation-by-id"},{"title":"Delete evaluation","deprecated":null,"version":null,"openapi":"/openapi.json delete /evaluations/{id}","href":"/api-reference/evaluations/delete-evaluation"},{"title":"Create evaluations from session","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromSession","href":"/api-reference/evaluations/create-evaluations-from-session"},{"title":"Evaluate multiple sessions in one call","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromSessions","href":"/api-reference/evaluations/evaluate-multiple-sessions-in-one-call"},{"title":"Create evaluations for a single trace","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromInferenceResult","href":"/api-reference/evaluations/create-evaluations-for-a-single-trace"},{"title":"Create single-turn evaluations","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/singleTurn","href":"/api-reference/evaluations/create-single-turn-evaluations"},{"title":"Retry failed evaluations","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/retry","href":"/api-reference/evaluations/retry-failed-evaluations"},{"title":"Evaluate a version","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromVersion","href":"/api-reference/evaluations/evaluate-a-version"},{"title":"Replay evaluations onto a new metric revision","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromMetrics","href":"/api-reference/evaluations/replay-evaluations-onto-a-new-metric-revision"},{"title":"Replay evaluations onto a new test case revision","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromTestCases","href":"/api-reference/evaluations/replay-evaluations-onto-a-new-test-case-revision"},{"title":"Delete multiple evaluations","deprecated":null,"version":null,"openapi":"/openapi.json delete /evaluations/batch","href":"/api-reference/evaluations/delete-multiple-evaluations"},{"title":"Get pending human evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/human/pending","href":"/api-reference/evaluations/get-pending-human-evaluations"},{"title":"Get completed human evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/human/completed","href":"/api-reference/evaluations/get-completed-human-evaluations"},{"title":"Claim an evaluation for human review or annotation","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/claim","href":"/api-reference/evaluations/claim-an-evaluation-for-human-review-or-annotation"},{"title":"Release a claimed evaluation or annotation","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/release","href":"/api-reference/evaluations/release-a-claimed-evaluation-or-annotation"},{"title":"Submit a human evaluation or annotation score","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/submit","href":"/api-reference/evaluations/submit-a-human-evaluation-or-annotation-score"},{"title":"Edit a submitted human evaluation","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/edit-human","href":"/api-reference/evaluations/edit-a-submitted-human-evaluation"},{"title":"Remove a human annotation","deprecated":null,"version":null,"openapi":"/openapi.json delete /evaluations/{id}/human-annotation","href":"/api-reference/evaluations/remove-a-human-annotation"}]},{"group":"evaluator-models","pages":[{"title":"Get evaluator models","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluatorModels","href":"/api-reference/evaluator-models/get-evaluator-models"},{"title":"Check judge generation settings against the model","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluatorModels/test-generation-settings","href":"/api-reference/evaluator-models/check-judge-generation-settings-against-the-model"}]},{"group":"comments","pages":[{"title":"Create comment","deprecated":null,"version":null,"openapi":"/openapi.json post /comments","href":"/api-reference/comments/create-comment"},{"title":"List distinct comment labels","deprecated":null,"version":null,"openapi":"/openapi.json get /comments/tags","href":"/api-reference/comments/list-distinct-comment-labels"},{"title":"Delete comment","deprecated":null,"version":null,"openapi":"/openapi.json delete /comments/{commentId}","href":"/api-reference/comments/delete-comment"}]},{"group":"metrics-v2","pages":[{"title":"List metrics","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/metrics","href":"/api-reference/metrics-v2/list-metrics"},{"title":"Create metric","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/metrics","href":"/api-reference/metrics-v2/create-metric"},{"title":"Get metric by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/metrics/{id}","href":"/api-reference/metrics-v2/get-metric-by-id"},{"title":"Delete metric","deprecated":null,"version":null,"openapi":"/openapi.json delete /v2/metrics/{id}","href":"/api-reference/metrics-v2/delete-metric"},{"title":"Update metric","description":"Change the name, description or tags of a metric. Every revision shows the change. Any other field answers 400: a change to a judge setting is a new revision. The id is a metric id. A revision id answers 404. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json patch /v2/metrics/{id}","href":"/api-reference/metrics-v2/update-metric"}]},{"group":"revisions","pages":[{"title":"List the revisions of a metric","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions","href":"/api-reference/revisions/list-the-revisions-of-a-metric"},{"title":"Create revision","description":"Create a revision of a metric, from its active revision or from the revision that `parentRevisionId` names. The new revision becomes the active one, and the old active one becomes legacy. A revision keeps the metric's name, description, tags and evaluation type, so the body takes its own `name`, the judge settings and links only. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions","href":"/api-reference/revisions/create-revision"},{"title":"Get revision by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}","href":"/api-reference/revisions/get-revision-by-id"},{"title":"Rename a revision","deprecated":null,"version":null,"openapi":"/openapi.json patch /v2/revisions/{id}","href":"/api-reference/revisions/rename-a-revision"},{"title":"Export a revision as a document","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}/export","href":"/api-reference/revisions/export-a-revision-as-a-document"},{"title":"Propose Classifier metrics for an LLM judge revision","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions/{id}/classifier-conversion","href":"/api-reference/revisions/propose-classifier-metrics-for-an-llm-judge-revision"},{"title":"Count the replay candidates of a revision","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}/replay-candidate-count","href":"/api-reference/revisions/count-the-replay-candidates-of-a-revision"},{"title":"Exclude a revision from analytics","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions/{id}/exclude-from-analytics","href":"/api-reference/revisions/exclude-a-revision-from-analytics"},{"title":"Include a revision in analytics","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions/{id}/include-in-analytics","href":"/api-reference/revisions/include-a-revision-in-analytics"},{"title":"Get the analytics impact of a revision","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}/analytics-exclusion-impact","href":"/api-reference/revisions/get-the-analytics-impact-of-a-revision"}]},{"group":"runs","pages":[{"title":"Get runs","deprecated":null,"version":null,"openapi":"/openapi.json get /runs","href":"/api-reference/runs/get-runs"},{"title":"Create run","deprecated":null,"version":null,"openapi":"/openapi.json post /runs","href":"/api-reference/runs/create-run"},{"title":"Close run","deprecated":null,"version":null,"openapi":"/openapi.json post /runs/{id}/close","href":"/api-reference/runs/close-run"},{"title":"Run a run again","deprecated":null,"version":null,"openapi":"/openapi.json post /runs/{id}/relaunch","href":"/api-reference/runs/run-a-run-again"},{"title":"Cancel run","deprecated":null,"version":null,"openapi":"/openapi.json post /runs/{id}/cancel","href":"/api-reference/runs/cancel-run"},{"title":"Get run metric summary","deprecated":null,"version":null,"openapi":"/openapi.json get /runs/{id}/metric-summary","href":"/api-reference/runs/get-run-metric-summary"},{"title":"Get run by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /runs/{id}","href":"/api-reference/runs/get-run-by-id"},{"title":"Delete run","deprecated":null,"version":null,"openapi":"/openapi.json delete /runs/{id}","href":"/api-reference/runs/delete-run"}]}]}]}]},{"version":"5.18","pages":[{"title":"5.18","href":"/v5.18/api-reference/health-check"}]},{"version":"5.17","pages":[{"title":"5.17","href":"/v5.17/api-reference/health-check"}]},{"version":"5.16","pages":[{"title":"5.16","href":"/v5.16/api-reference/health-check"}]},{"version":"5.15","pages":[{"title":"5.15","href":"/v5.15/api-reference/health-check"}]},{"version":"5.14","pages":[{"title":"5.14","href":"/v5.14/api-reference/health-check"}]},{"version":"5.13","pages":[{"title":"5.13","href":"/v5.13/api-reference/health-check"}]},{"version":"5.12","pages":[{"title":"5.12","href":"/v5.12/api-reference/health-check"}]},{"version":"5.11","pages":[{"title":"5.11","href":"/v5.11/api-reference/health-check"}]},{"version":"5.10","pages":[{"title":"5.10","href":"/v5.10/introduction"}]}]},"basePath":"","title":"List the revisions of a metric - Galtea Docs","deploymentId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","buildId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","dynamics":["c2aa737661","2b790eda92","b0f84f53ff","a9bb46feb3"],"chunks":["OpenApiReferenceProvider-jJHA3WSo.js","utils-DbZn3Mjn.js","cloneDeep-CnBnaSyy.js","_Uint8Array-CMQtTgBR.js","isObject-FP1Yky1u.js","utils-Bl2DvzOJ.js","addUniqueKeysToSchema-BwOLo9p1.js","snippetPresets-BBiPpKa-.js","style-to-object-BY3JEAdk.js","v4-DIgz8zy6.js","conditional-requirements-CFM0id0Q.js","ApiExamples-C0px4Tml.js","isEqual-zAyttAAO.js","usePlaygroundInputsStore-Dell6dGw.js","shallow-0VKqkSqN.js","getApiPlaygroundDisplay-CP_ctPEB.js","CodeSnippet-5L35ic0s.js","CodeSnippets-DOXbNhJw.js","Page-DRLI_2Ue.js","getPastedJson-VhzT9m2P.js","icon-CD8_AtCO.js","MethodPill-DGgOMftG.js","DuplicateIcon-DZ6A_EtN.js","createIcon-DUl4oM5f.js","DynamicMarkdown-BGHukeRM.js","SectionHeading-ChrEUs8u.js","axios-vUo_bRtp.js","Markdown-Dj-na-_-.js","dist-C5gjFYHe.js","lib-DuNMoZ05.js","lib-B8HbPgcC.js","katex-YMM-FMeD.js","html-void-elements-mCSPHezU.js","marked.esm-CZWythHk.js","AssistantPageLink-DEBW87tT.js"]}