Create a metric with its first revision. To revise a metric, create a revision under /v2/revisions: this body refuses parentMetricId. source takes the values that POST /metrics takes. See Metrics.
API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (gsk_*) and legacy (gsk-) API keys are accepted, e.g. Authorization: Bearer gsk_... or Authorization: Bearer gsk-....
Headers
Prefer
string
Send return=minimal to get no body back from a write and skip reading the resource: a create answers 201 with only Location, and an update answers 204.
Example:
"return=minimal"
Body
application/json
name
string
required
Required string length: 1 - 200
Example:
"Accuracy"
source
enum<string> | null
Available options:
SELF_HOSTED,
FULL_PROMPT,
PARTIAL_PROMPT,
HUMAN_EVALUATION,
GEVAL,
DEEPEVAL,
DETERMINISTIC,
CLASSIFIER
Example:
"PARTIAL_PROMPT"
evaluationParams
string[] | null
Maximum array length: 20
Required string length: 1 - 64
Example:
["input", "actual_output"]
judgePrompt
string | null
Maximum string length: 20000
evaluatorModelName
string | null
Required for PARTIAL_PROMPT. For CLASSIFIER: The selectable classifier model to run the question under, as listed by GET /evaluatorModels with kind=CLASSIFIER and selectable=true. Omitted or null, the one selectable classifier model is used. When several are selectable, the request is refused with 400 and this field must be sent.
Example:
"gpt-4.1"
definition
string | null
description
string | null
Maximum string length: 5000
documentationUrl
string | null
tags
string[] | null
Maximum array length: 20
Required string length: 1 - 64
areEvalParamsTop
boolean | null
organizationId
string | null
Example:
"org_123"
userGroupIds
string[] | null
Minimum string length: 1
Example:
["ug_123"]
specificationIds
string[] | null
Minimum string length: 1
Example:
["spec_123"]
judgeGenerationSettings
object | null
The generation settings this metric's judge runs with. Immutable: changing one creates a revision. Only the settings GET /evaluatorModels reports as configurable for the chosen model take effect; a value the provider rejects ends that evaluation as SKIPPED carrying the provider's own message.
Show child attributes
passThreshold
number | null
Score from 0 to 1 at or above which an evaluation of this metric passes. Omitted or null, it defaults to 0.5, or to the parent metric's threshold for a revision.
Required range: 0 <= x <= 1
Example:
0.7
applicabilityScope
enum<string> | null
Which sessions get the applicability check before this metric is judged: PRODUCTION, DEVELOPMENT, ALL or NONE (no check). A session the check finds the metric does not apply to is skipped and no judge call is made. Omitted or null, it defaults to PRODUCTION for a metric the platform scores and NONE for any other. A revision keeps the parent metric's value when the check runs for both. Fixed at create: a change creates a revision. Any value but NONE is refused with a 400 for a metric the platform does not score. A metric that scores only traces is never checked, so it takes NONE and refuses any other value. A metric that also scores another field is checked without traces: on each turn's input and actual output and its other fields. A FULL_PROMPT metric with empty evaluationParams whose judge prompt reads only traces is stored as checked, yet the evaluator judges it without the check. A FULL_PROMPT metric whose evaluationParams list only traces takes NONE even when its judge prompt reads another field: list that field in evaluationParams to get the check. The check runs only where the deployment enables it.
Available options:
NONE,
DEVELOPMENT,
PRODUCTION,
ALL
Example:
"PRODUCTION"
applicabilityThreshold
number | null
The lowest probability, from 0 to 1, that the metric applies to a session at which it is judged. Below it, the session is skipped. Omitted or null, it defaults to 0.5, or to the parent metric's value for a revision when the check runs for both. Fixed at create: a change creates a revision. Refused with a 400 for a metric the platform does not score, and for a metric that scores only traces. The check runs only where the deployment enables it.
Required range: 0 <= x <= 1
Example:
0.7
classifierQuestion
object | null
CLASSIFIER only, and required there: the one question the classifier answers. evaluationParams is derived from its {{ param }} placeholders.
Show child attributes
Response
Metric created successfully. On Prefer: return=minimal, or when the read after the write fails, the answer has no body.
id
string
required
Metric ID.
Example:
"metric_123"
organizationId
string | null
required
The organization of the metric. Null for a Galtea metric.
Example:
"org_123"
userId
string | null
required
Example:
"user_123"
name
string
required
Metric name, unique in its organization.
Example:
"Accuracy"
description
string | null
required
Example:
"Measures the accuracy of responses"
tags
string[]
required
Example:
["accuracy", "quality"]
documentationUrl
string | null
required
Example:
"https://docs.example.com/metrics/accuracy"
source
enum<string> | null
required
Evaluation method for the metric. FULL_PROMPT is deprecated for creation — POST /metrics rejects it with a 400. Use PARTIAL_PROMPT for new AI Evaluation metrics. The value remains in the enum because existing FULL_PROMPT metrics are still returned by reads and filters. CLASSIFIER is the Classifier judge, accepted only where the deployment enables it.
Available options:
SELF_HOSTED,
FULL_PROMPT,
PARTIAL_PROMPT,
HUMAN_EVALUATION,
GEVAL,
DEEPEVAL,
DETERMINISTIC,
CLASSIFIER
Example:
"PARTIAL_PROMPT"
activeRevisionId
string | null
required
read-only
The revision that evaluations of this metric run. Null when no revision is active.
Example:
"revision_123"
createdAt
string<date-time>
required
disabledAt
string<date-time> | null
required
read-only
The metric's own disabled date. It ignores the evaluator model of each revision: read a revision for that.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"Galtea Docs","colors":{"primary":"#5286FF","light":"#A9E3FE","dark":"#171717"},"logo":{"light":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5","dark":"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/dark.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=0ea251446a97e2cd0bb0e9de1b049412"},"favicon":"https://mintcdn.com/galtea/sKxmtq77X98SiOSi/favicon.png?fit=max\u0026auto=format\u0026n=sKxmtq77X98SiOSi\u0026q=85\u0026s=a297a4f88e5dd07d7858dc2998dfe3ce","appearance":{"default":"system","strict":false},"background":{"color":{"light":"#f6f6f5","dark":"#09090a"}},"navbar":{"links":[{"href":"mailto:support@galtea.ai","label":"Support"}],"primary":{"type":"button","label":"Dashboard","href":"https://platform.galtea.ai"}},"footer":{"socials":{"linkedin":"https://linkedin.com/company/galtea-ai","website":"https://galtea.ai"}},"fonts":{"family":"Geist"},"icons":{"library":"fontawesome"},"styling":{"eyebrows":"breadcrumbs","codeblocks":"system","latex":true},"integrations":{"posthog":{"apiKey":"phc_5hcYhBTteqSv1mp9ObS5j28EKEA1HV6sog9EZHikgcF","apiHost":"https://t.galtea.ai","sessionRecording":false}},"contextual":{"options":["copy","view","chatgpt","claude","perplexity","mcp","cursor","vscode"],"display":"header"},"navigation":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"galtea","hasAudioNarration":false,"actualSubdomain":"galtea","customDomains":["docs.galtea.ai"],"gitSource":{"type":"github","owner":"galtea-ai","repo":"docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{},"buildId":"6afd9a972bf917781dec84d5","clientVersion":"0.0.4177","searchFilterCounts":[{"language":"default","tag":"Concepts","count":3896},{"language":"default","tag":"REST API","count":1987},{"language":"default","tag":"Endpoints","count":1760},{"language":"default","tag":"SDK","count":1413},{"language":"default","tag":"Metrics","count":387},{"language":"default","tag":"Guides","count":330},{"language":"default","tag":"Deployment","count":180},{"language":"default","tag":"evaluations","count":180},{"language":"default","tag":"monitors","count":180},{"language":"default","tag":"metrics","count":177}]},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"starter-pricing","enabled":true,"variant":{"name":"treatment","enabled":true,"payload":{"type":"string","value":"treatment"},"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"wildcard-email-auth","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":true},"customCss":[],"page":{"pagePath":"api-reference/metrics-v2/create-metric","slug":"/api-reference/metrics-v2/create-metric","pageMetadata":{"title":"Create metric","description":"Create a metric with its first revision. To revise a metric, create a revision under `/v2/revisions`: this body refuses `parentMetricId`. `source` takes the values that `POST /metrics` takes. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/metrics","href":"/api-reference/metrics-v2/create-metric","autogeneratedByOpenApi":true},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx, jsxs: _jsxs} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n a: \"a\",\n code: \"code\",\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsxs(_components.p, {\n children: [\"Create a metric with its first revision. To revise a metric, create a revision under \", _jsx(_components.code, {\n children: \"/v2/revisions\"\n }), \": this body refuses \", _jsx(_components.code, {\n children: \"parentMetricId\"\n }), \". \", _jsx(_components.code, {\n children: \"source\"\n }), \" takes the values that \", _jsx(_components.code, {\n children: \"POST /metrics\"\n }), \" takes. See \", _jsx(_components.a, {\n href: \"https://docs.galtea.ai/concepts/metric\",\n children: \"Metrics\"\n }), \".\"]\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){return _jsx(_Fragment,{})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent}","frontmatter":{},"scope":{"codeStyling":"system","config":{},"pageMetadata":{"title":"Create metric","description":"Create a metric with its first revision. To revise a metric, create a revision under `/v2/revisions`: this body refuses `parentMetricId`. `source` takes the values that `POST /metrics` takes. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/metrics","href":"/api-reference/metrics-v2/create-metric","autogeneratedByOpenApi":true}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[],"codeExamples":{}},"jsLinks":["/_mintlify/custom/galtea/d232846d89fbe5a1/galtea-assistant.js"],"openApiReferenceData":{"operation":{"operationId":"createMetricV2","tags":["metrics-v2"],"summary":"Create metric","description":"Create a metric with its first revision. To revise a metric, create a revision under `/v2/revisions`: this body refuses `parentMetricId`. `source` takes the values that `POST /metrics` takes. See [Metrics](https://docs.galtea.ai/concepts/metric).","security":["a3df997e-5618-4708-9bcd-88211b174123"],"x-cli-name":"create","x-stability-level":"alpha","parameters":["10dbb4e0-6867-4fe8-9283-e478041500a7"],"requestBody":"6fa8052f-c51c-46f2-bab1-6b2d278ef3dc","responses":{"201":"bebd4c91-9e7c-4087-b179-e789b8dd5dc9","400":"11e45f4c-1a11-476b-b7f1-a7b1351325f5","401":"dbeb0ad1-3dd7-414e-adb4-2271c0cb5a13","403":"a8980b1d-a83f-4570-9d34-6f1ef27ea2a3","404":"b8ecaf8d-accd-4403-a9cc-8f0674bf8753"},"method":"post","type":"path","servers":["5b6f56cc-f97c-491d-a9e9-d0699bff83b6"],"path":"/v2/metrics","baseUrlOptions":["https://api.galtea.ai"],"title":"Create metric","codeSamples":[],"requiredOnlyExamples":false,"requestExampleType":"generated","responseExampleType":"generated"},"dependencies":{"parameters":{"10dbb4e0-6867-4fe8-9283-e478041500a7":{"schema":{"type":"string","description":"Send `return=minimal` to get no body back from a write and skip reading the resource: a create answers `201` with only `Location`, and an update answers `204`.","example":"return=minimal","isRequired":false,"uniqueKey":"","typeLabel":"string"},"required":false,"description":"Send `return=minimal` to get no body back from a write and skip reading the resource: a create answers `201` with only `Location`, and an update answers `204`.","name":"Prefer","in":"header"}},"requestBody":{"required":true,"content":{"application/json":{"schema":{"type":"object","properties":{"name":{"type":"string","minLength":1,"maxLength":200,"example":"Accuracy","isRequired":true,"uniqueKey":"name","typeLabel":"string"},"source":{"oneOf":[{"type":"string","enum":["SELF_HOSTED","FULL_PROMPT","PARTIAL_PROMPT","HUMAN_EVALUATION","GEVAL","DEEPEVAL","DETERMINISTIC","CLASSIFIER"],"example":"PARTIAL_PROMPT","uniqueKey":"source.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["SELF_HOSTED","FULL_PROMPT","PARTIAL_PROMPT","HUMAN_EVALUATION","GEVAL","DEEPEVAL","DETERMINISTIC","CLASSIFIER"],"example":"PARTIAL_PROMPT","uniqueKey":"source.oneOf.1","typeLabel":"null"}],"uniqueKey":"source","typeLabel":"enum\u003cstring> | null"},"evaluationParams":{"oneOf":[{"type":"array","items":{"type":"string","minLength":1,"maxLength":64,"uniqueKey":"evaluationParams.oneOf.0.items.[INDEX]","typeLabel":"string"},"maxItems":20,"example":["input","actual_output"],"uniqueKey":"evaluationParams.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string","minLength":1,"maxLength":64},"maxItems":20,"example":["input","actual_output"],"uniqueKey":"evaluationParams.oneOf.1","typeLabel":"null"}],"uniqueKey":"evaluationParams","typeLabel":"string[] | null"},"judgePrompt":{"oneOf":[{"type":"string","maxLength":20000,"uniqueKey":"judgePrompt.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":20000,"uniqueKey":"judgePrompt.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgePrompt","typeLabel":"string | null"},"evaluatorModelName":{"oneOf":[{"type":"string","example":"gpt-4.1","description":"Required for PARTIAL_PROMPT. For CLASSIFIER: The selectable classifier model to run the question under, as listed by `GET /evaluatorModels` with `kind=CLASSIFIER` and `selectable=true`. Omitted or null, the one selectable classifier model is used. When several are selectable, the request is refused with 400 and this field must be sent.","uniqueKey":"evaluatorModelName.oneOf.0","typeLabel":"string"},{"type":"null","example":"gpt-4.1","description":"Required for PARTIAL_PROMPT. For CLASSIFIER: The selectable classifier model to run the question under, as listed by `GET /evaluatorModels` with `kind=CLASSIFIER` and `selectable=true`. Omitted or null, the one selectable classifier model is used. When several are selectable, the request is refused with 400 and this field must be sent.","uniqueKey":"evaluatorModelName.oneOf.1","typeLabel":"null"}],"uniqueKey":"evaluatorModelName","typeLabel":"string | null"},"definition":{"oneOf":[{"type":"string","uniqueKey":"definition.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"definition.oneOf.1","typeLabel":"null"}],"uniqueKey":"definition","typeLabel":"string | null"},"description":{"oneOf":[{"type":"string","maxLength":5000,"uniqueKey":"description.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":5000,"uniqueKey":"description.oneOf.1","typeLabel":"null"}],"uniqueKey":"description","typeLabel":"string | null"},"documentationUrl":{"oneOf":[{"type":"string","uniqueKey":"documentationUrl.oneOf.0","typeLabel":"string"},{"type":"null","uniqueKey":"documentationUrl.oneOf.1","typeLabel":"null"}],"uniqueKey":"documentationUrl","typeLabel":"string | null"},"tags":{"oneOf":[{"type":"array","items":{"type":"string","minLength":1,"maxLength":64,"uniqueKey":"tags.oneOf.0.items.[INDEX]","typeLabel":"string"},"maxItems":20,"uniqueKey":"tags.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string","minLength":1,"maxLength":64},"maxItems":20,"uniqueKey":"tags.oneOf.1","typeLabel":"null"}],"uniqueKey":"tags","typeLabel":"string[] | null"},"areEvalParamsTop":{"oneOf":[{"type":"boolean","uniqueKey":"areEvalParamsTop.oneOf.0","typeLabel":"boolean"},{"type":"null","uniqueKey":"areEvalParamsTop.oneOf.1","typeLabel":"null"}],"uniqueKey":"areEvalParamsTop","typeLabel":"boolean | null"},"organizationId":{"oneOf":[{"type":"string","example":"org_123","uniqueKey":"organizationId.oneOf.0","typeLabel":"string"},{"type":"null","example":"org_123","uniqueKey":"organizationId.oneOf.1","typeLabel":"null"}],"uniqueKey":"organizationId","typeLabel":"string | null"},"userGroupIds":{"oneOf":[{"type":"array","items":{"type":"string","minLength":1,"uniqueKey":"userGroupIds.oneOf.0.items.[INDEX]","typeLabel":"string"},"example":["ug_123"],"uniqueKey":"userGroupIds.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string","minLength":1},"example":["ug_123"],"uniqueKey":"userGroupIds.oneOf.1","typeLabel":"null"}],"uniqueKey":"userGroupIds","typeLabel":"string[] | null"},"specificationIds":{"oneOf":[{"type":"array","items":{"type":"string","minLength":1,"uniqueKey":"specificationIds.oneOf.0.items.[INDEX]","typeLabel":"string"},"example":["spec_123"],"uniqueKey":"specificationIds.oneOf.0","typeLabel":"string[]"},{"type":"null","items":{"type":"string","minLength":1},"example":["spec_123"],"uniqueKey":"specificationIds.oneOf.1","typeLabel":"null"}],"uniqueKey":"specificationIds","typeLabel":"string[] | null"},"judgeGenerationSettings":{"oneOf":[{"type":"object","properties":{"temperature":{"oneOf":[{"type":"number","minimum":0,"example":0.3,"uniqueKey":"judgeGenerationSettings.oneOf.0.temperature.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"example":0.3,"uniqueKey":"judgeGenerationSettings.oneOf.0.temperature.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.temperature","typeLabel":"number | null"},"topP":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.9,"uniqueKey":"judgeGenerationSettings.oneOf.0.topP.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.9,"uniqueKey":"judgeGenerationSettings.oneOf.0.topP.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.topP","typeLabel":"number | null"},"maxOutputTokens":{"oneOf":[{"type":"integer","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap.","uniqueKey":"judgeGenerationSettings.oneOf.0.maxOutputTokens.oneOf.0","typeLabel":"integer"},{"type":"null","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap.","uniqueKey":"judgeGenerationSettings.oneOf.0.maxOutputTokens.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.maxOutputTokens","typeLabel":"integer | null"},"reasoningEffort":{"oneOf":[{"type":"string","example":"low","uniqueKey":"judgeGenerationSettings.oneOf.0.reasoningEffort.oneOf.0","typeLabel":"string"},{"type":"null","example":"low","uniqueKey":"judgeGenerationSettings.oneOf.0.reasoningEffort.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings.oneOf.0.reasoningEffort","typeLabel":"string | null"}},"additionalProperties":false,"description":"The generation settings this metric's judge runs with. Immutable: changing one creates a revision. Only the settings `GET /evaluatorModels` reports as configurable for the chosen model take effect; a value the provider rejects ends that evaluation as SKIPPED carrying the provider's own message.","uniqueKey":"judgeGenerationSettings.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"temperature":{"oneOf":[{"type":"number","minimum":0,"example":0.3},{"type":"null","minimum":0,"example":0.3}]},"topP":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.9},{"type":"null","minimum":0,"maximum":1,"example":0.9}]},"maxOutputTokens":{"oneOf":[{"type":"integer","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap."},{"type":"null","minimum":1,"example":512,"description":"A new metric needs at least 256, so the judge's structured answer fits. A metric stored before that floor keeps its cap."}]},"reasoningEffort":{"oneOf":[{"type":"string","example":"low"},{"type":"null","example":"low"}]}},"additionalProperties":false,"description":"The generation settings this metric's judge runs with. Immutable: changing one creates a revision. Only the settings `GET /evaluatorModels` reports as configurable for the chosen model take effect; a value the provider rejects ends that evaluation as SKIPPED carrying the provider's own message.","uniqueKey":"judgeGenerationSettings.oneOf.1","typeLabel":"null"}],"uniqueKey":"judgeGenerationSettings","typeLabel":"object | null"},"passThreshold":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.7,"description":"Score from 0 to 1 at or above which an evaluation of this metric passes. Omitted or null, it defaults to 0.5, or to the parent metric's threshold for a revision.","uniqueKey":"passThreshold.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.7,"description":"Score from 0 to 1 at or above which an evaluation of this metric passes. Omitted or null, it defaults to 0.5, or to the parent metric's threshold for a revision.","uniqueKey":"passThreshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"passThreshold","typeLabel":"number | null"},"applicabilityScope":{"oneOf":[{"type":"string","enum":["NONE","DEVELOPMENT","PRODUCTION","ALL"],"example":"PRODUCTION","description":"Which sessions get the applicability check before this metric is judged: `PRODUCTION`, `DEVELOPMENT`, `ALL` or `NONE` (no check). A session the check finds the metric does not apply to is skipped and no judge call is made. Omitted or null, it defaults to `PRODUCTION` for a metric the platform scores and `NONE` for any other. A revision keeps the parent metric's value when the check runs for both. Fixed at create: a change creates a revision. Any value but `NONE` is refused with a 400 for a metric the platform does not score. A metric that scores only `traces` is never checked, so it takes `NONE` and refuses any other value. A metric that also scores another field is checked without `traces`: on each turn's input and actual output and its other fields. A FULL_PROMPT metric with empty evaluationParams whose judge prompt reads only `traces` is stored as checked, yet the evaluator judges it without the check. A FULL_PROMPT metric whose evaluationParams list only `traces` takes NONE even when its judge prompt reads another field: list that field in evaluationParams to get the check. The check runs only where the deployment enables it.","uniqueKey":"applicabilityScope.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["NONE","DEVELOPMENT","PRODUCTION","ALL"],"example":"PRODUCTION","description":"Which sessions get the applicability check before this metric is judged: `PRODUCTION`, `DEVELOPMENT`, `ALL` or `NONE` (no check). A session the check finds the metric does not apply to is skipped and no judge call is made. Omitted or null, it defaults to `PRODUCTION` for a metric the platform scores and `NONE` for any other. A revision keeps the parent metric's value when the check runs for both. Fixed at create: a change creates a revision. Any value but `NONE` is refused with a 400 for a metric the platform does not score. A metric that scores only `traces` is never checked, so it takes `NONE` and refuses any other value. A metric that also scores another field is checked without `traces`: on each turn's input and actual output and its other fields. A FULL_PROMPT metric with empty evaluationParams whose judge prompt reads only `traces` is stored as checked, yet the evaluator judges it without the check. A FULL_PROMPT metric whose evaluationParams list only `traces` takes NONE even when its judge prompt reads another field: list that field in evaluationParams to get the check. The check runs only where the deployment enables it.","uniqueKey":"applicabilityScope.oneOf.1","typeLabel":"null"}],"uniqueKey":"applicabilityScope","typeLabel":"enum\u003cstring> | null"},"applicabilityThreshold":{"oneOf":[{"type":"number","minimum":0,"maximum":1,"example":0.7,"description":"The lowest probability, from 0 to 1, that the metric applies to a session at which it is judged. Below it, the session is skipped. Omitted or null, it defaults to 0.5, or to the parent metric's value for a revision when the check runs for both. Fixed at create: a change creates a revision. Refused with a 400 for a metric the platform does not score, and for a metric that scores only `traces`. The check runs only where the deployment enables it.","uniqueKey":"applicabilityThreshold.oneOf.0","typeLabel":"number"},{"type":"null","minimum":0,"maximum":1,"example":0.7,"description":"The lowest probability, from 0 to 1, that the metric applies to a session at which it is judged. Below it, the session is skipped. Omitted or null, it defaults to 0.5, or to the parent metric's value for a revision when the check runs for both. Fixed at create: a change creates a revision. Refused with a 400 for a metric the platform does not score, and for a metric that scores only `traces`. The check runs only where the deployment enables it.","uniqueKey":"applicabilityThreshold.oneOf.1","typeLabel":"null"}],"uniqueKey":"applicabilityThreshold","typeLabel":"number | null"},"classifierQuestion":{"oneOf":[{"type":"object","properties":{"type":{"type":"string","enum":["yes_no","scale"],"isRequired":true,"uniqueKey":"classifierQuestion.oneOf.0.type","typeLabel":"enum\u003cstring>"},"instructions":{"type":"string","maxLength":2000,"description":"The question, in English, naming at least one {{ evaluation_param }}.","isRequired":true,"uniqueKey":"classifierQuestion.oneOf.0.instructions","typeLabel":"string"},"goodAnswer":{"oneOf":[{"type":"string","enum":["yes","no"],"description":"yes_no only, and required there.","uniqueKey":"classifierQuestion.oneOf.0.goodAnswer.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["yes","no"],"description":"yes_no only, and required there.","uniqueKey":"classifierQuestion.oneOf.0.goodAnswer.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.goodAnswer","typeLabel":"enum\u003cstring> | null"},"criteria":{"oneOf":[{"type":"object","properties":{"yes":{"oneOf":[{"type":"string","maxLength":1000,"uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0.yes.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":1000,"uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0.yes.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0.yes","typeLabel":"string | null"},"no":{"oneOf":[{"type":"string","maxLength":1000,"uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0.no.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":1000,"uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0.no.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0.no","typeLabel":"string | null"}},"description":"yes_no only: what yes and no mean.","uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"yes":{"oneOf":[{"type":"string","maxLength":1000},{"type":"null","maxLength":1000}]},"no":{"oneOf":[{"type":"string","maxLength":1000},{"type":"null","maxLength":1000}]}},"description":"yes_no only: what yes and no mean.","uniqueKey":"classifierQuestion.oneOf.0.criteria.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.criteria","typeLabel":"object | null"},"levels":{"oneOf":[{"type":"array","items":{"type":"object","properties":{"description":{"type":"string","maxLength":1000,"isRequired":true,"uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.0.items.[INDEX].description","typeLabel":"string"},"score":{"oneOf":[{"type":"number","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best).","uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.0.items.[INDEX].score.oneOf.0","typeLabel":"number"},{"type":"null","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best).","uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.0.items.[INDEX].score.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.0.items.[INDEX].score","typeLabel":"number | null"}},"required":["description"],"uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.0.items.[INDEX]","typeLabel":"object"},"maxItems":10,"description":"scale only: the scored levels, worst first, with non-decreasing scores.","uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.0","typeLabel":"object[]"},{"type":"null","items":{"type":"object","properties":{"description":{"type":"string","maxLength":1000},"score":{"oneOf":[{"type":"number","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best)."},{"type":"null","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best)."}]}},"required":["description"]},"maxItems":10,"description":"scale only: the scored levels, worst first, with non-decreasing scores.","uniqueKey":"classifierQuestion.oneOf.0.levels.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.levels","typeLabel":"object[] | null"},"doesNotApply":{"oneOf":[{"type":"string","maxLength":1000,"description":"scale only: the text of an extra level that skips the evaluation when the classifier picks it.","uniqueKey":"classifierQuestion.oneOf.0.doesNotApply.oneOf.0","typeLabel":"string"},{"type":"null","maxLength":1000,"description":"scale only: the text of an extra level that skips the evaluation when the classifier picks it.","uniqueKey":"classifierQuestion.oneOf.0.doesNotApply.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion.oneOf.0.doesNotApply","typeLabel":"string | null"}},"required":["type","instructions"],"description":"CLASSIFIER only, and required there: the one question the classifier answers. evaluationParams is derived from its {{ param }} placeholders.","uniqueKey":"classifierQuestion.oneOf.0","typeLabel":"object"},{"type":"null","properties":{"type":{"type":"string","enum":["yes_no","scale"]},"instructions":{"type":"string","maxLength":2000,"description":"The question, in English, naming at least one {{ evaluation_param }}."},"goodAnswer":{"oneOf":[{"type":"string","enum":["yes","no"],"description":"yes_no only, and required there."},{"type":"null","enum":["yes","no"],"description":"yes_no only, and required there."}]},"criteria":{"oneOf":[{"type":"object","properties":{"yes":{"oneOf":[{"type":"string","maxLength":1000},{"type":"null","maxLength":1000}]},"no":{"oneOf":[{"type":"string","maxLength":1000},{"type":"null","maxLength":1000}]}},"description":"yes_no only: what yes and no mean."},{"type":"null","properties":{"yes":{"oneOf":[{"type":"string","maxLength":1000},{"type":"null","maxLength":1000}]},"no":{"oneOf":[{"type":"string","maxLength":1000},{"type":"null","maxLength":1000}]}},"description":"yes_no only: what yes and no mean."}]},"levels":{"oneOf":[{"type":"array","items":{"type":"object","properties":{"description":{"type":"string","maxLength":1000},"score":{"oneOf":[{"type":"number","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best)."},{"type":"null","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best)."}]}},"required":["description"]},"maxItems":10,"description":"scale only: the scored levels, worst first, with non-decreasing scores."},{"type":"null","items":{"type":"object","properties":{"description":{"type":"string","maxLength":1000},"score":{"oneOf":[{"type":"number","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best)."},{"type":"null","description":"From 0 to 1. Omit it on every level to space the scores evenly from 0 (worst) to 1 (best)."}]}},"required":["description"]},"maxItems":10,"description":"scale only: the scored levels, worst first, with non-decreasing scores."}]},"doesNotApply":{"oneOf":[{"type":"string","maxLength":1000,"description":"scale only: the text of an extra level that skips the evaluation when the classifier picks it."},{"type":"null","maxLength":1000,"description":"scale only: the text of an extra level that skips the evaluation when the classifier picks it."}]}},"required":["type","instructions"],"description":"CLASSIFIER only, and required there: the one question the classifier answers. evaluationParams is derived from its {{ param }} placeholders.","uniqueKey":"classifierQuestion.oneOf.1","typeLabel":"null"}],"uniqueKey":"classifierQuestion","typeLabel":"object | null"}},"required":["name"],"additionalProperties":false,"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"name":"Accuracy","source":"PARTIAL_PROMPT","evaluationParams":["input","actual_output"],"judgePrompt":"\u003cstring>","evaluatorModelName":"gpt-4.1","definition":"\u003cstring>","description":"\u003cstring>","documentationUrl":"\u003cstring>","tags":["\u003cstring>"],"areEvalParamsTop":true,"organizationId":"org_123","userGroupIds":["ug_123"],"specificationIds":["spec_123"],"judgeGenerationSettings":{"temperature":0.3,"topP":0.9,"maxOutputTokens":512,"reasoningEffort":"low"},"passThreshold":0.7,"applicabilityScope":"PRODUCTION","applicabilityThreshold":0.7,"classifierQuestion":{"instructions":"\u003cstring>","criteria":{"yes":"\u003cstring>","no":"\u003cstring>"},"levels":[{"description":"\u003cstring>","score":123}],"doesNotApply":"\u003cstring>"}}}},"exampleType":"generated"}},"exampleType":"generated"},"responses":{"bebd4c91-9e7c-4087-b179-e789b8dd5dc9":{"description":"Metric created successfully. On `Prefer: return=minimal`, or when the read after the write fails, the answer has no body.","headers":{"Location":{"schema":{"type":"string","description":"The path of the new resource"},"required":true,"description":"The path of the new resource"},"Content-Location":{"schema":{"type":"string","description":"The path of the resource in the body; absent when there is no body"},"required":false,"description":"The path of the resource in the body; absent when there is no body"},"Preference-Applied":{"schema":{"type":"string","enum":["return=minimal"],"description":"Present when the API honored `Prefer: return=minimal`"},"required":false,"description":"Present when the API honored `Prefer: return=minimal`"}},"content":{"application/json":{"schema":{"type":"object","properties":{"id":{"type":"string","example":"metric_123","description":"Metric ID.","isRequired":true,"uniqueKey":"id","typeLabel":"string"},"organizationId":{"oneOf":[{"type":"string","example":"org_123","description":"The organization of the metric. Null for a Galtea metric.","isRequired":true,"uniqueKey":"organizationId.oneOf.0","typeLabel":"string"},{"type":"null","example":"org_123","description":"The organization of the metric. Null for a Galtea metric.","isRequired":true,"uniqueKey":"organizationId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"organizationId","typeLabel":"string | null"},"userId":{"oneOf":[{"type":"string","example":"user_123","isRequired":true,"uniqueKey":"userId.oneOf.0","typeLabel":"string"},{"type":"null","example":"user_123","isRequired":true,"uniqueKey":"userId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"userId","typeLabel":"string | null"},"name":{"type":"string","example":"Accuracy","description":"Metric name, unique in its organization.","isRequired":true,"uniqueKey":"name","typeLabel":"string"},"description":{"oneOf":[{"type":"string","example":"Measures the accuracy of responses","isRequired":true,"uniqueKey":"description.oneOf.0","typeLabel":"string"},{"type":"null","example":"Measures the accuracy of responses","isRequired":true,"uniqueKey":"description.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"description","typeLabel":"string | null"},"tags":{"type":"array","items":{"type":"string","uniqueKey":"tags.items.[INDEX]","typeLabel":"string"},"example":["accuracy","quality"],"isRequired":true,"uniqueKey":"tags","typeLabel":"string[]"},"documentationUrl":{"oneOf":[{"type":"string","example":"https://docs.example.com/metrics/accuracy","isRequired":true,"uniqueKey":"documentationUrl.oneOf.0","typeLabel":"string"},{"type":"null","example":"https://docs.example.com/metrics/accuracy","isRequired":true,"uniqueKey":"documentationUrl.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"documentationUrl","typeLabel":"string | null"},"source":{"oneOf":[{"type":"string","enum":["SELF_HOSTED","FULL_PROMPT","PARTIAL_PROMPT","HUMAN_EVALUATION","GEVAL","DEEPEVAL","DETERMINISTIC","CLASSIFIER"],"example":"PARTIAL_PROMPT","description":"Evaluation method for the metric. `FULL_PROMPT` is deprecated for creation — `POST /metrics` rejects it with a 400. Use `PARTIAL_PROMPT` for new AI Evaluation metrics. The value remains in the enum because existing FULL_PROMPT metrics are still returned by reads and filters. `CLASSIFIER` is the Classifier judge, accepted only where the deployment enables it.","isRequired":true,"uniqueKey":"source.oneOf.0","typeLabel":"enum\u003cstring>"},{"type":"null","enum":["SELF_HOSTED","FULL_PROMPT","PARTIAL_PROMPT","HUMAN_EVALUATION","GEVAL","DEEPEVAL","DETERMINISTIC","CLASSIFIER"],"example":"PARTIAL_PROMPT","description":"Evaluation method for the metric. `FULL_PROMPT` is deprecated for creation — `POST /metrics` rejects it with a 400. Use `PARTIAL_PROMPT` for new AI Evaluation metrics. The value remains in the enum because existing FULL_PROMPT metrics are still returned by reads and filters. `CLASSIFIER` is the Classifier judge, accepted only where the deployment enables it.","isRequired":true,"uniqueKey":"source.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"source","typeLabel":"enum\u003cstring> | null"},"activeRevisionId":{"oneOf":[{"type":"string","readOnly":true,"example":"revision_123","description":"The revision that evaluations of this metric run. Null when no revision is active.","isRequired":true,"uniqueKey":"activeRevisionId.oneOf.0","typeLabel":"string"},{"type":"null","readOnly":true,"example":"revision_123","description":"The revision that evaluations of this metric run. Null when no revision is active.","isRequired":true,"uniqueKey":"activeRevisionId.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"activeRevisionId","typeLabel":"string | null"},"createdAt":{"type":"string","format":"date-time","isRequired":true,"uniqueKey":"createdAt","typeLabel":"string\u003cdate-time>"},"disabledAt":{"oneOf":[{"type":"string","format":"date-time","readOnly":true,"description":"The metric's own disabled date. It ignores the evaluator model of each revision: read a revision for that.","isRequired":true,"uniqueKey":"disabledAt.oneOf.0","typeLabel":"string\u003cdate-time>"},{"type":"null","format":"date-time","readOnly":true,"description":"The metric's own disabled date. It ignores the evaluator model of each revision: read a revision for that.","isRequired":true,"uniqueKey":"disabledAt.oneOf.1","typeLabel":"null"}],"isRequired":true,"uniqueKey":"disabledAt","typeLabel":"string\u003cdate-time> | null"}},"required":["id","organizationId","userId","name","description","tags","documentationUrl","source","activeRevisionId","createdAt","disabledAt"],"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"id":"metric_123","organizationId":"org_123","userId":"user_123","name":"Accuracy","description":"Measures the accuracy of responses","tags":["accuracy","quality"],"documentationUrl":"https://docs.example.com/metrics/accuracy","source":"PARTIAL_PROMPT","activeRevisionId":"revision_123","createdAt":"2023-11-07T05:31:56Z","disabledAt":"2023-11-07T05:31:56Z"}}},"exampleType":"generated"}},"exampleType":"generated"},"11e45f4c-1a11-476b-b7f1-a7b1351325f5":{"description":"Invalid request body, including an unknown field such as `parentMetricId`","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"dbeb0ad1-3dd7-414e-adb4-2271c0cb5a13":{"description":"Unauthorized","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"a8980b1d-a83f-4570-9d34-6f1ef27ea2a3":{"description":"The caller's user groups do not list metric.create","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"},"b8ecaf8d-accd-4403-a9cc-8f0674bf8753":{"description":"A user group or specification in the body is not found","content":{"application/json":{"schema":{"type":"object","properties":{"error":{"type":"string","example":"Error type","uniqueKey":"error","typeLabel":"string"},"message":{"type":"string","example":"Error message description","uniqueKey":"message","typeLabel":"string"}},"uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"error":"Error type","message":"Error message description"}}},"exampleType":"generated"}},"exampleType":"generated"}},"security":{"a3df997e-5618-4708-9bcd-88211b174123":{"bearerAuth":{"type":"http","scheme":"bearer","description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","scopes":[],"schemeName":"bearerAuth"}}},"servers":{"5b6f56cc-f97c-491d-a9e9-d0699bff83b6":{"url":"https://api.galtea.ai"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"http","scheme":"bearer","description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","scopes":[],"schemeName":"bearerAuth"},"schema":{"title":"Bearer Auth","type":"string","isRequired":true,"description":"API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (`gsk_*`) and legacy (`gsk-`) API keys are accepted, e.g. `Authorization: Bearer gsk_...` or `Authorization: Bearer gsk-...`.","format":"bearer","typeLabel":"string\u003cbearer>","deprecated":false},"schemeName":"bearerAuth","name":"Authorization"}],"title":"bearerAuth"}]},"originalFileLocation":"openapi.json"},"subdomain":"galtea","siteName":"Galtea Docs","title":"Create metric - Galtea Docs","navMaps":{"firstHrefInVersion":{"5.19":{"href":"/api-reference/metrics-v2/create-metric","matchLevel":0},"5.18":{"href":"/v5.18/api-reference/health-check","matchLevel":2},"5.17":{"href":"/v5.17/api-reference/health-check","matchLevel":2},"5.16":{"href":"/v5.16/api-reference/health-check","matchLevel":2},"5.15":{"href":"/v5.15/api-reference/health-check","matchLevel":2},"5.14":{"href":"/v5.14/api-reference/health-check","matchLevel":2},"5.13":{"href":"/v5.13/api-reference/health-check","matchLevel":2},"5.12":{"href":"/v5.12/api-reference/health-check","matchLevel":2},"5.11":{"href":"/v5.11/api-reference/health-check","matchLevel":2},"5.10":{"href":"/v5.10/introduction","matchLevel":4}},"firstHrefInLanguage":{}},"lastModified":"2026-11-18T12:31:48.227Z","originalFileLocation":"api-reference/metrics-v2/create-metric.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Create a metric with its first revision. To revise a metric, create a revision under /v2/revisions: this body refuses parentMetricId. source takes the values that POST /metrics takes. See Metrics.\">\u003cmeta data-mint-head name=\"application-name\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Create metric - Galtea Docs\">\u003cmeta data-mint-head property=\"og:description\" content=\"Create a metric with its first revision. To revise a metric, create a revision under /v2/revisions: this body refuses parentMetricId. source takes the values that POST /metrics takes. See Metrics.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Galtea Docs\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=metrics-v2\u0026amp;title=Create+metric\u0026amp;description=Create+a+metric+with+its+first+revision.+To+revise+a+metric%2C+create+a+revision+under+%60%2Fv2%2Frevisions%60%3A+this+body+refuses+%60parentMetricId%60.+%60source%60+takes+the+val\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=0abd11eba1f9734a82b784c460a65b9689e40ebeef6159044f378bdb77a13fc2\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Create metric - Galtea Docs\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Create a metric with its first revision. To revise a metric, create a revision under /v2/revisions: this body refuses parentMetricId. source takes the values that POST /metrics takes. See Metrics.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://galtea.mintlify.site/_mintlify/api/og/v2?division=metrics-v2\u0026amp;title=Create+metric\u0026amp;description=Create+a+metric+with+its+first+revision.+To+revise+a+metric%2C+create+a+revision+under+%60%2Fv2%2Frevisions%60%3A+this+body+refuses+%60parentMetricId%60.+%60source%60+takes+the+val\u0026amp;theme=fd2f90730a25c88261e3323d\u0026amp;signature=0abd11eba1f9734a82b784c460a65b9689e40ebeef6159044f378bdb77a13fc2\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/galtea/uhYCG_Ntu-v3eoIp/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Galtea Docs\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#5286FF\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/metrics-v2/create-metric.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.galtea.ai/#organization\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/galtea/t4BZ_SsOYjDJqfd8/logo/light.svg?fit=max\u0026auto=format\u0026n=t4BZ_SsOYjDJqfd8\u0026q=85\u0026s=52a5941e3fa4d5af453da96cfa8d07e5\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.galtea.ai#website\",\"name\":\"Galtea Docs\",\"url\":\"https://docs.galtea.ai\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric#webpage\",\"url\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric\",\"name\":\"Create metric\",\"description\":\"Create a metric with its first revision. To revise a metric, create a revision under /v2/revisions: this body refuses parentMetricId. source takes the values that POST /metrics takes. See Metrics.\",\"dateModified\":\"2026-11-18T12:31:48.227Z\",\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Endpoints\",\"item\":\"https://docs.galtea.ai/api-reference/health-check\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"metrics-v2\",\"item\":\"https://docs.galtea.ai/api-reference/metrics-v2/list-metrics\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Create metric\",\"item\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric#apireference\",\"headline\":\"Create metric\",\"name\":\"Create metric\",\"description\":\"Create a metric with its first revision. To revise a metric, create a revision under /v2/revisions: this body refuses parentMetricId. source takes the values that POST /metrics takes. See Metrics.\",\"url\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric\",\"mainEntityOfPage\":{\"@id\":\"https://docs.galtea.ai/api-reference/metrics-v2/create-metric#webpage\"},\"dateModified\":\"2026-11-18T12:31:48.227Z\",\"publisher\":{\"@id\":\"https://docs.galtea.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.galtea.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Galtea Docs\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Galtea Docs\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/api-reference/metrics-v2/create-metric.md","siteName":"Galtea Docs","nav":{"global":{"anchors":[{"anchor":"Blog","icon":"newspaper","href":"https://galtea.ai/blog"},{"anchor":"Changelog","icon":"list-check","href":"https://docs.galtea.ai/changelog"}]},"versions":[{"version":"5.19","default":true,"tag":"Latest","tabs":[{"tab":"Guides","pages":[{"title":"Guides","href":"/introduction"}]},{"tab":"Concepts","pages":[{"title":"Concepts","href":"/concepts/overview"}]},{"tab":"Deployment","pages":[{"title":"Deployment","href":"/deployment/executive-summary"}]},{"tab":"REST API","groups":[{"group":"Overview","pages":[{"title":"Write responses","icon":"reply","href":"/api-reference/write-responses"},{"title":"Enum values","icon":"list","href":"/api-reference/enum-values"}]},{"group":"Endpoints","pages":[{"group":"API Reference","pages":[{"title":"Health check","deprecated":null,"version":null,"openapi":"/openapi.json get /health","href":"/api-reference/health-check"},{"title":"Get minimum SDK version","deprecated":null,"version":null,"openapi":"/openapi.json get /minimum-sdk-version","href":"/api-reference/get-minimum-sdk-version"},{"title":"Build info","deprecated":null,"version":null,"openapi":"/openapi.json get /build-info","href":"/api-reference/build-info"},{"title":"Build info for every deployed service","deprecated":null,"version":null,"openapi":"/openapi.json get /build-info/services","href":"/api-reference/build-info-for-every-deployed-service"},{"title":"Platform compatibility","deprecated":null,"version":null,"openapi":"/openapi.json get /platform-compatibility","href":"/api-reference/platform-compatibility"},{"title":"Whether every deployed service can reach its dependencies","deprecated":null,"version":null,"openapi":"/openapi.json get /self-check","href":"/api-reference/whether-every-deployed-service-can-reach-its-dependencies"}]},{"group":"api-tokens","pages":[{"title":"List API tokens","deprecated":null,"version":null,"openapi":"/openapi.json get /auth/apiTokens","href":"/api-reference/api-tokens/list-api-tokens"},{"title":"Create API token","deprecated":null,"version":null,"openapi":"/openapi.json post /auth/apiTokens","href":"/api-reference/api-tokens/create-api-token"},{"title":"Revoke API token","deprecated":null,"version":null,"openapi":"/openapi.json delete /auth/apiTokens/{apiTokenId}","href":"/api-reference/api-tokens/revoke-api-token"},{"title":"Rename API token","deprecated":null,"version":null,"openapi":"/openapi.json patch /auth/apiTokens/{apiTokenId}","href":"/api-reference/api-tokens/rename-api-token"},{"title":"Regenerate API token","deprecated":null,"version":null,"openapi":"/openapi.json post /auth/apiTokens/{apiTokenId}/regenerate","href":"/api-reference/api-tokens/regenerate-api-token"}]},{"group":"auth","pages":[{"title":"Get current user","deprecated":null,"version":null,"openapi":"/openapi.json get /auth/user","href":"/api-reference/auth/get-current-user"}]},{"group":"organizations","pages":[{"title":"Get organizations","deprecated":null,"version":null,"openapi":"/openapi.json get /organizations","href":"/api-reference/organizations/get-organizations"},{"title":"Get organization by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /organizations/{id}","href":"/api-reference/organizations/get-organization-by-id"},{"title":"Update organization","deprecated":null,"version":null,"openapi":"/openapi.json patch /organizations/{id}","href":"/api-reference/organizations/update-organization"},{"title":"Get credit status","deprecated":null,"version":null,"openapi":"/openapi.json get /organizations/{id}/creditStatus","href":"/api-reference/organizations/get-credit-status"}]},{"group":"user-groups","pages":[{"title":"Get user groups","deprecated":null,"version":null,"openapi":"/openapi.json get /userGroups","href":"/api-reference/user-groups/get-user-groups"},{"title":"Create user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups","href":"/api-reference/user-groups/create-user-group"},{"title":"Link users to user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups/{id}/users","href":"/api-reference/user-groups/link-users-to-user-group"},{"title":"Unlink users from user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}/users","href":"/api-reference/user-groups/unlink-users-from-user-group"},{"title":"Delete multiple user groups","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/batch","href":"/api-reference/user-groups/delete-multiple-user-groups"},{"title":"Get user group by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /userGroups/{id}","href":"/api-reference/user-groups/get-user-group-by-id"},{"title":"Delete user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}","href":"/api-reference/user-groups/delete-user-group"},{"title":"Update user group","deprecated":null,"version":null,"openapi":"/openapi.json patch /userGroups/{id}","href":"/api-reference/user-groups/update-user-group"},{"title":"List grantable user group permissions","deprecated":null,"version":null,"openapi":"/openapi.json get /userGroups/grantablePermissions","href":"/api-reference/user-groups/list-grantable-user-group-permissions"},{"title":"Link metrics to user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups/{id}/metrics","href":"/api-reference/user-groups/link-metrics-to-user-group"},{"title":"Unlink metrics from user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}/metrics","href":"/api-reference/user-groups/unlink-metrics-from-user-group"},{"title":"Link products to user group","deprecated":null,"version":null,"openapi":"/openapi.json post /userGroups/{id}/products","href":"/api-reference/user-groups/link-products-to-user-group"},{"title":"Unlink products from user group","deprecated":null,"version":null,"openapi":"/openapi.json delete /userGroups/{id}/products","href":"/api-reference/user-groups/unlink-products-from-user-group"}]},{"group":"metrics","pages":[{"title":"Get metrics","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics","href":"/api-reference/metrics/get-metrics"},{"title":"Create metric","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics","href":"/api-reference/metrics/create-metric"},{"title":"Create multiple metrics","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/batch","href":"/api-reference/metrics/create-multiple-metrics"},{"title":"Delete multiple metrics","deprecated":null,"version":null,"openapi":"/openapi.json delete /metrics/batch","href":"/api-reference/metrics/delete-multiple-metrics"},{"title":"Get metric by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}","href":"/api-reference/metrics/get-metric-by-id"},{"title":"Delete metric","deprecated":null,"version":null,"openapi":"/openapi.json delete /metrics/{id}","href":"/api-reference/metrics/delete-metric"},{"title":"Update metric","deprecated":null,"version":null,"openapi":"/openapi.json patch /metrics/{id}","href":"/api-reference/metrics/update-metric"},{"title":"Count replay candidates per product for a metric revision","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/replay-candidate-count","href":"/api-reference/metrics/count-replay-candidates-per-product-for-a-metric-revision"},{"title":"Generate or complete metric configuration with AI","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/generate-config","href":"/api-reference/metrics/generate-or-complete-metric-configuration-with-ai"},{"title":"Preview the prompt a judge configuration produces","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/preview-prompt","href":"/api-reference/metrics/preview-the-prompt-a-judge-configuration-produces"},{"title":"Score a draft Classifier question on a sample","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/test-draft","href":"/api-reference/metrics/score-a-draft-classifier-question-on-a-sample"},{"title":"Create several Classifier metrics at once (classifier metrics only)","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/bulk","href":"/api-reference/metrics/create-several-classifier-metrics-at-once-classifier-metrics-only"},{"title":"Propose Classifier metrics for an LLM judge metric","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/classifier-conversion","href":"/api-reference/metrics/propose-classifier-metrics-for-an-llm-judge-metric"},{"title":"Export a metric revision as a document","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/export","href":"/api-reference/metrics/export-a-metric-revision-as-a-document"},{"title":"Get the analytics impact of a metric revision","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/analytics-exclusion-impact","href":"/api-reference/metrics/get-the-analytics-impact-of-a-metric-revision"},{"title":"Include or exclude a metric revision from analytics","deprecated":null,"version":null,"openapi":"/openapi.json patch /metrics/{id}/analytics-exclusion","href":"/api-reference/metrics/include-or-exclude-a-metric-revision-from-analytics"},{"title":"Get human annotation count and optimization eligibility","deprecated":null,"version":null,"openapi":"/openapi.json get /metrics/{id}/human-annotation-count","href":"/api-reference/metrics/get-human-annotation-count-and-optimization-eligibility"},{"title":"Optimize metric","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/optimize","href":"/api-reference/metrics/optimize-metric"},{"title":"Activate an optimized judge prompt","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/activate-optimization","href":"/api-reference/metrics/activate-an-optimized-judge-prompt"},{"title":"Keep the current judge prompt over an optimized candidate","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/{id}/decline-optimization","href":"/api-reference/metrics/keep-the-current-judge-prompt-over-an-optimized-candidate"},{"title":"Revise metric configuration with AI (Update With AI)","deprecated":null,"version":null,"openapi":"/openapi.json post /metrics/update-config","href":"/api-reference/metrics/revise-metric-configuration-with-ai-update-with-ai"}]},{"group":"specifications","pages":[{"title":"Get specifications","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications","href":"/api-reference/specifications/get-specifications"},{"title":"Create specification","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications","href":"/api-reference/specifications/create-specification"},{"title":"Get specification by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications/{id}","href":"/api-reference/specifications/get-specification-by-id"},{"title":"Delete specification","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/{id}","href":"/api-reference/specifications/delete-specification"},{"title":"Update specification","deprecated":null,"version":null,"openapi":"/openapi.json patch /specifications/{id}","href":"/api-reference/specifications/update-specification"},{"title":"Create multiple specifications","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/batch","href":"/api-reference/specifications/create-multiple-specifications"},{"title":"Delete multiple specifications","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/batch","href":"/api-reference/specifications/delete-multiple-specifications"},{"title":"Get linked metrics","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications/{id}/metrics","href":"/api-reference/specifications/get-linked-metrics"},{"title":"Link metrics to specification","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/{id}/metrics","href":"/api-reference/specifications/link-metrics-to-specification"},{"title":"Unlink metrics from specification","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/{id}/metrics","href":"/api-reference/specifications/unlink-metrics-from-specification"},{"title":"Get linked datasets","deprecated":null,"version":null,"openapi":"/openapi.json get /specifications/{id}/tests","href":"/api-reference/specifications/get-linked-datasets"},{"title":"Link datasets to specification","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/{id}/tests","href":"/api-reference/specifications/link-datasets-to-specification"},{"title":"Unlink datasets from specification","deprecated":null,"version":null,"openapi":"/openapi.json delete /specifications/{id}/tests","href":"/api-reference/specifications/unlink-datasets-from-specification"},{"title":"Generate specification configuration","deprecated":null,"version":null,"openapi":"/openapi.json post /specifications/generate-config","href":"/api-reference/specifications/generate-specification-configuration"}]},{"group":"models","pages":[{"title":"Get models","deprecated":null,"version":null,"openapi":"/openapi.json get /models","href":"/api-reference/models/get-models"},{"title":"Create model","deprecated":null,"version":null,"openapi":"/openapi.json post /models","href":"/api-reference/models/create-model"},{"title":"Delete multiple models","deprecated":null,"version":null,"openapi":"/openapi.json delete /models/batch","href":"/api-reference/models/delete-multiple-models"},{"title":"Get model by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /models/{id}","href":"/api-reference/models/get-model-by-id"},{"title":"Delete model","deprecated":null,"version":null,"openapi":"/openapi.json delete /models/{id}","href":"/api-reference/models/delete-model"},{"title":"Update model","deprecated":null,"version":null,"openapi":"/openapi.json patch /models/{id}","href":"/api-reference/models/update-model"}]},{"group":"products","pages":[{"title":"Get products","deprecated":null,"version":null,"openapi":"/openapi.json get /products","href":"/api-reference/products/get-products"},{"title":"Create product","deprecated":null,"version":null,"openapi":"/openapi.json post /products","href":"/api-reference/products/create-product"},{"title":"List distinct product tags","deprecated":null,"version":null,"openapi":"/openapi.json get /products/tags","href":"/api-reference/products/list-distinct-product-tags"},{"title":"Delete multiple products","deprecated":null,"version":null,"openapi":"/openapi.json delete /products/batch","href":"/api-reference/products/delete-multiple-products"},{"title":"Get product by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /products/{id}","href":"/api-reference/products/get-product-by-id"},{"title":"Delete product","deprecated":null,"version":null,"openapi":"/openapi.json delete /products/{id}","href":"/api-reference/products/delete-product"},{"title":"Update product","deprecated":null,"version":null,"openapi":"/openapi.json patch /products/{id}","href":"/api-reference/products/update-product"},{"title":"Generate product configuration using AI","deprecated":null,"version":null,"openapi":"/openapi.json post /products/generate-config","href":"/api-reference/products/generate-product-configuration-using-ai"},{"title":"Cross-check a document against an existing product's specifications","deprecated":null,"version":null,"openapi":"/openapi.json post /products/{id}/regenerate-config","href":"/api-reference/products/cross-check-a-document-against-an-existing-products-specifications"}]},{"group":"versions","pages":[{"title":"Get versions","deprecated":null,"version":null,"openapi":"/openapi.json get /versions","href":"/api-reference/versions/get-versions"},{"title":"Create version","deprecated":null,"version":null,"openapi":"/openapi.json post /versions","href":"/api-reference/versions/create-version"},{"title":"Get version by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /versions/{id}","href":"/api-reference/versions/get-version-by-id"},{"title":"Delete version","deprecated":null,"version":null,"openapi":"/openapi.json delete /versions/{id}","href":"/api-reference/versions/delete-version"},{"title":"Update version","deprecated":null,"version":null,"openapi":"/openapi.json patch /versions/{id}","href":"/api-reference/versions/update-version"},{"title":"List metrics annotated with compatibility for a version","deprecated":null,"version":null,"openapi":"/openapi.json get /versions/{id}/compatible-metrics","href":"/api-reference/versions/list-metrics-annotated-with-compatibility-for-a-version"},{"title":"Delete multiple versions","deprecated":null,"version":null,"openapi":"/openapi.json delete /versions/batch","href":"/api-reference/versions/delete-multiple-versions"},{"title":"Get or create version by facts","deprecated":null,"version":null,"openapi":"/openapi.json post /versions/get-or-create","href":"/api-reference/versions/get-or-create-version-by-facts"}]},{"group":"monitors","pages":[{"title":"Get monitor results","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{id}/results","href":"/api-reference/monitors/get-monitor-results"},{"title":"Delete multiple monitors","deprecated":null,"version":null,"openapi":"/openapi.json delete /monitors/batch","href":"/api-reference/monitors/delete-multiple-monitors"},{"title":"Get monitor by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{id}","href":"/api-reference/monitors/get-monitor-by-id"},{"title":"Delete monitor","deprecated":null,"version":null,"openapi":"/openapi.json delete /monitors/{id}","href":"/api-reference/monitors/delete-monitor"},{"title":"Update monitor","deprecated":null,"version":null,"openapi":"/openapi.json patch /monitors/{id}","href":"/api-reference/monitors/update-monitor"},{"title":"List a monitor's alert rules","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alert-rules","href":"/api-reference/monitors/list-a-monitors-alert-rules"},{"title":"Create a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules","href":"/api-reference/monitors/create-a-monitor-alert-rule"},{"title":"Get a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/api-reference/monitors/get-a-monitor-alert-rule"},{"title":"Delete a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json delete /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/api-reference/monitors/delete-a-monitor-alert-rule"},{"title":"Update a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json patch /monitors/{monitorId}/alert-rules/{alertRuleId}","href":"/api-reference/monitors/update-a-monitor-alert-rule"},{"title":"Pause a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/pause","href":"/api-reference/monitors/pause-a-monitor-alert-rule"},{"title":"Resume a monitor alert rule","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/resume","href":"/api-reference/monitors/resume-a-monitor-alert-rule"},{"title":"Regenerate an alert rule's webhook signing secret","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{monitorId}/alert-rules/{alertRuleId}/regenerate-webhook-secret","href":"/api-reference/monitors/regenerate-an-alert-rules-webhook-signing-secret"},{"title":"List a monitor's alerts","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alerts","href":"/api-reference/monitors/list-a-monitors-alerts"},{"title":"Get a monitor alert","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors/{monitorId}/alerts/{alertId}","href":"/api-reference/monitors/get-a-monitor-alert"},{"title":"Get monitors","deprecated":null,"version":null,"openapi":"/openapi.json get /monitors","href":"/api-reference/monitors/get-monitors"},{"title":"Create monitor","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors","href":"/api-reference/monitors/create-monitor"},{"title":"Preview monitor content-filter matches","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/preview","href":"/api-reference/monitors/preview-monitor-content-filter-matches"},{"title":"Pause monitor","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{id}/pause","href":"/api-reference/monitors/pause-monitor"},{"title":"Resume monitor","deprecated":null,"version":null,"openapi":"/openapi.json post /monitors/{id}/resume","href":"/api-reference/monitors/resume-monitor"}]},{"group":"endpoint-connections","pages":[{"title":"Test endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json post /endpointConnections/testConnection","href":"/api-reference/endpoint-connections/test-endpoint-connection"},{"title":"Parse a cURL command into endpoint connection fields","deprecated":null,"version":null,"openapi":"/openapi.json post /endpointConnections/parse-curl","href":"/api-reference/endpoint-connections/parse-a-curl-command-into-endpoint-connection-fields"},{"title":"Delete multiple endpoint connections","deprecated":null,"version":null,"openapi":"/openapi.json delete /endpointConnections/batch","href":"/api-reference/endpoint-connections/delete-multiple-endpoint-connections"},{"title":"Get endpoint connection by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /endpointConnections/{id}","href":"/api-reference/endpoint-connections/get-endpoint-connection-by-id"},{"title":"Delete endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json delete /endpointConnections/{id}","href":"/api-reference/endpoint-connections/delete-endpoint-connection"},{"title":"Update endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json patch /endpointConnections/{id}","href":"/api-reference/endpoint-connections/update-endpoint-connection"},{"title":"Get endpoint connections","deprecated":null,"version":null,"openapi":"/openapi.json get /endpointConnections","href":"/api-reference/endpoint-connections/get-endpoint-connections"},{"title":"Create endpoint connection","deprecated":null,"version":null,"openapi":"/openapi.json post /endpointConnections","href":"/api-reference/endpoint-connections/create-endpoint-connection"}]},{"group":"datasets","pages":[{"title":"Get dataset types used by the organization","deprecated":null,"version":null,"openapi":"/openapi.json get /tests/types","href":"/api-reference/datasets/get-dataset-types-used-by-the-organization"},{"title":"Extend a generated dataset with more cases","deprecated":null,"version":null,"openapi":"/openapi.json post /tests/{id}/extend","href":"/api-reference/datasets/extend-a-generated-dataset-with-more-cases"},{"title":"Create multiple datasets","deprecated":null,"version":null,"openapi":"/openapi.json post /tests/batch","href":"/api-reference/datasets/create-multiple-datasets"},{"title":"Delete multiple datasets","deprecated":null,"version":null,"openapi":"/openapi.json delete /tests/batch","href":"/api-reference/datasets/delete-multiple-datasets"},{"title":"Get dataset by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /tests/{id}","href":"/api-reference/datasets/get-dataset-by-id"},{"title":"Delete dataset","deprecated":null,"version":null,"openapi":"/openapi.json delete /tests/{id}","href":"/api-reference/datasets/delete-dataset"},{"title":"Update dataset","deprecated":null,"version":null,"openapi":"/openapi.json patch /tests/{id}","href":"/api-reference/datasets/update-dataset"},{"title":"Get datasets","deprecated":null,"version":null,"openapi":"/openapi.json get /tests","href":"/api-reference/datasets/get-datasets"},{"title":"Create dataset","deprecated":null,"version":null,"openapi":"/openapi.json post /tests","href":"/api-reference/datasets/create-dataset"},{"title":"Generate dataset configuration from specifications","deprecated":null,"version":null,"openapi":"/openapi.json post /tests/generate-config","href":"/api-reference/datasets/generate-dataset-configuration-from-specifications"}]},{"group":"test-cases","pages":[{"title":"Get test cases","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases","href":"/api-reference/test-cases/get-test-cases"},{"title":"Create test case","deprecated":null,"version":null,"openapi":"/openapi.json post /testCases","href":"/api-reference/test-cases/create-test-case"},{"title":"Get test case languages","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases/languages","href":"/api-reference/test-cases/get-test-case-languages"},{"title":"Export test cases as CSV","deprecated":null,"version":null,"openapi":"/openapi.json post /testCases/export","href":"/api-reference/test-cases/export-test-cases-as-csv"},{"title":"Get test case by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases/{id}","href":"/api-reference/test-cases/get-test-case-by-id"},{"title":"Delete test case","deprecated":null,"version":null,"openapi":"/openapi.json delete /testCases/{id}","href":"/api-reference/test-cases/delete-test-case"},{"title":"Update test case","deprecated":null,"version":null,"openapi":"/openapi.json patch /testCases/{id}","href":"/api-reference/test-cases/update-test-case"},{"title":"Delete multiple test cases","deprecated":null,"version":null,"openapi":"/openapi.json delete /testCases/batch","href":"/api-reference/test-cases/delete-multiple-test-cases"},{"title":"Augment test cases","deprecated":null,"version":null,"openapi":"/openapi.json post /generateFromFewShot/augment","href":"/api-reference/test-cases/augment-test-cases"},{"title":"Get augmentation task status","deprecated":null,"version":null,"openapi":"/openapi.json get /generateFromFewShot/status/{taskId}","href":"/api-reference/test-cases/get-augmentation-task-status"},{"title":"Count replay candidates per product for a test case revision","deprecated":null,"version":null,"openapi":"/openapi.json get /testCases/{id}/replay-candidate-count","href":"/api-reference/test-cases/count-replay-candidates-per-product-for-a-test-case-revision"}]},{"group":"sessions","pages":[{"title":"List metrics annotated with compatibility for a session","deprecated":null,"version":null,"openapi":"/openapi.json get /sessions/{id}/compatible-metrics","href":"/api-reference/sessions/list-metrics-annotated-with-compatibility-for-a-session"},{"title":"Get sessions","deprecated":null,"version":null,"openapi":"/openapi.json get /sessions","href":"/api-reference/sessions/get-sessions"},{"title":"Create session","deprecated":null,"version":null,"openapi":"/openapi.json post /sessions","href":"/api-reference/sessions/create-session"},{"title":"Get session by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /sessions/{id}","href":"/api-reference/sessions/get-session-by-id"},{"title":"Delete session","deprecated":null,"version":null,"openapi":"/openapi.json delete /sessions/{id}","href":"/api-reference/sessions/delete-session"},{"title":"Update session","deprecated":null,"version":null,"openapi":"/openapi.json patch /sessions/{id}","href":"/api-reference/sessions/update-session"},{"title":"Finish session","deprecated":null,"version":null,"openapi":"/openapi.json patch /sessions/{id}/finish","href":"/api-reference/sessions/finish-session"},{"title":"Delete multiple sessions","deprecated":null,"version":null,"openapi":"/openapi.json delete /sessions/batch","href":"/api-reference/sessions/delete-multiple-sessions"},{"title":"Generate next user message","deprecated":null,"version":null,"openapi":"/openapi.json post /conversationSimulator/generateNextUserMessage","href":"/api-reference/sessions/generate-next-user-message"},{"title":"Import sessions from a Langfuse trace export","deprecated":null,"version":null,"openapi":"/openapi.json post /sessions/import","href":"/api-reference/sessions/import-sessions-from-a-langfuse-trace-export"}]},{"group":"traces","pages":[{"title":"Get traces","deprecated":null,"version":null,"openapi":"/openapi.json get /inferenceResults","href":"/api-reference/traces/get-traces"},{"title":"Create trace","deprecated":null,"version":null,"openapi":"/openapi.json post /inferenceResults","href":"/api-reference/traces/create-trace"},{"title":"Get aggregated performance data","deprecated":null,"version":null,"openapi":"/openapi.json get /inferenceResults/aggregatedData","href":"/api-reference/traces/get-aggregated-performance-data"},{"title":"Get trace by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /inferenceResults/{id}","href":"/api-reference/traces/get-trace-by-id"},{"title":"Delete trace","deprecated":null,"version":null,"openapi":"/openapi.json delete /inferenceResults/{id}","href":"/api-reference/traces/delete-trace"},{"title":"Update trace","deprecated":null,"version":null,"openapi":"/openapi.json patch /inferenceResults/{id}","href":"/api-reference/traces/update-trace"},{"title":"Create traces batch","deprecated":null,"version":null,"openapi":"/openapi.json post /inferenceResults/batch","href":"/api-reference/traces/create-traces-batch"},{"title":"Delete multiple traces","deprecated":null,"version":null,"openapi":"/openapi.json delete /inferenceResults/batch","href":"/api-reference/traces/delete-multiple-traces"},{"title":"Generate traces from test cases","deprecated":null,"version":null,"openapi":"/openapi.json post /inferenceResults/generate","href":"/api-reference/traces/generate-traces-from-test-cases"}]},{"group":"spans","pages":[{"title":"Get spans","deprecated":null,"version":null,"openapi":"/openapi.json get /traces","href":"/api-reference/spans/get-spans"},{"title":"Create span","deprecated":null,"version":null,"openapi":"/openapi.json post /traces","href":"/api-reference/spans/create-span"},{"title":"Get span by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /traces/{id}","href":"/api-reference/spans/get-span-by-id"},{"title":"Delete span","deprecated":null,"version":null,"openapi":"/openapi.json delete /traces/{id}","href":"/api-reference/spans/delete-span"},{"title":"Create spans batch","deprecated":null,"version":null,"openapi":"/openapi.json post /traces/batch","href":"/api-reference/spans/create-spans-batch"},{"title":"Delete multiple spans","deprecated":null,"version":null,"openapi":"/openapi.json delete /traces/batch","href":"/api-reference/spans/delete-multiple-spans"}]},{"group":"analytics","pages":[{"title":"Get analytics data","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics","href":"/api-reference/analytics/get-analytics-data"},{"title":"Export analytics data","deprecated":null,"version":null,"openapi":"/openapi.json post /analytics/export","href":"/api-reference/analytics/export-analytics-data"},{"title":"Get analytics insights for a version","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/insights","href":"/api-reference/analytics/get-analytics-insights-for-a-version"},{"title":"Get cross-version analytics comparison insights","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/insights/comparison","href":"/api-reference/analytics/get-cross-version-analytics-comparison-insights"},{"title":"Get latency, cost and tokens per version for a product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/inference","href":"/api-reference/analytics/get-latency-cost-and-tokens-per-version-for-a-product"},{"title":"Get the average score per version and the excluded-result count for a product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/version-summary","href":"/api-reference/analytics/get-the-average-score-per-version-and-the-excluded-result-count-for-a-product"},{"title":"Get the test-case coverage per version for a product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/coverage","href":"/api-reference/analytics/get-the-test-case-coverage-per-version-for-a-product"},{"title":"Get per-version scores and the newest version, per product","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/summary","href":"/api-reference/analytics/get-per-version-scores-and-the-newest-version-per-product"},{"title":"List products with their session stats for a period","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/products","href":"/api-reference/analytics/list-products-with-their-session-stats-for-a-period"},{"title":"Get the sessions of a period summed over products","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/sessions-overview","href":"/api-reference/analytics/get-the-sessions-of-a-period-summed-over-products"},{"title":"Get the estimated cost of the sessions of a period summed over products","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/cost-overview","href":"/api-reference/analytics/get-the-estimated-cost-of-the-sessions-of-a-period-summed-over-products"},{"title":"Get the estimated cost, LLM spans and tokens of a period split by model, version or end user","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/cost-breakdown","href":"/api-reference/analytics/get-the-estimated-cost-llm-spans-and-tokens-of-a-period-split-by-model-version-or-end-user"},{"title":"List the products whose share of critical failures went up","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/changes","href":"/api-reference/analytics/list-the-products-whose-share-of-critical-failures-went-up"},{"title":"List the specifications that sessions failed in a period","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/failing-specifications","href":"/api-reference/analytics/list-the-specifications-that-sessions-failed-in-a-period"},{"title":"Get the session outcomes of a product per day, week or month","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/session-outcomes-over-time","href":"/api-reference/analytics/get-the-session-outcomes-of-a-product-per-day-week-or-month"},{"title":"Get the estimated cost per session of a product per day, week or month","deprecated":null,"version":null,"openapi":"/openapi.json get /analytics/session-cost-over-time","href":"/api-reference/analytics/get-the-estimated-cost-per-session-of-a-product-per-day-week-or-month"}]},{"group":"storage","pages":[{"title":"Generate upload presigned URL","deprecated":null,"version":null,"openapi":"/openapi.json get /storage/generate-put-presigned-url","href":"/api-reference/storage/generate-upload-presigned-url"},{"title":"Generate download presigned URL","deprecated":null,"version":null,"openapi":"/openapi.json get /storage/generate-get-presigned-url","href":"/api-reference/storage/generate-download-presigned-url"}]},{"group":"jobs","pages":[{"title":"Get job status","deprecated":null,"version":null,"openapi":"/openapi.json get /jobs/{jobId}/status","href":"/api-reference/jobs/get-job-status"},{"title":"Cancel a job","deprecated":null,"version":null,"openapi":"/openapi.json post /jobs/{jobId}/cancel","href":"/api-reference/jobs/cancel-a-job"}]},{"group":"otel","pages":[{"title":"Validate credentials for OTel ingestion","deprecated":null,"version":null,"openapi":"/openapi.json post /otel/auth","href":"/api-reference/otel/validate-credentials-for-otel-ingestion"},{"title":"Ingest OpenTelemetry spans (OTLP JSON)","deprecated":null,"version":null,"openapi":"/openapi.json post /otel/traces","href":"/api-reference/otel/ingest-opentelemetry-spans-otlp-json"}]},{"group":"phone-connections","pages":[{"title":"Get phone connections","deprecated":null,"version":null,"openapi":"/openapi.json get /phoneConnections","href":"/api-reference/phone-connections/get-phone-connections"},{"title":"Create phone connection","deprecated":null,"version":null,"openapi":"/openapi.json post /phoneConnections","href":"/api-reference/phone-connections/create-phone-connection"},{"title":"Get phone connection by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /phoneConnections/{id}","href":"/api-reference/phone-connections/get-phone-connection-by-id"},{"title":"Delete phone connection","deprecated":null,"version":null,"openapi":"/openapi.json delete /phoneConnections/{id}","href":"/api-reference/phone-connections/delete-phone-connection"},{"title":"Update phone connection","deprecated":null,"version":null,"openapi":"/openapi.json patch /phoneConnections/{id}","href":"/api-reference/phone-connections/update-phone-connection"},{"title":"Delete multiple phone connections","deprecated":null,"version":null,"openapi":"/openapi.json delete /phoneConnections/batch","href":"/api-reference/phone-connections/delete-multiple-phone-connections"}]},{"group":"web-rtc-connections","pages":[{"title":"Get WebRTC connections","deprecated":null,"version":null,"openapi":"/openapi.json get /webRtcConnections","href":"/api-reference/web-rtc-connections/get-webrtc-connections"},{"title":"Create WebRTC connection","deprecated":null,"version":null,"openapi":"/openapi.json post /webRtcConnections","href":"/api-reference/web-rtc-connections/create-webrtc-connection"},{"title":"Get WebRTC connection by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /webRtcConnections/{id}","href":"/api-reference/web-rtc-connections/get-webrtc-connection-by-id"},{"title":"Delete WebRTC connection","deprecated":null,"version":null,"openapi":"/openapi.json delete /webRtcConnections/{id}","href":"/api-reference/web-rtc-connections/delete-webrtc-connection"},{"title":"Update WebRTC connection","deprecated":null,"version":null,"openapi":"/openapi.json patch /webRtcConnections/{id}","href":"/api-reference/web-rtc-connections/update-webrtc-connection"},{"title":"Delete multiple WebRTC connections","deprecated":null,"version":null,"openapi":"/openapi.json delete /webRtcConnections/batch","href":"/api-reference/web-rtc-connections/delete-multiple-webrtc-connections"}]},{"group":"evaluations","pages":[{"title":"Get evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations","href":"/api-reference/evaluations/get-evaluations"},{"title":"Get evaluation count and last-evaluated date per product","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/summary","href":"/api-reference/evaluations/get-evaluation-count-and-last-evaluated-date-per-product"},{"title":"Get evaluation by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/{id}","href":"/api-reference/evaluations/get-evaluation-by-id"},{"title":"Delete evaluation","deprecated":null,"version":null,"openapi":"/openapi.json delete /evaluations/{id}","href":"/api-reference/evaluations/delete-evaluation"},{"title":"Create evaluations from session","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromSession","href":"/api-reference/evaluations/create-evaluations-from-session"},{"title":"Evaluate multiple sessions in one call","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromSessions","href":"/api-reference/evaluations/evaluate-multiple-sessions-in-one-call"},{"title":"Create evaluations for a single trace","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromInferenceResult","href":"/api-reference/evaluations/create-evaluations-for-a-single-trace"},{"title":"Create single-turn evaluations","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/singleTurn","href":"/api-reference/evaluations/create-single-turn-evaluations"},{"title":"Retry failed evaluations","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/retry","href":"/api-reference/evaluations/retry-failed-evaluations"},{"title":"Evaluate a version","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromVersion","href":"/api-reference/evaluations/evaluate-a-version"},{"title":"Replay evaluations onto a new metric revision","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromMetrics","href":"/api-reference/evaluations/replay-evaluations-onto-a-new-metric-revision"},{"title":"Replay evaluations onto a new test case revision","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/fromTestCases","href":"/api-reference/evaluations/replay-evaluations-onto-a-new-test-case-revision"},{"title":"Delete multiple evaluations","deprecated":null,"version":null,"openapi":"/openapi.json delete /evaluations/batch","href":"/api-reference/evaluations/delete-multiple-evaluations"},{"title":"Get pending human evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/human/pending","href":"/api-reference/evaluations/get-pending-human-evaluations"},{"title":"Get completed human evaluations","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluations/human/completed","href":"/api-reference/evaluations/get-completed-human-evaluations"},{"title":"Claim an evaluation for human review or annotation","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/claim","href":"/api-reference/evaluations/claim-an-evaluation-for-human-review-or-annotation"},{"title":"Release a claimed evaluation or annotation","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/release","href":"/api-reference/evaluations/release-a-claimed-evaluation-or-annotation"},{"title":"Submit a human evaluation or annotation score","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/submit","href":"/api-reference/evaluations/submit-a-human-evaluation-or-annotation-score"},{"title":"Edit a submitted human evaluation","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluations/{id}/edit-human","href":"/api-reference/evaluations/edit-a-submitted-human-evaluation"},{"title":"Remove a human annotation","deprecated":null,"version":null,"openapi":"/openapi.json delete /evaluations/{id}/human-annotation","href":"/api-reference/evaluations/remove-a-human-annotation"}]},{"group":"evaluator-models","pages":[{"title":"Get evaluator models","deprecated":null,"version":null,"openapi":"/openapi.json get /evaluatorModels","href":"/api-reference/evaluator-models/get-evaluator-models"},{"title":"Check judge generation settings against the model","deprecated":null,"version":null,"openapi":"/openapi.json post /evaluatorModels/test-generation-settings","href":"/api-reference/evaluator-models/check-judge-generation-settings-against-the-model"}]},{"group":"comments","pages":[{"title":"Create comment","deprecated":null,"version":null,"openapi":"/openapi.json post /comments","href":"/api-reference/comments/create-comment"},{"title":"List distinct comment labels","deprecated":null,"version":null,"openapi":"/openapi.json get /comments/tags","href":"/api-reference/comments/list-distinct-comment-labels"},{"title":"Delete comment","deprecated":null,"version":null,"openapi":"/openapi.json delete /comments/{commentId}","href":"/api-reference/comments/delete-comment"}]},{"group":"metrics-v2","pages":[{"title":"List metrics","description":"List metrics, each once, with the id of its active revision and no revision inline. The list holds the metrics of the caller's organization and the Galtea metrics. A caller limited to the products its user groups grant also sees only the metrics those products use, and the Galtea metrics. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/metrics","href":"/api-reference/metrics-v2/list-metrics"},{"title":"Create metric","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/metrics","href":"/api-reference/metrics-v2/create-metric"},{"title":"Get metric by ID","description":"Get a metric with the id of its active revision. The id is a metric id. A revision id answers 404. See [Metrics](https://docs.galtea.ai/concepts/metric).","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/metrics/{id}","href":"/api-reference/metrics-v2/get-metric-by-id"},{"title":"Delete metric","deprecated":null,"version":null,"openapi":"/openapi.json delete /v2/metrics/{id}","href":"/api-reference/metrics-v2/delete-metric"},{"title":"Update metric","deprecated":null,"version":null,"openapi":"/openapi.json patch /v2/metrics/{id}","href":"/api-reference/metrics-v2/update-metric"}]},{"group":"revisions","pages":[{"title":"List the revisions of a metric","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions","href":"/api-reference/revisions/list-the-revisions-of-a-metric"},{"title":"Create revision","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions","href":"/api-reference/revisions/create-revision"},{"title":"Get revision by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}","href":"/api-reference/revisions/get-revision-by-id"},{"title":"Rename a revision","deprecated":null,"version":null,"openapi":"/openapi.json patch /v2/revisions/{id}","href":"/api-reference/revisions/rename-a-revision"},{"title":"Export a revision as a document","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}/export","href":"/api-reference/revisions/export-a-revision-as-a-document"},{"title":"Propose Classifier metrics for an LLM judge revision","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions/{id}/classifier-conversion","href":"/api-reference/revisions/propose-classifier-metrics-for-an-llm-judge-revision"},{"title":"Count the replay candidates of a revision","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}/replay-candidate-count","href":"/api-reference/revisions/count-the-replay-candidates-of-a-revision"},{"title":"Exclude a revision from analytics","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions/{id}/exclude-from-analytics","href":"/api-reference/revisions/exclude-a-revision-from-analytics"},{"title":"Include a revision in analytics","deprecated":null,"version":null,"openapi":"/openapi.json post /v2/revisions/{id}/include-in-analytics","href":"/api-reference/revisions/include-a-revision-in-analytics"},{"title":"Get the analytics impact of a revision","deprecated":null,"version":null,"openapi":"/openapi.json get /v2/revisions/{id}/analytics-exclusion-impact","href":"/api-reference/revisions/get-the-analytics-impact-of-a-revision"}]},{"group":"runs","pages":[{"title":"Get runs","deprecated":null,"version":null,"openapi":"/openapi.json get /runs","href":"/api-reference/runs/get-runs"},{"title":"Create run","deprecated":null,"version":null,"openapi":"/openapi.json post /runs","href":"/api-reference/runs/create-run"},{"title":"Close run","deprecated":null,"version":null,"openapi":"/openapi.json post /runs/{id}/close","href":"/api-reference/runs/close-run"},{"title":"Run a run again","deprecated":null,"version":null,"openapi":"/openapi.json post /runs/{id}/relaunch","href":"/api-reference/runs/run-a-run-again"},{"title":"Cancel run","deprecated":null,"version":null,"openapi":"/openapi.json post /runs/{id}/cancel","href":"/api-reference/runs/cancel-run"},{"title":"Get run metric summary","deprecated":null,"version":null,"openapi":"/openapi.json get /runs/{id}/metric-summary","href":"/api-reference/runs/get-run-metric-summary"},{"title":"Get run by ID","deprecated":null,"version":null,"openapi":"/openapi.json get /runs/{id}","href":"/api-reference/runs/get-run-by-id"},{"title":"Delete run","deprecated":null,"version":null,"openapi":"/openapi.json delete /runs/{id}","href":"/api-reference/runs/delete-run"}]}]}]}]},{"version":"5.18","pages":[{"title":"5.18","href":"/v5.18/api-reference/health-check"}]},{"version":"5.17","pages":[{"title":"5.17","href":"/v5.17/api-reference/health-check"}]},{"version":"5.16","pages":[{"title":"5.16","href":"/v5.16/api-reference/health-check"}]},{"version":"5.15","pages":[{"title":"5.15","href":"/v5.15/api-reference/health-check"}]},{"version":"5.14","pages":[{"title":"5.14","href":"/v5.14/api-reference/health-check"}]},{"version":"5.13","pages":[{"title":"5.13","href":"/v5.13/api-reference/health-check"}]},{"version":"5.12","pages":[{"title":"5.12","href":"/v5.12/api-reference/health-check"}]},{"version":"5.11","pages":[{"title":"5.11","href":"/v5.11/api-reference/health-check"}]},{"version":"5.10","pages":[{"title":"5.10","href":"/v5.10/introduction"}]}]},"basePath":"","title":"Create metric - Galtea Docs","deploymentId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","buildId":"dpl_HhUetB7eHHDAmK9T1Teip38TgFx9","dynamics":["c2aa737661","2b790eda92","b0f84f53ff","a9bb46feb3"],"chunks":["OpenApiReferenceProvider-jJHA3WSo.js","utils-DbZn3Mjn.js","cloneDeep-CnBnaSyy.js","_Uint8Array-CMQtTgBR.js","isObject-FP1Yky1u.js","utils-Bl2DvzOJ.js","addUniqueKeysToSchema-BwOLo9p1.js","snippetPresets-BBiPpKa-.js","style-to-object-BY3JEAdk.js","v4-DIgz8zy6.js","conditional-requirements-CFM0id0Q.js","ApiExamples-C0px4Tml.js","isEqual-zAyttAAO.js","usePlaygroundInputsStore-Dell6dGw.js","shallow-0VKqkSqN.js","getApiPlaygroundDisplay-CP_ctPEB.js","CodeSnippet-5L35ic0s.js","CodeSnippets-DOXbNhJw.js","Page-DRLI_2Ue.js","getPastedJson-VhzT9m2P.js","icon-CD8_AtCO.js","MethodPill-DGgOMftG.js","DuplicateIcon-DZ6A_EtN.js","createIcon-DUl4oM5f.js","DynamicMarkdown-BGHukeRM.js","SectionHeading-ChrEUs8u.js","axios-vUo_bRtp.js","Markdown-Dj-na-_-.js","dist-C5gjFYHe.js","lib-DuNMoZ05.js","lib-B8HbPgcC.js","katex-YMM-FMeD.js","html-void-elements-mCSPHezU.js","marked.esm-CZWythHk.js","AssistantPageLink-DEBW87tT.js"]}