Get human annotation count and optimization eligibility
Returns the optimization-eligibility snapshot for a metric.
count is the number of evaluations that have both an AI score and a
human-provided score (annotation). For FULL_PROMPT/PARTIAL_PROMPT metrics
this means the AI judged the evaluation and a human later reviewed it.
For HUMAN_EVALUATION metrics both fields hold the same human-provided
value (for analytics compatibility).
disagreementCount is the subset of count where the human score differs
from the AI score: these are the rows the optimizer learns from.
minAnnotations and minDisagreements are the api-enforced thresholds
(mirrored from the metrics-generator hard thresholds). Optimize is rejected
early unless count >= minAnnotations AND disagreementCount >= minDisagreements.
Documentation Index
Fetch the complete documentation index at: https://docs.galtea.ai/llms.txt
Use this file to discover all available pages before exploring further.
Authorizations
API key authorization. Pass your API key in the Authorization header as a Bearer token. Both new (gsk_*) and legacy (gsk-) API keys are accepted, e.g. Authorization: Bearer gsk_... or Authorization: Bearer gsk-....
Path Parameters
Metric ID
Response
Annotation/disagreement counts and thresholds retrieved successfully
Evaluations with both an AI score and a human score.
Subset of count where the human score differs from the AI score.
Minimum annotations required to optimize this metric.
Minimum disagreements required to optimize this metric.