# Galtea Docs ## Docs - [Export analytics data](https://docs.galtea.ai/api-reference/analytics/export-analytics-data.md): Export analytics data for a product with optional filtering. See [Platform Overview](https://docs.galtea.ai/introduction). - [Get analytics data](https://docs.galtea.ai/api-reference/analytics/get-analytics-data.md): Get analytics data for a product with optional filtering. See [Platform Overview](https://docs.galtea.ai/introduction). - [Get current user](https://docs.galtea.ai/api-reference/auth/get-current-user.md): Get the currently authenticated user. See [Registration & Authentication](https://docs.galtea.ai/registration). - [Create endpoint connection](https://docs.galtea.ai/api-reference/endpoint-connections/create-endpoint-connection.md): Create a new endpoint connection. See [Endpoint Connections](https://docs.galtea.ai/concepts/product/endpoint-connection). - [Delete endpoint connection](https://docs.galtea.ai/api-reference/endpoint-connections/delete-endpoint-connection.md): Soft delete an endpoint connection. See [Endpoint Connections](https://docs.galtea.ai/concepts/product/endpoint-connection). - [Delete multiple endpoint connections](https://docs.galtea.ai/api-reference/endpoint-connections/delete-multiple-endpoint-connections.md): Soft delete multiple endpoint connections by their IDs. See [Endpoint Connections](https://docs.galtea.ai/concepts/product/endpoint-connection). - [Get endpoint connection by ID](https://docs.galtea.ai/api-reference/endpoint-connections/get-endpoint-connection-by-id.md): Get a specific endpoint connection by ID. See [Endpoint Connections](https://docs.galtea.ai/concepts/product/endpoint-connection). - [Get endpoint connections](https://docs.galtea.ai/api-reference/endpoint-connections/get-endpoint-connections.md): Get list of endpoint connections with pagination and filtering. See [Endpoint Connections](https://docs.galtea.ai/concepts/product/endpoint-connection). - [Test endpoint connection](https://docs.galtea.ai/api-reference/endpoint-connections/test-endpoint-connection.md): Test an endpoint connection by making a sample request. Can be used in two modes: (1) Without an ID — all connection fields are required (creation flow). (2) With an ID — fetches the stored connection and applies any provided fields as overrides (update flow). See [Endpoint Connections](https://docs… - [Update endpoint connection](https://docs.galtea.ai/api-reference/endpoint-connections/update-endpoint-connection.md): Update an existing endpoint connection. See [Endpoint Connections](https://docs.galtea.ai/concepts/product/endpoint-connection). - [Claim an evaluation for human review or annotation](https://docs.galtea.ai/api-reference/evaluations/claim-an-evaluation-for-human-review-or-annotation.md): Claim an evaluation to prevent concurrent editing. For HUMAN_EVALUATION metrics, enforces user group permissions (admins skip). For other metrics, works as an annotation claim open to all org members. Works on any evaluation status. Sets humanEvaluatorStartedAt timestamp. See [Evaluations](https://d… - [Create evaluations for a single inference result](https://docs.galtea.ai/api-reference/evaluations/create-evaluations-for-a-single-inference-result.md): Create evaluations for a specific turn in a conversation. This is useful for production monitoring where you want to evaluate turn-by-turn performance. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Create evaluations from session](https://docs.galtea.ai/api-reference/evaluations/create-evaluations-from-session.md): Create evaluations from a session. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Create single-turn evaluations](https://docs.galtea.ai/api-reference/evaluations/create-single-turn-evaluations.md): Create evaluations for single-turn interactions. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Delete evaluation](https://docs.galtea.ai/api-reference/evaluations/delete-evaluation.md): Soft delete an evaluation. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Delete multiple evaluations](https://docs.galtea.ai/api-reference/evaluations/delete-multiple-evaluations.md): Soft delete multiple evaluations by their IDs. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Edit a submitted human evaluation](https://docs.galtea.ai/api-reference/evaluations/edit-a-submitted-human-evaluation.md): Edit the score and reason for a previously submitted human evaluation. Only the original evaluator can edit. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Evaluate a version](https://docs.galtea.ai/api-reference/evaluations/evaluate-a-version.md): Automatically evaluates a version by resolving its product's specifications, their linked metrics, and their linked tests. Creates inference generation jobs for every test case across all linked tests. Specifications without tests or without metrics are silently skipped. See [Evaluations](https://do… - [Get completed human evaluations](https://docs.galtea.ai/api-reference/evaluations/get-completed-human-evaluations.md): Get list of human evaluations completed by the authenticated user. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Get evaluation by ID](https://docs.galtea.ai/api-reference/evaluations/get-evaluation-by-id.md): Get a specific evaluation by ID. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Get evaluations](https://docs.galtea.ai/api-reference/evaluations/get-evaluations.md): Get list of evaluations with pagination and filtering. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Get pending human evaluations](https://docs.galtea.ai/api-reference/evaluations/get-pending-human-evaluations.md): Get list of pending human evaluations that the authenticated user can evaluate based on their user groups. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Release a claimed evaluation or annotation](https://docs.galtea.ai/api-reference/evaluations/release-a-claimed-evaluation-or-annotation.md): Release a previously claimed evaluation or annotation without submitting a score. Works on any evaluation status. Clears humanEvaluatorStartedAt. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Replay evaluations onto a new metric revision](https://docs.galtea.ai/api-reference/evaluations/replay-evaluations-onto-a-new-metric-revision.md): Re-runs historical evaluations that used any metric in `metricGroupId` against the new metric revision `newMetricId`, scoped to the given products. Idempotent: any `(sessionId, inferenceResultId)` pair that already has an evaluation on `newMetricId` is skipped. - [Retry failed evaluations](https://docs.galtea.ai/api-reference/evaluations/retry-failed-evaluations.md): Retry one or more failed evaluations. Non-admin users are limited by EVALUATION_MAX_RETRIES. See [Evaluations](https://docs.galtea.ai/concepts/product/version/session/evaluation). - [Submit a human evaluation or annotation score](https://docs.galtea.ai/api-reference/evaluations/submit-a-human-evaluation-or-annotation-score.md): Submit a score and optional reason. For HUMAN_EVALUATION metrics, enforces user group permissions and updates both score sets. For PENDING_HUMAN evaluations, also sets status to SUCCESS. For other metrics, works as an annotation — writes only humanScore/humanReason/humanEvaluatorFinishedAt, leaving… - [Get evaluator models](https://docs.galtea.ai/api-reference/evaluator-models/get-evaluator-models.md): Get list of evaluator models with filtering options. See [Models](https://docs.galtea.ai/concepts/model). - [Get minimum SDK version](https://docs.galtea.ai/api-reference/get-minimum-sdk-version.md): Get minimum supported SDK version and latest published version. See [Platform Overview](https://docs.galtea.ai/introduction). - [Health check](https://docs.galtea.ai/api-reference/health-check.md): Health check endpoint to verify API is running. See [Platform Overview](https://docs.galtea.ai/introduction). - [Create inference result](https://docs.galtea.ai/api-reference/inference-results/create-inference-result.md): Create a new inference result. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Create inference results batch](https://docs.galtea.ai/api-reference/inference-results/create-inference-results-batch.md): Create multiple inference results from conversation turns. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Delete inference result](https://docs.galtea.ai/api-reference/inference-results/delete-inference-result.md): Soft delete an inference result. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Delete multiple inference results](https://docs.galtea.ai/api-reference/inference-results/delete-multiple-inference-results.md): Soft delete multiple inference results by their IDs. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Generate inference results from test cases](https://docs.galtea.ai/api-reference/inference-results/generate-inference-results-from-test-cases.md): Triggers async inference generation for specified test cases using the version's endpoint connection. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Get aggregated performance data](https://docs.galtea.ai/api-reference/inference-results/get-aggregated-performance-data.md): Get aggregated performance metrics data. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Get inference result by ID](https://docs.galtea.ai/api-reference/inference-results/get-inference-result-by-id.md): Get a specific inference result by ID. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Get inference results](https://docs.galtea.ai/api-reference/inference-results/get-inference-results.md): Get list of inference results with pagination and filtering. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Update inference result](https://docs.galtea.ai/api-reference/inference-results/update-inference-result.md): Update an existing inference result. See [Inference Results](https://docs.galtea.ai/concepts/product/version/session/inference-result). - [Get job status](https://docs.galtea.ai/api-reference/jobs/get-job-status.md): Retrieve the status of an async job (e.g., inference generation). Returns the job state, progress, result, and any error information. - [Count replay candidates per product for a metric revision](https://docs.galtea.ai/api-reference/metrics/count-replay-candidates-per-product-for-a-metric-revision.md): For each requested product, returns how many historical evaluations in this metric's group would be replayed against this revision. Any `(sessionId, inferenceResultId)` pair already evaluated with this metric is excluded. Products with no candidates return `count: 0`. - [Create metric](https://docs.galtea.ai/api-reference/metrics/create-metric.md): Create a new metric. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Create multiple metrics](https://docs.galtea.ai/api-reference/metrics/create-multiple-metrics.md): Create multiple metrics at once. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Delete metric](https://docs.galtea.ai/api-reference/metrics/delete-metric.md): Soft delete a metric. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Delete multiple metrics](https://docs.galtea.ai/api-reference/metrics/delete-multiple-metrics.md): Soft delete multiple metrics by their IDs. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Generate metric configuration from specifications](https://docs.galtea.ai/api-reference/metrics/generate-metric-configuration-from-specifications.md): Generates metric configurations using AI for the given specifications. Optionally creates metrics automatically. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Get human annotation count](https://docs.galtea.ai/api-reference/metrics/get-human-annotation-count.md): Returns the count of evaluations that have both an AI score and a human-provided score (annotation). For FULL_PROMPT/PARTIAL_PROMPT metrics this means the AI judged the evaluation and a human later reviewed it. For HUMAN_EVALUATION metrics both fields hold the same human-provided value (for analytic… - [Get metric by ID](https://docs.galtea.ai/api-reference/metrics/get-metric-by-id.md): Get a specific metric by ID. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Get metrics](https://docs.galtea.ai/api-reference/metrics/get-metrics.md): Get list of metrics with pagination and filtering. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Optimize metric](https://docs.galtea.ai/api-reference/metrics/optimize-metric.md): Creates an optimized copy of a metric by sending its human-annotated evaluations to the metrics-generator service, which uses the gap between AI and human scores to produce a better judge prompt. Only FULL_PROMPT and PARTIAL_PROMPT metrics owned by an organization can be optimized. Requires at least… - [Update metric](https://docs.galtea.ai/api-reference/metrics/update-metric.md): Update an existing metric. See [Metrics](https://docs.galtea.ai/concepts/metric). - [Create model](https://docs.galtea.ai/api-reference/models/create-model.md): Create a new model. See [Models](https://docs.galtea.ai/concepts/model). - [Delete model](https://docs.galtea.ai/api-reference/models/delete-model.md): Soft delete a model. See [Models](https://docs.galtea.ai/concepts/model). - [Delete multiple models](https://docs.galtea.ai/api-reference/models/delete-multiple-models.md): Soft delete multiple models by their IDs. See [Models](https://docs.galtea.ai/concepts/model). - [Get model by ID](https://docs.galtea.ai/api-reference/models/get-model-by-id.md): Get a specific model by ID. See [Models](https://docs.galtea.ai/concepts/model). - [Get models](https://docs.galtea.ai/api-reference/models/get-models.md): Get list of models with pagination and filtering. See [Models](https://docs.galtea.ai/concepts/model). - [Update model](https://docs.galtea.ai/api-reference/models/update-model.md): Update an existing model. See [Models](https://docs.galtea.ai/concepts/model). - [Get credit status](https://docs.galtea.ai/api-reference/organizations/get-credit-status.md): Returns the current credit status for the organization, used for the credit warning badge. See [Platform Overview](https://docs.galtea.ai/introduction). - [Get organization by ID](https://docs.galtea.ai/api-reference/organizations/get-organization-by-id.md): Get a specific organization by ID. See [Platform Overview](https://docs.galtea.ai/introduction). - [Get organizations](https://docs.galtea.ai/api-reference/organizations/get-organizations.md): Get list of organizations with pagination and filtering. See [Platform Overview](https://docs.galtea.ai/introduction). - [Create product](https://docs.galtea.ai/api-reference/products/create-product.md): Create a new product. See [Products](https://docs.galtea.ai/concepts/product). - [Delete multiple products](https://docs.galtea.ai/api-reference/products/delete-multiple-products.md): Soft delete multiple products by their IDs. See [Products](https://docs.galtea.ai/concepts/product). - [Delete product](https://docs.galtea.ai/api-reference/products/delete-product.md): Soft delete a product. See [Products](https://docs.galtea.ai/concepts/product). - [Generate product configuration using AI](https://docs.galtea.ai/api-reference/products/generate-product-configuration-using-ai.md): Uses AI to generate comprehensive product metadata and specification configurations based on a product name and user description. Optionally accepts product specification files (documents, images, audio, video, code) for detailed generation. See [Products](https://docs.galtea.ai/concepts/product). - [Get product by ID](https://docs.galtea.ai/api-reference/products/get-product-by-id.md): Get a specific product by ID. See [Products](https://docs.galtea.ai/concepts/product). - [Get products](https://docs.galtea.ai/api-reference/products/get-products.md): Get list of products with pagination and filtering options. See [Products](https://docs.galtea.ai/concepts/product). - [Update product](https://docs.galtea.ai/api-reference/products/update-product.md): Update an existing product. See [Products](https://docs.galtea.ai/concepts/product). - [Create session](https://docs.galtea.ai/api-reference/sessions/create-session.md): Create a new session. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Delete multiple sessions](https://docs.galtea.ai/api-reference/sessions/delete-multiple-sessions.md): Soft delete multiple sessions by their IDs. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Delete session](https://docs.galtea.ai/api-reference/sessions/delete-session.md): Soft delete a session. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Finish session](https://docs.galtea.ai/api-reference/sessions/finish-session.md): Marks a session as COMPLETED (stoppingReason provided) or FAILED (error provided). At least one of stoppingReason or error must be provided. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Generate next user message](https://docs.galtea.ai/api-reference/sessions/generate-next-user-message.md): Simulate the next user message in a conversation based on the provided scenario and turns. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Get session by ID](https://docs.galtea.ai/api-reference/sessions/get-session-by-id.md): Get a specific session by ID. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Get sessions](https://docs.galtea.ai/api-reference/sessions/get-sessions.md): Get list of sessions with pagination and filtering. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Update session](https://docs.galtea.ai/api-reference/sessions/update-session.md): Update an existing session. See [Sessions](https://docs.galtea.ai/concepts/product/version/session). - [Create multiple specifications](https://docs.galtea.ai/api-reference/specifications/create-multiple-specifications.md): Create multiple specifications at once. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Create specification](https://docs.galtea.ai/api-reference/specifications/create-specification.md): Create a new specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Delete multiple specifications](https://docs.galtea.ai/api-reference/specifications/delete-multiple-specifications.md): Soft delete multiple specifications by their IDs. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Delete specification](https://docs.galtea.ai/api-reference/specifications/delete-specification.md): Soft delete a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Generate specification configuration](https://docs.galtea.ai/api-reference/specifications/generate-specification-configuration.md): Uses AI to suggest the specification type, test type, and test variant for a given description. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Get linked metrics](https://docs.galtea.ai/api-reference/specifications/get-linked-metrics.md): Get all metrics linked to a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Get linked tests](https://docs.galtea.ai/api-reference/specifications/get-linked-tests.md): Get all tests linked to a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Get specification by ID](https://docs.galtea.ai/api-reference/specifications/get-specification-by-id.md): Get a specific specification by ID. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Get specifications](https://docs.galtea.ai/api-reference/specifications/get-specifications.md): Get list of specifications with pagination and filtering. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Link metrics to specification](https://docs.galtea.ai/api-reference/specifications/link-metrics-to-specification.md): Link one or more metrics to a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Link tests to specification](https://docs.galtea.ai/api-reference/specifications/link-tests-to-specification.md): Link one or more tests to a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Unlink metrics from specification](https://docs.galtea.ai/api-reference/specifications/unlink-metrics-from-specification.md): Unlink one or more metrics from a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Unlink tests from specification](https://docs.galtea.ai/api-reference/specifications/unlink-tests-from-specification.md): Unlink one or more tests from a specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Update specification](https://docs.galtea.ai/api-reference/specifications/update-specification.md): Update an existing specification. See [Specifications](https://docs.galtea.ai/concepts/product/specification). - [Generate download presigned URL](https://docs.galtea.ai/api-reference/storage/generate-download-presigned-url.md): Generate a presigned URL for downloading files from storage. See [Platform Overview](https://docs.galtea.ai/introduction). - [Generate upload presigned URL](https://docs.galtea.ai/api-reference/storage/generate-upload-presigned-url.md): Generate a presigned URL for uploading files to storage. See [Platform Overview](https://docs.galtea.ai/introduction). - [Augment test cases](https://docs.galtea.ai/api-reference/test-cases/augment-test-cases.md): Submit test cases for augmentation using few-shot learning. The API automatically selects up to 5 random test cases from the given test as few-shot examples. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Create test case](https://docs.galtea.ai/api-reference/test-cases/create-test-case.md): Create a new test case. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Delete multiple test cases](https://docs.galtea.ai/api-reference/test-cases/delete-multiple-test-cases.md): Soft delete multiple test cases by their IDs. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Delete test case](https://docs.galtea.ai/api-reference/test-cases/delete-test-case.md): Soft delete a test case. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Export test cases as CSV](https://docs.galtea.ai/api-reference/test-cases/export-test-cases-as-csv.md): Generate a CSV from the current DB state of the given test cases, upload to storage, and return a presigned download URL. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get augmentation task status](https://docs.galtea.ai/api-reference/test-cases/get-augmentation-task-status.md): Retrieve the status of an augmentation task. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get test case by ID](https://docs.galtea.ai/api-reference/test-cases/get-test-case-by-id.md): Get a specific test case by ID. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get test case languages](https://docs.galtea.ai/api-reference/test-cases/get-test-case-languages.md): Get all available languages for test cases. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get test cases](https://docs.galtea.ai/api-reference/test-cases/get-test-cases.md): Get list of test cases with pagination and filtering options. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Update test case](https://docs.galtea.ai/api-reference/test-cases/update-test-case.md): Update an existing test case. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Create multiple tests](https://docs.galtea.ai/api-reference/tests/create-multiple-tests.md): Create multiple tests at once. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Create test](https://docs.galtea.ai/api-reference/tests/create-test.md): Create a new test. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Delete multiple tests](https://docs.galtea.ai/api-reference/tests/delete-multiple-tests.md): Soft delete multiple tests by their IDs. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Delete test](https://docs.galtea.ai/api-reference/tests/delete-test.md): Soft delete a test. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Generate test configuration from specifications](https://docs.galtea.ai/api-reference/tests/generate-test-configuration-from-specifications.md): Derives test type, variant, and name from specifications (rule-based). Optionally creates tests automatically. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get test by ID](https://docs.galtea.ai/api-reference/tests/get-test-by-id.md): Get a specific test by ID. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get test types used by the organization](https://docs.galtea.ai/api-reference/tests/get-test-types-used-by-the-organization.md): Retrieves the non-repeated test types of all the products of the user's organization. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Get tests](https://docs.galtea.ai/api-reference/tests/get-tests.md): Get list of tests with pagination and filtering options. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Update test](https://docs.galtea.ai/api-reference/tests/update-test.md): Apply a partial update to an existing test. See [Tests](https://docs.galtea.ai/concepts/product/test). - [Create trace](https://docs.galtea.ai/api-reference/traces/create-trace.md): Create a new trace for a tool/function call. See [Traces](https://docs.galtea.ai/sdk/api/trace/service). - [Create traces batch](https://docs.galtea.ai/api-reference/traces/create-traces-batch.md): Create multiple traces in a single API call (transactional). See [Traces](https://docs.galtea.ai/sdk/api/trace/service). - [Delete multiple traces](https://docs.galtea.ai/api-reference/traces/delete-multiple-traces.md): Soft delete multiple traces by their IDs. See [Traces](https://docs.galtea.ai/sdk/api/trace/service). - [Delete trace](https://docs.galtea.ai/api-reference/traces/delete-trace.md): Soft delete a trace by its ID. See [Traces](https://docs.galtea.ai/sdk/api/trace/service). - [Get trace by ID](https://docs.galtea.ai/api-reference/traces/get-trace-by-id.md): Get a specific trace by its ID. See [Traces](https://docs.galtea.ai/sdk/api/trace/service). - [Get traces](https://docs.galtea.ai/api-reference/traces/get-traces.md): Get a list of traces with filtering and pagination. See [Traces](https://docs.galtea.ai/sdk/api/trace/service). - [Ingest OTLP/JSON traces](https://docs.galtea.ai/api-reference/traces/ingest-otlpjson-traces.md): Receives an OTLP/JSON trace payload from the OTel Collector and persists spans as Galtea Trace records. Authenticated via standard API key (processAccessTokenMiddleware). - [Validate credentials for OTel ingestion](https://docs.galtea.ai/api-reference/traces/validate-credentials-for-otel-ingestion.md): Validates the customer's API key and returns the user ID via x-customer-id header. Used by the Istio gateway ext-authz filter to authenticate OTel data ingestion requests. - [Create user group](https://docs.galtea.ai/api-reference/user-groups/create-user-group.md): Create a new user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Delete multiple user groups](https://docs.galtea.ai/api-reference/user-groups/delete-multiple-user-groups.md): Soft delete multiple user groups by their IDs. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Delete user group](https://docs.galtea.ai/api-reference/user-groups/delete-user-group.md): Soft delete a user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Get user group by ID](https://docs.galtea.ai/api-reference/user-groups/get-user-group-by-id.md): Get a specific user group by ID. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Get user groups](https://docs.galtea.ai/api-reference/user-groups/get-user-groups.md): Get list of user groups with pagination and filtering. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Link metrics to user group](https://docs.galtea.ai/api-reference/user-groups/link-metrics-to-user-group.md): Add metrics to a user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Link users to user group](https://docs.galtea.ai/api-reference/user-groups/link-users-to-user-group.md): Add users to a user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Unlink metrics from user group](https://docs.galtea.ai/api-reference/user-groups/unlink-metrics-from-user-group.md): Remove metrics from a user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Unlink users from user group](https://docs.galtea.ai/api-reference/user-groups/unlink-users-from-user-group.md): Remove users from a user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Update user group](https://docs.galtea.ai/api-reference/user-groups/update-user-group.md): Update an existing user group. See [User Groups](https://docs.galtea.ai/concepts/user-group). - [Create version](https://docs.galtea.ai/api-reference/versions/create-version.md): Create a new version. See [Versions](https://docs.galtea.ai/concepts/product/version). - [Delete multiple versions](https://docs.galtea.ai/api-reference/versions/delete-multiple-versions.md): Soft delete multiple versions by their IDs. See [Versions](https://docs.galtea.ai/concepts/product/version). - [Delete version](https://docs.galtea.ai/api-reference/versions/delete-version.md): Soft delete a version. See [Versions](https://docs.galtea.ai/concepts/product/version). - [Get version by ID](https://docs.galtea.ai/api-reference/versions/get-version-by-id.md): Get a specific version by ID. See [Versions](https://docs.galtea.ai/concepts/product/version). - [Get versions](https://docs.galtea.ai/api-reference/versions/get-versions.md): Get list of versions with pagination and filtering options. See [Versions](https://docs.galtea.ai/concepts/product/version). - [Update version](https://docs.galtea.ai/api-reference/versions/update-version.md): Update an existing version. See [Versions](https://docs.galtea.ai/concepts/product/version). - [Metric](https://docs.galtea.ai/concepts/metric.md): Criteria and methods for evaluating AI product performance - [AI Metric Generation](https://docs.galtea.ai/concepts/metric/ai-generation.md): Automatically generate evaluation metrics from your product specifications using AI - [Answer Relevancy](https://docs.galtea.ai/concepts/metric/answer-relevancy.md): Evaluates whether the generated answer is relevant to the user's input. - [BLEU](https://docs.galtea.ai/concepts/metric/bleu.md): Primarily used for machine translation evaluation, measuring how many n-grams (phrases of n words) in the candidate translation overlap with those in a set of reference translations. - [Contextual Precision](https://docs.galtea.ai/concepts/metric/contextual-precision.md): Evaluates whether relevant documents in the retrieval context are ranked higher than irrelevant ones. - [Contextual Recall](https://docs.galtea.ai/concepts/metric/contextual-recall.md): Assesses how comprehensively the retrieved context covers the information needed to produce the expected output. - [Contextual Relevancy](https://docs.galtea.ai/concepts/metric/contextual-relevancy.md): Measures the quality of your RAG pipeline's retriever by evaluating the overall relevance of the information presented in your retrieval_context for a given input. - [Conversation Completeness](https://docs.galtea.ai/concepts/metric/conversation-completeness.md): Evaluates whether your chatbot can guide a user to successfully complete their task across multiple turns. - [Conversation Relevancy](https://docs.galtea.ai/concepts/metric/conversation-relevancy.md): Checks if your product consistently responds in a contextually relevant way during a multi-turn conversation. - [Data Leakage](https://docs.galtea.ai/concepts/metric/data-leakage.md): Evaluates whether the LLM returns content that may include sensitive information. It also checks that the model does not reveal any data explicitly defined as an inability or that crosses established security boundaries. - [Evaluation Parameters](https://docs.galtea.ai/concepts/metric/evaluation-parameters.md): Data fields available to metric evaluators during scoring - [Evaluation Types](https://docs.galtea.ai/concepts/metric/evaluation-types.md): How metrics are scored: Self-Hosted, AI Evaluation, or Human Evaluation - [Factual Accuracy](https://docs.galtea.ai/concepts/metric/factual-accuracy.md): Evaluates whether the generated output is factually accurate and adequately addresses the user's input when compared to the reference answer. - [Faithfulness](https://docs.galtea.ai/concepts/metric/faithfulness.md): Evaluates whether the generated output aligns with the retrieved context in a RAG pipeline. - [IOU](https://docs.galtea.ai/concepts/metric/iou.md): Measures the spatial overlap between a predicted bounding box and one or more reference boxes. This metric is commonly used in object detection and layout tasks to quantify how well the predicted region aligns with the ground truth. - [Jailbreak Resilience](https://docs.galtea.ai/concepts/metric/jailbreak-resilience.md): Evaluates the AI's ability to provide a safe and appropriate refusal when faced with inputs that are malicious, harmful, or out-of-scope, based on its specific product boundaries. - [JSON Field Match](https://docs.galtea.ai/concepts/metric/json-field-match.md): Compares JSON objects field by field, checking whether all fields in the expected output exist in the actual output with matching values. Returns the fraction of expected fields that match. - [JSON Field Match (Normalized)](https://docs.galtea.ai/concepts/metric/json-field-match-normalized.md): Compares JSON objects field by field with case-insensitive and accent-insensitive string matching. Returns the fraction of expected fields that match. - [Knowledge Retention](https://docs.galtea.ai/concepts/metric/knowledge-retention.md): Checks if your product can follow a multi-turn conversation without losing information. - [METEOR](https://docs.galtea.ai/concepts/metric/meteor.md): Evaluates translation, summarization, and paraphrasing by aligning words using exact matches, stems, or synonyms, computing precision and recall. - [Misuse Resilience](https://docs.galtea.ai/concepts/metric/misuse-resilience.md): Evaluates whether the generated output is resilient to misuse and remains aligned with the product description. - [Non-Toxic](https://docs.galtea.ai/concepts/metric/non-toxic.md): Evaluates whether your product's responses are free from harmful, offensive, or toxic language. - [Resilience To Noise](https://docs.galtea.ai/concepts/metric/resilience-to-noise.md): Measures a language model's robustness to input noise such as typos, OCR/ASR errors, grammatical mistakes, and distracting content. - [Role Adherence](https://docs.galtea.ai/concepts/metric/role-adherence.md): Checks whether your chatbot stays within its defined role across the entire conversation. - [ROUGE](https://docs.galtea.ai/concepts/metric/rouge.md): Evaluates automatic summarization by measuring the longest common subsequence (LCS) that preserves the word order between candidate and reference summaries. - [Spatial Match](https://docs.galtea.ai/concepts/metric/spatial-match.md): Performs a binary evaluation of the spatial alignment between a predicted bounding box and one or more reference boxes using the best Intersection over Union (IoU) score. Returns a pass/fail signal based on a threshold, making it ideal for layout-sensitive validation tasks. - [Text Match (Deprecated)](https://docs.galtea.ai/concepts/metric/text-match.md): Determines whether the generated text matches the reference with high character-level similarity using fuzzy matching given by the [Text Similarity](/concepts/metric/text-similarity) metric. Returns a binary outcome based on a threshold, making it ideal for simple pass/fail evaluations where exact w… - [Text Similarity](https://docs.galtea.ai/concepts/metric/text-similarity.md): Quantifies the overall textual resemblance between a generated summary and a reference summary by using character-level fuzzy matching. This metric accounts for minor variations in wording or structure while still capturing how similar the two texts are at a surface level. - [Tool Correctness](https://docs.galtea.ai/concepts/metric/tool-correctness.md): Measures whether the agent called exactly the expected set of tools for a test case, penalizing missing required tools or using any unnecessary ones. - [Unbiased](https://docs.galtea.ai/concepts/metric/unbiased.md): Evaluates whether your product's output contains or reinforces harmful bias based on gender, race, or political orientation. - [URL Validation](https://docs.galtea.ai/concepts/metric/url-validation.md): Ensures that all URLs in the model’s output are safe, properly formatted, and resolvable using strict validation and SSRF protection. - [User Objective Accomplished](https://docs.galtea.ai/concepts/metric/user-objective-accomplished.md): Evaluates whether the user's stated objective was successfully and correctly achieved during the conversation. - [User Satisfaction](https://docs.galtea.ai/concepts/metric/user-satisfaction.md): Evaluates how satisfied the user was with the conversation. It is a key indicator of user experience. - [Model](https://docs.galtea.ai/concepts/model.md): A representation of a LLM Model with cost information to calculate cost estimations - [Product](https://docs.galtea.ai/concepts/product.md): A functionality or service evaluated by Galtea - [Endpoint Connection](https://docs.galtea.ai/concepts/product/endpoint-connection.md): A reusable connection to an external endpoint that defines how to connect to your AI system's API. - [Templates & Mapping](https://docs.galtea.ai/concepts/product/endpoint-connection-configuration.md): Configure how Galtea formats requests to your endpoint, extracts values from responses, sets custom headers, and handles retries. - [Structured Input Template Syntax](https://docs.galtea.ai/concepts/product/endpoint-connection-template-syntax.md): Reference for the {{ input.field_name }}, {{ context.field_name }}, {{ language_code }}, and {{ language_name }} template syntax used in endpoint connection input templates. - [Specification](https://docs.galtea.ai/concepts/product/specification.md): A testable behavioral expectation for a product - [Test](https://docs.galtea.ai/concepts/product/test.md): A set of test cases for evaluating product performance - [Accuracy Tests](https://docs.galtea.ai/concepts/product/test/accuracy-tests.md): Evaluate the accuracy and correctness of your outputs - [Behavior Tests](https://docs.galtea.ai/concepts/product/test/behavior-tests.md): Evaluate multi-turn dialogue interactions using conversation simulation with simulated users - [Test Case](https://docs.galtea.ai/concepts/product/test/case.md): A single challenge for evaluating product performance - [Conversation Simulator](https://docs.galtea.ai/concepts/product/test/case/conversation-simulator.md): Test your conversational AI by simulating realistic multi-turn user interactions. - [Data Augmentation](https://docs.galtea.ai/concepts/product/test/data-augmentation.md): Automatically expand your test datasets from a handful of examples into comprehensive, realistic test suites - [Strategies](https://docs.galtea.ai/concepts/product/test/security-strategies.md): Galtea platform uses a variety of security strategies to generate adversarial test cases and evaluate the robustness of your product. - [Security & Safety Tests](https://docs.galtea.ai/concepts/product/test/security-tests.md): Evaluate security, safety, and bias aspects of your AI products - [Threats](https://docs.galtea.ai/concepts/product/test/security-threats.md): Galtea platform tests the robustness of your product against multiple types of threats - [Version](https://docs.galtea.ai/concepts/product/version.md): A specific iteration of a product in Galtea - [Session](https://docs.galtea.ai/concepts/product/version/session.md): A group of inference results that make up a full conversation - [Evaluation](https://docs.galtea.ai/concepts/product/version/session/evaluation.md): An evaluation that assesses inference results from a session using a metric - [Inference Result](https://docs.galtea.ai/concepts/product/version/session/inference-result.md): A single turn in a conversation between a user and an AI system - [Trace](https://docs.galtea.ai/concepts/product/version/session/trace.md): Track and visualize the internal operations of your AI agent during inference - [User Group](https://docs.galtea.ai/concepts/user-group.md): Organize users and metrics into groups for human evaluation workflows - [Introduction](https://docs.galtea.ai/introduction.md): Evaluate, test, and monitor your AI products with Galtea. - [Quickstart](https://docs.galtea.ai/quickstart.md): Validate your AI product with Galtea - [Registration](https://docs.galtea.ai/registration.md): Create your Galtea account and sign in - [Create Endpoint Connection](https://docs.galtea.ai/sdk/api/endpoint-connection/create.md): Create a new endpoint connection for a product. - [Delete Endpoint Connection](https://docs.galtea.ai/sdk/api/endpoint-connection/delete.md): Delete a specific endpoint connection by its ID. - [Get Endpoint Connection](https://docs.galtea.ai/sdk/api/endpoint-connection/get.md): Retrieve a specific endpoint connection by its ID. - [Get Endpoint Connection By Name](https://docs.galtea.ai/sdk/api/endpoint-connection/get-by-name.md): Retrieve a specific endpoint connection by its name within a product. - [List Endpoint Connections](https://docs.galtea.ai/sdk/api/endpoint-connection/list.md): List endpoint connections with optional filters. - [Endpoint Connection Service](https://docs.galtea.ai/sdk/api/endpoint-connection/service.md): Endpoint Connection Service API methods in the Galtea SDK - [Test Connection](https://docs.galtea.ai/sdk/api/endpoint-connection/test-connection.md): Test an endpoint connection by making a sample request. - [Update Endpoint Connection](https://docs.galtea.ai/sdk/api/endpoint-connection/update.md): Update an existing endpoint connection. - [Create Evaluations](https://docs.galtea.ai/sdk/api/evaluation/create.md): Create evaluations for all inference results within a session, or evaluate a single inference result using specified metrics. - [Create Single-Turn Evaluation](https://docs.galtea.ai/sdk/api/evaluation/create-single-turn.md): Create an evaluation for a single-turn interaction, either from a test case or production data. - [Deleting Evaluation](https://docs.galtea.ai/sdk/api/evaluation/delete.md): Delete a specific evaluation by its ID. - [Retrieving Evaluation](https://docs.galtea.ai/sdk/api/evaluation/get.md): Retrieve a specific evaluation by its ID. - [Listing Evaluations](https://docs.galtea.ai/sdk/api/evaluation/list.md): List all evaluations associated with a specific session. - [Retrying Evaluations](https://docs.galtea.ai/sdk/api/evaluation/retry.md): Retry one or more failed evaluations. - [Run Evaluation](https://docs.galtea.ai/sdk/api/evaluation/run.md): Run an evaluation pipeline for a version, using either your deployed endpoint or a local agent. - [Evaluation Service](https://docs.galtea.ai/sdk/api/evaluation/service.md): Evaluation Service API methods in the Galtea SDK - [Waiting for Evaluations](https://docs.galtea.ai/sdk/api/evaluation/wait-for.md): Poll evaluations until they leave PENDING status, then return the completed results. - [Galtea Client](https://docs.galtea.ai/sdk/api/galtea.md): Main entry point for the Galtea SDK - [Create Inference Result](https://docs.galtea.ai/sdk/api/inference-result/create.md): Create a new inference result log in a session. - [Create and Evaluate Inference Result](https://docs.galtea.ai/sdk/api/inference-result/create-and-evaluate.md): Create an inference result and immediately evaluate it against specified metrics in a single call. - [Create Inference Result Batch](https://docs.galtea.ai/sdk/api/inference-result/create-batch.md): Create a batch of inference results in a session. - [Delete Inference Result](https://docs.galtea.ai/sdk/api/inference-result/delete.md): Delete an inference result log by its ID. - [Generate Inference Result](https://docs.galtea.ai/sdk/api/inference-result/generate.md): Execute an agent and automatically capture traces, latency, and metadata - [Get Inference Result](https://docs.galtea.ai/sdk/api/inference-result/get.md): Retrieve an inference result log by its ID. - [List Inference Results](https://docs.galtea.ai/sdk/api/inference-result/list.md): List inference result logs for a session. - [Inference Result Service](https://docs.galtea.ai/sdk/api/inference-result/service.md): Inference Result Service API methods in the Galtea SDK - [Update Inference Result](https://docs.galtea.ai/sdk/api/inference-result/update.md): Update an existing inference result with agent output and metadata - [CallbackHandler](https://docs.galtea.ai/sdk/api/langfuse/callback-handler.md): Drop-in replacement for Langfuse's langchain.CallbackHandler with Galtea trace linking. - [observe](https://docs.galtea.ai/sdk/api/langfuse/observe.md): Drop-in replacement for Langfuse's @observe decorator with Galtea trace linking. - [Langfuse Integration](https://docs.galtea.ai/sdk/api/langfuse/service.md): Langfuse integration API reference for the Galtea SDK - [start_as_current_observation](https://docs.galtea.ai/sdk/api/langfuse/start-as-current-observation.md): Drop-in replacement for Langfuse's start_as_current_observation context manager with Galtea trace linking. - [Create Metric](https://docs.galtea.ai/sdk/api/metric/create.md): Create a metric for evaluating your products. - [Deleting Metric](https://docs.galtea.ai/sdk/api/metric/delete.md): Delete a specific metric by its ID. - [Retrieving Metric](https://docs.galtea.ai/sdk/api/metric/get.md): Retrieve a specific metric by its ID. - [Retrieving Metric By Name](https://docs.galtea.ai/sdk/api/metric/get-by-name.md): Retrieve a specific metric by its name. - [Listing Metrics](https://docs.galtea.ai/sdk/api/metric/list.md): List all metrics. - [Metrics Service](https://docs.galtea.ai/sdk/api/metric/service.md): Metrics Service API methods in the Galtea SDK - [Deleting Product](https://docs.galtea.ai/sdk/api/product/delete.md): Delete a specific product by its ID. - [Retrieving Product](https://docs.galtea.ai/sdk/api/product/get.md): Retrieve a specific product by its ID. - [Retrieving Product By Name](https://docs.galtea.ai/sdk/api/product/get-by-name.md): Retrieve a specific product by its name. - [Listing Products](https://docs.galtea.ai/sdk/api/product/list.md): This method allows you to list many products. - [Product Service](https://docs.galtea.ai/sdk/api/product/service.md): Product Service API methods in the Galtea SDK - [Create Session](https://docs.galtea.ai/sdk/api/session/create.md): Create a new session to group inference results. - [Delete Session](https://docs.galtea.ai/sdk/api/session/delete.md): Delete a specific session and all its associated data. - [Get Session](https://docs.galtea.ai/sdk/api/session/get.md): Retrieve a specific session by its ID. - [Get Session By Custom ID](https://docs.galtea.ai/sdk/api/session/get-by-custom-id.md): Retrieve a specific session by its Custom ID. - [Get Or Create Session](https://docs.galtea.ai/sdk/api/session/get-or-create.md): Get an existing session or create a new one if it doesn't exist. - [List Sessions](https://docs.galtea.ai/sdk/api/session/list.md): List sessions with optional filtering. - [Session Service](https://docs.galtea.ai/sdk/api/session/service.md): Session Service API methods in the Galtea SDK - [Update Session](https://docs.galtea.ai/sdk/api/session/update.md): Update an existing session with metadata and status information - [Simulator Service](https://docs.galtea.ai/sdk/api/simulator/service.md): Simulator Service API methods in the Galtea SDK for running multi-turn conversation simulations. - [Simulate Conversation](https://docs.galtea.ai/sdk/api/simulator/simulate.md): Run a full conversation simulation between your agent and a simulated user using the Galtea SDK. - [Create Specification](https://docs.galtea.ai/sdk/api/specification/create.md): Create a specification for a product. - [Deleting Specification](https://docs.galtea.ai/sdk/api/specification/delete.md): Delete a specific specification by its ID. - [Retrieving Specification](https://docs.galtea.ai/sdk/api/specification/get.md): Retrieve a specific specification by its ID. - [Get Linked Metrics](https://docs.galtea.ai/sdk/api/specification/get-metrics.md): Get all metrics linked to a specification. - [Link Metrics](https://docs.galtea.ai/sdk/api/specification/link-metrics.md): Link metrics to a specification. - [Listing Specifications](https://docs.galtea.ai/sdk/api/specification/list.md): List specifications with optional filters. - [Specifications Service](https://docs.galtea.ai/sdk/api/specification/service.md): Specifications Service API methods in the Galtea SDK - [Unlink Metrics](https://docs.galtea.ai/sdk/api/specification/unlink-metrics.md): Unlink metrics from a specification. - [Create Test Case](https://docs.galtea.ai/sdk/api/test-case/create.md): Create a test case for your test. - [Deleting Test Case](https://docs.galtea.ai/sdk/api/test-case/delete.md): Delete a specific test case by its ID. - [Retrieving Test Case](https://docs.galtea.ai/sdk/api/test-case/get.md): Retrieve a specific test case by its ID. - [Listing Test Cases](https://docs.galtea.ai/sdk/api/test-case/list.md): List all test cases associated with a specific test. - [Test Case Service](https://docs.galtea.ai/sdk/api/test-case/service.md): Test Case Service API methods in the Galtea SDK - [Create Test](https://docs.galtea.ai/sdk/api/test/create.md): Create a test for your product. - [Deleting Test](https://docs.galtea.ai/sdk/api/test/delete.md): Delete a specific test by its ID. - [Downloading Test](https://docs.galtea.ai/sdk/api/test/download.md): Download the file associated with a specific test. - [Retrieving Test](https://docs.galtea.ai/sdk/api/test/get.md): Retrieve a specific test by its ID. - [Retrieving Test By Name](https://docs.galtea.ai/sdk/api/test/get-by-name.md): Retrieve a specific test by its name. - [Listing Tests](https://docs.galtea.ai/sdk/api/test/list.md): List all tests associated with a specific product. - [Test Service](https://docs.galtea.ai/sdk/api/test/service.md): Test Service API methods in the Galtea SDK - [Update Test](https://docs.galtea.ai/sdk/api/test/update.md): Update the name or metadata of an existing test - [Clear Context](https://docs.galtea.ai/sdk/api/trace/clear-context.md): Clear a previously attached context and optionally flush pending traces. - [Create Trace](https://docs.galtea.ai/sdk/api/trace/create.md): Create a single trace directly via the API. - [Create Trace Batch](https://docs.galtea.ai/sdk/api/trace/create-batch.md): Create multiple traces in a single API call. - [Delete Trace](https://docs.galtea.ai/sdk/api/trace/delete.md): Delete a trace by ID. - [Get Trace](https://docs.galtea.ai/sdk/api/trace/get.md): Retrieve a single trace by ID. - [List Traces](https://docs.galtea.ai/sdk/api/trace/list.md): Retrieve traces for an inference result. - [Trace Service](https://docs.galtea.ai/sdk/api/trace/service.md): Trace Service API methods in the Galtea SDK - [Set Context](https://docs.galtea.ai/sdk/api/trace/set-context.md): Set Galtea context values for trace correlation. - [start_trace](https://docs.galtea.ai/sdk/api/trace/start-trace.md): Context manager for creating traces with fine-grained control. - [@trace Decorator](https://docs.galtea.ai/sdk/api/trace/trace-decorator.md): Automatically trace function calls with OpenTelemetry. - [Create User Group](https://docs.galtea.ai/sdk/api/user-group/create.md): Create a new user group. - [Delete User Group](https://docs.galtea.ai/sdk/api/user-group/delete.md): Delete a user group by its ID. - [Retrieving User Group](https://docs.galtea.ai/sdk/api/user-group/get.md): Get a user group by its ID. - [Retrieving User Group by Name](https://docs.galtea.ai/sdk/api/user-group/get-by-name.md): Get a user group by its name. - [Link Metrics](https://docs.galtea.ai/sdk/api/user-group/link-metrics.md): Link metrics to a user group. - [Link Users](https://docs.galtea.ai/sdk/api/user-group/link-users.md): Link users to a user group. - [Listing User Groups](https://docs.galtea.ai/sdk/api/user-group/list.md): List user groups with optional filters. - [User Groups Service](https://docs.galtea.ai/sdk/api/user-group/service.md): User Groups Service API methods in the Galtea SDK - [Unlink Metrics](https://docs.galtea.ai/sdk/api/user-group/unlink-metrics.md): Remove metrics from a user group. - [Unlink Users](https://docs.galtea.ai/sdk/api/user-group/unlink-users.md): Remove users from a user group. - [Update User Group](https://docs.galtea.ai/sdk/api/user-group/update.md): Update an existing user group. - [Create Version](https://docs.galtea.ai/sdk/api/version/create.md): Create a version for your product. - [Deleting Version](https://docs.galtea.ai/sdk/api/version/delete.md): Delete a specific version by its ID. - [Retrieving Version](https://docs.galtea.ai/sdk/api/version/get.md): Retrieve a specific version by its ID. - [Retrieving Version By Name](https://docs.galtea.ai/sdk/api/version/get-by-name.md): Retrieve a specific version by its name. - [Listing Versions](https://docs.galtea.ai/sdk/api/version/list.md): List all versions associated with a specific product. - [Version Service](https://docs.galtea.ai/sdk/api/version/service.md): Version Service API methods in the Galtea SDK - [Installation](https://docs.galtea.ai/sdk/installation.md): Learn how to install the SDK and set up your environment - [Agent Skill](https://docs.galtea.ai/sdk/integrations/agent-skill.md): Install the Galtea Agent Skill so Claude Code, Cursor, and other AI coding assistants can drive Galtea on your behalf. - [GitHub Actions](https://docs.galtea.ai/sdk/integrations/github-actions.md): Learn how to integrate Galtea's evaluation capabilities into your GitHub Actions workflow - [Langfuse Integration Guide](https://docs.galtea.ai/sdk/integrations/langfuse/integration-guide.md): What changes when you add Galtea evaluation to your Langfuse-instrumented app - [Langfuse Integration](https://docs.galtea.ai/sdk/integrations/langfuse/overview.md): Send your Langfuse traces to Galtea for evaluation — swap one import, zero extra config - [Create a Custom Test](https://docs.galtea.ai/sdk/tutorials/create-test.md): Learn how to create and upload custom tests using the SDK - [Direct Inferences and Evaluations from the Platform](https://docs.galtea.ai/sdk/tutorials/direct-inferences-and-evaluations-from-platform.md): Learn how to configure Endpoint Connections to run inferences and evaluations directly from the Galtea Dashboard, without writing any SDK code. - [Evaluate with Custom Metrics](https://docs.galtea.ai/sdk/tutorials/evaluate-with-custom-metrics.md): Learn how to run evaluations with your own custom, self-hosted metrics. - [Evaluating Conversations](https://docs.galtea.ai/sdk/tutorials/evaluating-conversations.md): Learn how to evaluate multi-turn conversations using Galtea's session-based workflow across test-based, past conversations, and production monitoring. - [How to create your judge prompt?](https://docs.galtea.ai/sdk/tutorials/how-to-create-your-llm-as-a-judge-prompt.md): A practical guide for writing LLM-as-a-judge prompts: define objective evaluation criteria, unambiguous scoring rubrics, and machine-friendly outputs. - [How to evaluate your agentic system?](https://docs.galtea.ai/sdk/tutorials/how-to-evaluate-your-agentic-system.md): A practical guide for evaluating your agentic system: use Galtea's tracing feature to capture your agent's traces and then define your specific scope of interest by creating a custom metric. - [Human Evaluation](https://docs.galtea.ai/sdk/tutorials/human-evaluation.md): Set up user groups, create human evaluation metrics, and let your team manually review and score AI outputs - [Monitor Production Responses](https://docs.galtea.ai/sdk/tutorials/monitor-production-responses-to-user-queries.md): Learn how to log and evaluate user queries from your production environment. - [Run Test-Based Evaluations](https://docs.galtea.ai/sdk/tutorials/run-test-based-evaluations.md): Learn how to run evaluations for a single-turn, test-based workflow. - [Simulating User Conversations](https://docs.galtea.ai/sdk/tutorials/simulating-conversations.md): Learn how to use Galtea's Conversation Simulator to test your AI with simulated multi-turn conversations. - [Specification-Driven Evaluations](https://docs.galtea.ai/sdk/tutorials/specification-driven-evaluations.md): Define what your product should do, generate metrics from specs, and create tests — all driven by specifications - [Tracing Agent Operations](https://docs.galtea.ai/sdk/tutorials/tracing-agent-operations.md): Learn how to capture and analyze the internal operations of your AI agent - [Writing Effective Specifications](https://docs.galtea.ai/sdk/tutorials/writing-specifications.md): Learn how to write clear specification descriptions that power AI-generated tests and metrics. - [Usage](https://docs.galtea.ai/sdk/usage.md): Learn how to use the SDK in your codebases ## OpenAPI Specs - [openapi](https://api.galtea.ai/openapi.json) ## Optional - [Blog](https://galtea.ai/blog) - [Changelog](https://docs.galtea.ai/changelog)