​
Get Started

Register

Register your organization into Galtea’s platform

Quickstart

Execute your first Evaluation in less than 5 minutes

​
How It Works

The typical workflow in Galtea follows these steps:

1

Create Product

Create a Product to represent your AI functionality
2

Create Version

Define a new Version of your Product with specific parameters
3

Create Test

Create a Test with Test Cases to evaluate your Product
4

Define an Evaluation

Establish an Evaluation that links the Test and the specific Version to be assessed
5

Run Evaluations

Run each Test Case against a Version with Evaluation Tasks to evaluate a specific Metric Type
6

Analyze Results

Review and compare the performance of different Versions using the built-in analytics tools
7

Iterate

Develop a new Version of your Product and repeat the process to compare the performance of the new Version with the previous ones

​
Platform Access

You can interact with Galtea through multiple channels:

Web Platform

Manage your products and access insights via the dashboard.

Python SDK

Seamlessly integrate our services using the Python SDK.

GitHub Actions

Automate your workflows by integrating with GitHub Actions.

REST API

Documentation is coming soon.

​
Core Concepts

Galtea is built around several key concepts that work together to provide comprehensive evaluation of AI products:

Product

A functionality or service being evaluated

Version

A specific iteration of a product

Test

A set of test cases for evaluating product performance

Evaluation

A link between a product version and a test that groups evaluation tasks

Metric Type

Ways to evaluate and score product performance

Model

Way to keep track of your models’ costs