Skip to main content
A User Group organizes users and metrics within an organization to streamline human evaluation workflows.

​
How It Works

User Groups serve two key purposes:
  1. Assigning evaluators: Group users who should review and annotate AI outputs for specific metrics.
  2. Scoping metrics: Link metrics to groups so that only users in those groups see pending evaluations for those metrics.
When a Human Evaluation metric is linked to a user group, only users in that group will see pending evaluations for that metric in the Human Evaluations page of the dashboard.

​
Properties

​
id
string
Unique identifier for the user group.
​
organization_id
string
The organization this group belongs to.
​
name
string
required
Name of the user group.
​
type
string
required
Type of user group. Currently only EVALUATOR is supported.
​
description
string
Description of the group’s purpose.
​
user_ids
list[string]
IDs of users in this group.
​
metric_ids
list[string]
IDs of metrics linked to this group.

​
Managing User Groups

User groups can be managed in two places:
  • Dashboard: Navigate to an organization’s Groups tab to create, edit, and delete groups. From metric and user detail pages, you can also assign and unassign groups.
  • SDK: Use the galtea.user_groups service for programmatic management.