Skip to main content

​
What is a User Group?

A User Group organizes users, metrics, and products within an organization to streamline human evaluation workflows. User Groups serve three key purposes:
  1. Assigning evaluators: Group users who should review and annotate AI outputs for specific metrics.
  2. Scoping metrics: Link metrics to groups so that only users in those groups see pending evaluations for those metrics.
  3. Linking products: Link products to a group, or mark a group as linked to all products of the organization, current and future. A READER or HUMAN_EVALUATOR sees the union of the products that all its groups link. When one of its groups links all products, it sees every product, including a product that no other group links. A READER or HUMAN_EVALUATOR in no group sees no product. Unless one of its groups links all products, a READER or HUMAN_EVALUATOR sees only the metrics that its products evaluate, link to a specification, or monitor. OWNER, ADMIN and MEMBER users see every product and every metric of the organization, whatever their groups.
A Human Evaluation metric is routed strictly: only users in a group linked to that metric see its pending evaluations in the Human Evaluations page of the dashboard. A READER or HUMAN_EVALUATOR also sees only the evaluations of the products their groups grant. A metric with no linked group reaches nobody, and its metric page shows a warning. A new organization gets an empty “all products” group. Organizations created before this feature also got this group, filled with their READER and HUMAN_EVALUATOR users. More than one group can be linked to all products.

​
Managing User Groups

Only an OWNER or ADMIN may create, edit, or delete a user group, or change its users or products. A MEMBER can read every group of the organization. A MEMBER can also link or unlink a group of the organization to a metric that the MEMBER may edit. User groups can be managed in two places:
  • Dashboard: Navigate to an organization’s Groups tab to create, edit, and delete groups. The create and edit forms set the group’s products, or All products. In a group’s Products tab, an OWNER or ADMIN links products and unlinks the selected ones. While All products is on, the tab shows only a note. The group keeps its stored links, and they apply again when All products is turned off. The edit form shows them. In the create form, turning on All products clears the products that you picked. From the user detail page, an OWNER or ADMIN can assign and unassign groups. When an OWNER or ADMIN invites a READER or HUMAN_EVALUATOR, the invite form asks for their groups and warns before it sends an invitation with no group. From the metric detail page, any user who may edit the metric can assign and unassign groups.
  • SDK: Use the galtea.user_groups service for programmatic management. See the Human Evaluation tutorial for a step-by-step guide.

​
SDK Integration

User Group SDK API

Create, list, update, and delete user groups programmatically. Link and unlink users, metrics, and products.

​
User Group Properties

​
string
Unique identifier for the user group.
​
string
The organization this group belongs to.
​
string
required
Name of the user group.
​
string
required
Type of user group. Currently only EVALUATOR is supported.
​
string
Description of the group’s purpose.
​
list[string]
IDs of users in this group.
​
list[string]
IDs of metrics linked to this group. A READER or HUMAN_EVALUATOR gets only the IDs of the metrics it can see.
​
list[string]
IDs of products linked to this group. The products a group links are the only products its READER and HUMAN_EVALUATOR users can see. A READER or HUMAN_EVALUATOR gets only the IDs of the products it can see, in every group.
​
boolean
When true, the group is linked to every product of the organization, current and future, regardless of product_ids. A READER or HUMAN_EVALUATOR in the group then sees every product.

Concepts overview

How Galtea’s concepts connect — diagram + per-entity quick reference.

Human Evaluation Tutorial

Step-by-step guide to the full annotation workflow with screenshots.

User Group SDK API

Programmatic management of user groups.