Skip to main content

​
Returns

Returns a list of InferenceResult objects.

​
Example

inference_result = galtea.inference_results.create_batch(
    session_id=session_id,
    conversation_turns=[
        {"role": "user", "content": "Hi"},
        {"role": "assistant", "content": "Hello!"},
    ],
)

​
Parameters

​
session_id
string
required
The session ID to log the inference results to.
​
conversation_turns
list[dict]
required
A list of dictionaries, where each dictionary represents a conversation turn with role and content keys as mandatory and an optional retrieval_context key. The role key can only have these values: user or assistant.
The retrieval_context key is optional and can be sent to our platform if you have used it when calling your AI product. For this reason, it only makes sense to send it when we have a message with role assistant.
Maximum batch size recommended: 100 turns. For longer conversations, split into multiple batches or use the individual create() method.
​
conversation_simulator_version
string
The version of Galtea’s conversation simulator used to generate the user messages. This should only be provided when logging a conversation that was generated using the simulator. This parameter helps with traceability and analytics for conversations created through Galtea’s simulation capabilities.