Inference Result
Create Inference Result Batch
Create a batch of inference results in a session.
Returns
Returns a list of InferenceResult objects.
Example
Parameters
The session ID to log the inference results to.
A list of dictionaries, where each dictionary represents a conversation turn with role
and content
keys as mandatory and an optional retrieval_context
key.
The role
key can only have these values: user
or assistant
.
The retrieval_context
key is optional and can be sent to our platform if you have used it when calling your AI product.
For this reason, it only makes sense to send it when we have a message with role assistant
.