Create a batch of inference results in a session.
role
and content
keys as mandatory and an optional retrieval_context
key.
The role
key can only have these values: user
or assistant
.retrieval_context
key is optional and can be sent to our platform if you have used it when calling your AI product.
For this reason, it only makes sense to send it when we have a message with role assistant
.