Inference Result
Create Inference Result
Create a new inference result log in a session.
Returns
Returns an InferenceResult object.
Example
Parameters
The session ID to log the inference result to.
The input text/prompt.
The generated output/response.
Context retrieved for RAG systems.
Latency in milliseconds.
Token usage information (e.g., {"input_tokens": 10, "output_tokens": 5}).
Cost information (e.g., {"cost_per_input_token": 0.0001}).