Returns
Returns an InferenceResult object.Example
Parameters
The session ID to log the inference result to.
The input text/prompt.
The generated output/response.
Context retrieved for RAG systems.
Latency in milliseconds.
Token usage information (e.g.,
{"input_tokens": 10, "output_tokens": 5}
).Cost information (e.g.,
{"cost_per_input_token": 0.0001}
).