create() or run()), they start in PENDING status while the evaluation engine processes them. Use wait_for() to block until all evaluations have completed.
An evaluation is considered complete when its status is anything other than PENDING:
SUCCESS, FAILED, SKIPPED, PENDING_HUMAN, CANCELLED, or OUTDATED.
Usage
- By Evaluation IDs
- By Job ID
Returns
A list of Evaluation objects once all have leftPENDING status. When using evaluation_ids, results are in the same order as the input. When using job_id, no specific result ordering is guaranteed.
Parameters
The job ID returned by
run() in endpoint-connection mode. Mutually exclusive with evaluation_ids.Maximum seconds to wait before raising
TimeoutError. When using job_id, this covers both the job polling and evaluation polling phases.