ComparativeExperimentResults#

class langsmith.evaluation._runner.ComparativeExperimentResults(results: dict, examples: Dict[UUID, Example] | None = None)[source]#

Represents the results of an evaluate_comparative() call.

This class provides an iterator interface to iterate over the experiment results as they become available. It also provides methods to access the experiment name, the number of results, and to wait for the results to be processed.

Parameters:

  • results (dict) –

  • examples (Optional[Dict[uuid.UUID, schemas.Example]]) –

experiment_name() → str#

Returns the name of the experiment.

wait() → None#

Waits for the experiment data to be processed.

Methods

__init__(results[, examples])

__init__(results: dict, examples: Dict[UUID, Example] | None = None)[source]#
Parameters:

  • results (dict) –

  • examples (Dict[UUID, Example] | None) –