Skip to main content
Ctrl+K
🦜️🛠️ LangSmith  documentation - Home 🦜️🛠️ LangSmith  documentation - Home
  • Reference
Ctrl+K
Docs
  • GitHub
  • X / Twitter
Ctrl+K
  • Reference
Docs
  • GitHub
  • X / Twitter

Modules

  • client
  • async_client
  • evaluation
    • AsyncExperimentResults
    • ComparativeExperimentResults
    • ExperimentResultRow
    • ExperimentResults
    • Category
    • ComparisonEvaluationResult
    • DynamicComparisonRunEvaluator
    • DynamicRunEvaluator
    • EvaluationResult
    • EvaluationResults
    • FeedbackConfig
    • RunEvaluator
    • CategoricalScoreConfig
    • ContinuousScoreConfig
    • aevaluate
    • aevaluate_existing
    • async_chain_from_iterable
    • evaluate
    • evaluate_comparative
    • evaluate_existing
    • comparison_evaluator
    • run_evaluator
  • run_helpers
  • wrappers
  • _testing
  • LangSmith Python SDK
  • evaluation
  • comparison_evaluator

comparison_evaluator#

langsmith.evaluation.evaluator.comparison_evaluator(func: Callable[[Sequence[Run], Example | None], ComparisonEvaluationResult | dict | Awaitable[ComparisonEvaluationResult | dict]]) → DynamicComparisonRunEvaluator[source]#

Create a comaprison evaluator from a function.

Parameters:

func (Callable[[Sequence[Run], Example | None], ComparisonEvaluationResult | dict | Awaitable[ComparisonEvaluationResult | dict]]) –

Return type:

DynamicComparisonRunEvaluator

On this page
  • comparison_evaluator()

© Copyright 2024, LangChain Inc.