ReadonlychoicesThe choices to classify the example into
ReadonlyevaluatorOptional ReadonlyinputReadonlykindThe kind of the evaluation. Also known as the "kind" of evaluator.
ReadonlymodelThe model to use for classification
ReadonlynameThe name of the evaluator / the metric that it measures
Optional ReadonlyoptimizationThe direction to optimize the numeric evaluation score E.x. "MAXIMIZE" means that the higher the score, the better the evaluation
ReadonlypromptOptional ReadonlytelemetryList out the prompt template variables needed to perform evaluation
Binds the input mapping to the evaluator. It makes a a copy of the evaluator and returns it.
The function that evaluates the example
An LLM evaluator that performs evaluation via classification