The arguments for creating a classification-based evaluator
The choices to classify the example into. e.g. { "correct": 1, "incorrect": 0 }
The prompt template to use for classification
Optional
Whether OpenTelemetry is enabled on the call. Defaults to true for visibility into the evals calls.
true Copy
true
The tracer to use for the call. If not provided, the traces will get picked up by the global tracer.
The arguments for creating a classification-based evaluator