Interface CreateEvaluatorArgs

interface CreateEvaluatorArgs {
name: string;
optimizationDirection?: OptimizationDirection;
}

Properties

name: string

The name of the metric that the evaluator produces E.x. "correctness"

optimizationDirection?: OptimizationDirection

If present, represents the direction in which you want the metric to be optimized E.x. "MAXIMIZE" means you want the number to be higher.