EvaluatorParams: {
    expected?: Example["output"];
    input: Example["input"];
    metadata?: Record<string, unknown>;
    output: TaskOutput;
}

Type declaration

  • Optionalexpected?: Example["output"]

    The expected or reference output of the Dataset Example

  • input: Example["input"]

    The input field of the Dataset Example

  • Optionalmetadata?: Record<string, unknown>

    Metadata associated with the Dataset Example

  • output: TaskOutput

    The output of the task