Arize Phoenix TS
    Preparing search index...

    Gate the suite on the pass rate: each run passes when passFn returns true for its annotation, and the suite passes when at least minPassRate of runs do. passFn decides what "passing" means, so any logic works — a score bar, a score range, a label match, a metadata check, etc.

    interface PassRateAcceptanceCriterion {
        annotationName: string;
        metric: "passRate";
        minPassRate: number;
        passFn: (annotation: Annotation) => boolean;
    }

    Hierarchy (View Summary)

    Index

    Properties

    annotationName: string

    Annotation name to aggregate across completed test runs.

    metric: "passRate"
    minPassRate: number

    Minimum fraction of runs (01) that must pass for the suite to pass — e.g. 0.9 requires 90% of runs to satisfy passFn, 1 requires all of them. The suite passes when passRate >= minPassRate.

    passFn: (annotation: Annotation) => boolean

    Predicate deciding whether a single run passes, given the run's last Annotation for annotationName (its score, label, explanation, metadata, …). Runs whose predicate returns true count toward the pass rate.