Evalkeeper
    Preparing search index...

    Type Alias Comparison

    Two tests compared case by case: the verdict, the difference and its range, the cases the challenger fixed and broke, and each check's pass rates.

    type Comparison = {
        avgMs: { challenger: number | null; champion: number | null };
        broke: string[];
        byCheck: Record<string, { challenger: Rate; champion: Rate }>;
        cost: { challenger: number | null; champion: number | null };
        fixed: string[];
        high: number;
        low: number;
        mean: number;
        n: number;
        verdict: Verdict;
    }
    Index
    avgMs: { challenger: number | null; champion: number | null }
    broke: string[]

    Passed every time on the champion, not on the challenger.

    byCheck: Record<string, { challenger: Rate; champion: Rate }>
    cost: { challenger: number | null; champion: number | null }

    Per output, called (not reused).

    fixed: string[]

    Passed every time on the challenger, not on the champion.

    high: number
    low: number
    mean: number

    Challenger minus champion, in pass share (−1 to 1).

    n: number

    Cases both runs have.

    verdict: Verdict