Evalkeeper
    Preparing search index...

    Function disagreements

    • The cases two tests graded differently, on the cases they share: a different score, different checks failed, or an answer on one side and none on the other. Cases the challenger broke come first, then fixed, then the rest, each in case order. Use it to read where two models disagree: next to compareRuns, which says by how much.

      Parameters

      • champion: RunOutput[]

        The answers of the test in place (usually the live model's).

      • challenger: RunOutput[]

        The answers of the test it's compared with.

      Returns Disagreement[]