Function decisionCheck

decisionCheck(
    key: string,
    answer: DecisionAnswerLike | undefined,
    expected: DecisionExpected | undefined,
    opts?: {
        describe?: (v: DecisionExpected) => string;
        levels?: number;
        threshold?: number;
    },
): CheckResult
One question's check: passes when the model picked right, and carries its probability measures (brier, logLoss, confidence, correct), which a test averages and turns into a calibration error. Doesn't apply (null) when there's no right answer to compare with.
Parameters
- key: string
- answer: DecisionAnswerLike | undefined
- expected: DecisionExpected | undefined
- opts: {
      describe?: (v: DecisionExpected) => string;
      levels?: number;
      threshold?: number;
  } = {}
Returns CheckResult
- Defined in packages/core/src/decisions.ts:133