Evalkeeper
    Preparing search index...

    Function weeklySummary

    • What the last weekly check found, from every suite's tests.

      Parameters

      • args: {
            cases?: CaseRecord[];
            models: ModelCatalog;
            routes: Record<string, { fallbackModel: string | null; model: string }>;
            runs: RunRecord[];
            suites: { key: string; label: string; operation: string }[];
            thumbs?: ThumbsSummary[];
            today?: Date;
        }
        • Optionalcases?: CaseRecord[]

          Every suite's cases (store.listCases), to count the drafts from activity. Leave out to skip the count.

        • models: ModelCatalog
        • routes: Record<string, { fallbackModel: string | null; model: string }>

          Each operation's live and fallback model.

        • runs: RunRecord[]

          Every suite's tests, newest first or not.

        • suites: { key: string; label: string; operation: string }[]
        • Optionalthumbs?: ThumbsSummary[]

          From thumbsSummary over the last week; only flagged ones are shown.

        • Optionaltoday?: Date

      Returns WeeklySummary

      const runs = (await Promise.all(SUITES.map((s) => store.listRuns(s.key, { limit: 50 })))).flat();
      const weekly = weeklySummary({ runs, suites: SUITES, routes, models: MODELS, thumbs });
      if (!weekly.clear) console.log(weekly.drift, weekly.retiring);

    Settings
    Member Visibility