An EvalStore on your Prisma client, using the models in schema/evalkeeper.prisma.
schema/evalkeeper.prisma
Your Prisma client.
import { prismaStore } from "@crowandraven/evalkeeper/prisma";const store = prismaStore(prisma);const runner = createRunner({ store, suites, models, promptVersion }); Copy
import { prismaStore } from "@crowandraven/evalkeeper/prisma";const store = prismaStore(prisma);const runner = createRunner({ store, suites, models, promptVersion });
An EvalStore on your own eval tables, through a mapping (see PrismaStoreMap), for an app that had eval tables before Evalkeeper.
PrismaStoreMap
Where your tables differ from Evalkeeper's.
const store = prismaStore(prisma, { fields: { evalCaseLabel: { note: "rationale" }, evalRun: { set: "split", startedBy: "startedById" }, },}); Copy
const store = prismaStore(prisma, { fields: { evalCaseLabel: { note: "rationale" }, evalRun: { set: "split", startedBy: "startedById" }, },});
An EvalStore on your Prisma client, using the models in
schema/evalkeeper.prisma.