Evalkeeper
    Preparing search index...

    Type Alias Attack

    One attack: text an app's inject puts into a case's untrusted field. {{canary}} in the text becomes the suite's canary, a made-up word that shows up in an answer only if the model followed the attack; {{goal}} becomes the suite's goal, the wrong answer a hijack asks for.

    type Attack = {
        id: string;
        kind: AttackKind;
        source: string;
        technique: string;
        text: string;
    }
    Index
    id: string

    Stable within its source, so a rerun skips cases made from it.

    source: string

    Where it came from: "evalkeeper", or a tool and version.

    technique: string

    How it works, in a few words ("ignore previous instructions").

    text: string