Skip to main content
POST
Preview deterministic draft evaluators against stored evidence

Authorizations

Authorization
string
header
required

MCPJam API key (sk_…). Create one at Settings → API keys. Guest sessions cannot use the API, and API keys cannot manage other API keys.

Headers

x-mcpjam-eval-vocabulary
enum<string>

Which vocabulary this request and its response speak. Absent means 1, which is byte-for-byte today's contract: the same request fields, the same refusals, the same response projection. 2 is the canonical vocabulary. Any other value is a 400 with code: "VALIDATION_ERROR".

Today it decides one thing: the spelling of an evaluator's policy role. Vocabulary 1 accepts and returns gating; vocabulary 2 accepts both spellings and returns the canonical required. Sending required without the header is a 400, deliberately — vocabulary 1 is not widened to meet vocabulary 2 half way, because a boundary that accepts a spelling it does not announce is one two implementations can disagree about.

A response that varies by vocabulary sends Vary: x-mcpjam-eval-vocabulary.

Available options:
1,
2

Path Parameters

projectId
string
required

ID of the hosted project that contains the server.

runId
string
required

Eval run ID, as returned by POST /eval-runs.

Body

application/json
assertions
object
required
continuation
object
matchOptions
object | null

Optional deterministic tool matching options; null omits matching.

Response

Draft evidence comparison.

schemaVersion
any
required
sourceRunId
string
required
sourceHash
string
required
draftHash
string
required
complete
boolean
required
continuationAvailable
boolean
required
counts
object
required
differences
object[]
required
modelUse
any
required
configRevision
any
continuation
object