evals.intentsolutions.io / human-review / v1

human-review/v1DRAFT

Predicate URI: https://evals.intentsolutions.io/human-review/v1

What this predicate asserts

A curated human verdict about a skill (thumbs, score text, annotation) captured as a first-class signal, kept separate from automated grades and never folded into them.

Where it is used

Captured via the j-rig review verb; rendered per-dimension on the labs skill-signals surface.

Machine-readable definition

The canonical JSON Schema (plus matching Zod and Pydantic validators) is version-pinned in the contracts kernel: schemas/v1/human-review.schema.json. The kernel package is @intentsolutions/core on npm.

How to verify a statement carrying this predicate

Statements are in-toto v1 Statements, DSSE-signed keyless via sigstore against the public production Rekor transparency log. Given a bundle file and its sigstore bundle:

cosign verify-blob --new-bundle-format --bundle <file>.sigstore.json --certificate-identity <the emitting workflow's identity> --certificate-oidc-issuer https://token.actions.githubusercontent.com <file>

Live, verifiable examples: the results browser re-verifies every row before rendering and links each bundle's evidence.