Run an approved evaluation
Submit one reviewed evaluation quote after approval and keep execution, delivery and model quality separate.
What you get
One owned evaluation order with the approved configuration and request identity.
Requires a fresh evaluation quote, explicit cost approval, credits and current execution gates.
| Support | Requirement |
|---|---|
| Interfaces | MCP, HTTP |
| Access | approval required |
| Workflow state | gated |
| Credential corridors (see workflow) | evaluations |
Ask your assistant
Example task
Run this evaluation only after I approve the quote and its limits.Install this skill
Use an existing compatible MCP connection or the customer CLI. Skills provide instructions; installing them does not configure credentials, grant permissions or enable execution.
Install reliquary-evaluation-order
reliqua skills install --skill reliquary-evaluation-order --directory "$HOME/.agents/skills"Download SKILL.md — Official task instructions, version 0.5.0.
Install the customer CLI — Verified release downloads, commands and troubleshooting.
Connect MCP — Keep writes disabled for discovery and planning.
Authentication and exact scopes — Corridor names identify key configuration; the API checks its actual read and write scopes.
Follow the workflow
- Check the current catalog and registered write tool. Present the exact server quote: immutable model/revision, frozen sets, execution mode, maximum cost, expiry and limits.
- After explicit approval, call evaluation_order with that quote_id, approveExecution:true and a stable caller-supplied idempotencyKey of 16-80 letters, digits, underscores or hyphens.
- Report the owned evaluation ID and actual lifecycle state. Submission, completed grading, delivered report, measured quality and finalized billing are separate outcomes.
- On an ambiguous result retain the original quote and request key; do not silently retry, change request identity or launch a batch of evaluations from one approval.
Tools and API routes
Call reliquary_connection first and use only tools registered in that connection. Route templates need the owned resource identifiers described by the existing API reference.
| Interface | Operation |
|---|---|
| MCP | reliquary_connection |
| MCP | reliquary_evaluation_catalog |
| MCP | reliquary_evaluation_order |
| HTTP | GET /api/v1/evaluations/catalog |
| HTTP | POST /api/v1/evaluations |
Availability and authorization
This workflow can prepare an action using existing contracts. Execution requires current server capabilities, qualified capacity, appropriate account scope, a fresh quote when applicable, and explicit approval of the concrete action. The customer preview CLI has no execution commands; MCP writes stay disabled by default.
Back to the skills catalog — Find another workflow or connect an interface.