PraxonBook a call
All work

Case study · AI orchestration harness

Elenchus

Python · Rust · local-first

Models propose, verifiers dispose. A personal, local-first harness that orchestrates language models behind a verification pipeline — every claim leaves the system stamped Verified, Unproven, or Refuted, wearing its evidence grade. Named for the Socratic cross-examination.

In development
§ I

The contract

Every claim is checked by the strongest verifier its class allows, and every claim wears its verdict in the output itself. "I can't confirm that" is a first-class answer. The one forbidden state is confident-unverified: the system may be wrong, but it may not be wrong while claiming certainty.

Checksums match the cited source publicationVerified · 2 sources
Vendor benchmark outperforms the baselineUnproven · vendor only
This harness makes every output correctRefuted
§ II

Roughly how it works

One loop, ordered so cheap checks kill bad candidates before expensive ones run. A task is classified, context is assembled under a hard budget, a small plan is drawn with machine-checkable acceptance criteria, and multiple candidate solutions are generated in parallel — each isolated, none trusted.

Then the verification cascade disposes. Code faces compilers, linters, and tests it cannot edit. Factual claims are atomized and each one faces source retrieval, entailment, and a citation-reality check — a fabricated citation kills the candidate at the first gate. A separate critic gives the surviving winner a cold read against the acceptance criteria, seeing only the result, never the conversation that produced it.

Every call, cost, and verdict is traced. The models themselves are interchangeable — when a better one ships, the roster changes and the harness stays.

§ III

Why it exists

Model output is fluent whether or not it is true, and rules that live in a prompt depend on the model feeling like following them. Elenchus moves the epistemics out of the prompt and into pipeline stages that run whether the model feels like it or not. The measure of the system is not how much it generates — it's the cost of each piece of verified work.

§ IV

Status

In active development as a personal tool — the same verification discipline Praxon applies to client platforms, promoted to infrastructure. Deliberately described here in outline only.

Want verification-first AI in your platform?

Book a discovery call