Skip to content
Whether what it says is supported

Analect Evidence File

Analect Evidence File checks an AI output against the document it was written from, claim by claim. Two models from different vendors judge every claim, each verdict quotes the passage it rests on, and what the output left out is reported on its own. Every output gets a signed Certificate of Accuracy that anyone can check.

Part of the Evidence File and the Assurance Pack Last reviewed by George McKenna, Chairman & CTO, ETT.

The question it answers

Which claims in this AI output does the source support, and which does it contradict?

What goes in

  • An AI output and the source it was written from, as pasted text, PDF with a text layer or Word.
  • What produced the output: the system or model, the date and the purpose, recorded as you state them.
  • For the Assurance Pack: one AI system, your acceptance criteria and your reviewers.

What comes out

  • A Certificate of Accuracy for each output: every claim, its verdict and the passage the verdict rests on.
  • Omissions: material facts in the source that the output left out, counted on their own.
  • One register across the set, as PDF and as a file your own systems can read.
  • A reference and digests, so anyone holding a certificate can check it on the public verification page.
  • For one system over a quarter, a signed pack that maps the evidence to ISO/IEC 42001 and the EU AI Act.
Built to be checked

How is it measured?

  • Two models from different vendors check every claim. A claim they disagree on is marked disputed and left for a person.
  • The checker is itself measured, and the figures are published with the weak rows beside the strong ones.
  • Every rate is stated with its denominator: claims checked, claims settled, facts found.
The limits

What does Analect Evidence File not do?

  • It does not say the source itself is true. It says whether the output agrees with it.
  • It does not say which system wrote the output. That is recorded as you state it.
  • It does not replace professional review. It shows a reviewer exactly where to look.
  • It does not keep your documents. It keeps the certificates.
Where it sits

Where does Analect Evidence File fit in an AI pipeline?

Beside it, not inside it. Analect does not sit in the path of your AI requests, and you do not change your models or tools to use it. Analect Evidence File works at the points marked below.

  1. 01

    Before you build

    What the work should cost, and on which model.

  2. 02

    Prepare the documents

    What is in them, what they cost to hold, who may see them.

  3. 03

    Choose what the model is given

    Whether sending less still gets the same answers.

  4. 04

    Run

    Your own models and tools. Nothing of Analect's sits here.

  5. 05

    Check the output

    Whether each claim is supported by its source.

    Analect Evidence File works here.

  6. 06

    Prove it over time

    Evidence an auditor can follow, for one system over a period.

    Analect Evidence File works here.

How to get it

How do we start using Analect Evidence File?

Most customers meet Analect Evidence File through the Accuracy Evidence File, a three-week, fixed-price service, or through the Accuracy Assurance Pack, which runs for a quarter. Accounts are set up by ETT, and each account sees only the workflows its work needs.

All workflows

Questions

About Analect Evidence File

What is a Certificate of Accuracy?

A record of one AI output checked against one source. It lists every claim the output makes, whether the source supports it, contradicts it or never mentions it, the passage each verdict rests on, and the material facts the output left out. It carries a reference and digests so anyone can check it.

Can somebody outside our organisation check a certificate?

Yes. Anyone holding one can check on the public verification page that Analect issued it, that it has not been withdrawn, and that their file is the one it was issued against. Nothing is uploaded to do it.

Does a clean certificate mean the output is true?

No. It means no claim in the output was contradicted by the source. It does not certify that the source is right, or which system wrote the output, and every certificate says so.

See it on worked material, then on yours

Thirty minutes with the team that runs Analect: the AI Spend Forecast and the Accuracy Evidence File on worked examples, and what either would look like on your bills or your outputs.

Book a demo