Document answer agent checklist: 12 checks for your documents

Your documents are in one format
A second format is scoped and quoted on its own before any work on it starts.
The pages are text, not scans that need OCR
OCR is not included; a sample of your files is checked at the kickoff.
You have a list of anything in the documents that must not be quoted
It comes with the documents, before the build starts.
You confirm in writing that the documents hold no regulated personal or health data, or you list in writing what must be excluded
What the agent may read is settled in writing before it reads anything.
You have 15 to 30 real questions, each with the passage a person would point to
We draft a first set for you to correct; they become the golden questions the agent is tested on.
A model API key sits in your own account or secret store (Anthropic by default)
The model cost per answer is yours and shows in the cost report; search and the verifier make no model call.
A repository or storage location you own is ready for the handover, with access for our build account
Your documents live in your repository or storage, not in a consumer AI plan.
A named contact answers questions and runs the acceptance test
The work pauses while it waits on an input from you.
On your golden questions, search reaches a recall@5 of 0.85 or higher
The passages a person would point to come back among the first five results.
On 10 golden questions, every claim shows a citation and a quote
The verifier marks each claim verified or visibly unverified; none is hidden.
3 questions outside the documents are each declined, with no citation invented
The agent quotes your documents; it does not judge whether they are correct or current.
Every answer shows its tokens, its cost and its seconds
You see what each answer costs to run.

0 of 12 done

12 left to do:

Your documents are in one format
The pages are text, not scans that need OCR
You have a list of anything in the documents that must not be quoted
You confirm in writing that the documents hold no regulated personal or health data, or you list in writing what must be excluded
You have 15 to 30 real questions, each with the passage a person would point to
A model API key sits in your own account or secret store (Anthropic by default)
A repository or storage location you own is ready for the handover, with access for our build account
A named contact answers questions and runs the acceptance test
On your golden questions, search reaches a recall@5 of 0.85 or higher
On 10 golden questions, every claim shows a citation and a quote
3 questions outside the documents are each declined, with no citation invented
Every answer shows its tokens, its cost and its seconds

Want an answer agent on your documents?

Our fixed-price Document Answer Agent build answers questions from your documents: every claim cites a passage and quotes it, a verifier checks each quote, questions outside the documents are declined, and every answer shows what it cost.

Ask about a Document Answer Agent See the demo See a sample report Our services

This checklist is not legal advice or an audit of your documents.

Are your documents ready for an answer agent?

0 of 12 done

Want an answer agent on your documents?