How to Use Mistral document OCR in Hermes
Mistral document OCR extracts text, tables, and embedded images from PDFs and images, with optional structured JSON annotations. Use it to turn reports and scanned documents into content an agent can search, compare, or analyze.
Prompts to try with Mistral document OCR in Hermes
Copy an example into Hermes, or ask in your own words.
Each quarter, check for a new Apple earnings report PDF and use Mistral document OCR to extract its financial tables for comparison with the previous report.
Each month, check for a new NASA Inspector General semiannual report PDF and use Mistral document OCR to extract its text for a digest of newly reported findings.
Each year, check for a new Microsoft annual report PDF and use Mistral document OCR to extract its text and identify changes in the risk factors section.
Each month, check for new Wikimedia Foundation financial report PDFs and use Mistral document OCR to extract their tables into a running financial comparison.
Each week, check for a revised PDF of Mistral 7B at https://arxiv.org/pdf/2310.06825 and use Mistral document OCR to extract changed text and tables when a revision appears.
How to set up Mistral document OCR in Hermes
Pick the way that suits you. Each takes about two minutes.
Use the Spiral skill
- Send Hermes this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use Spiral's MCP server
- Add the server and sign in
Hermes opens your browser: sign in to Spiral and click Authorize. No API key. When Hermes asks Enable all tools? \[Y/n/select], answer Y: n cancels without saving the server, and select hides the tools you leave out.
hermes mcp add spiral \ --url https://api.spiral.ai/mcp \ --auth oauth \ --connect-timeout 300
- Check it
In a chat that was already open, run /reload-mcp.
hermes mcp list hermes mcp test spiral
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run Mistral document OCR
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "mistral", "model": "mistral-ocr-3", "input": { "document": { "document_url": "<document_url>" } } }'
Then paste one of the prompts above: Hermes finds Mistral document OCR on Spiral, shows the price and runs it.
Mistral document OCR providers and prices
Spiral runs Mistral document OCR through Mistral. Open a card for today's price, with every fee included.
Settings you can ask for
Mistral document OCR works from your document annotation prompt. Ask Hermes for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Image limit | a whole number | Max images to extract | |
| Table format | markdown or html | ||
| Extract footer | on or off | off | Extract the page footer into the response's |
| Extract header | on or off | off | Extract the page header into the response's |
| Image min size | a whole number | Minimum height and width of image to extract | |
| Include blocks | on or off | on | Return paragraph-level bounding boxes for all content blocks in the response |
| Include image base64 | on or off | Include image URLs in response | |
| Confidence scores granularity | word, page, or block | Granularity for confidence scores: 'page' (aggregate only), 'word' (per-word scores), or 'block' (per-block scores). Defaults to None (no confidence scores) to keep response payload small. |
Every API field of Mistral OCR 3 is on its tool page: open its card above.
What can you do with Mistral document OCR in Hermes?
Maintain a searchable collection as new public report PDFs appear. A scheduled agent can extract each new document and compare its text or tables with previously processed editions.
Make annual reports searchable
Extract report text into Markdown for a company research index, then use it to find business segments, risks, and accounting notes.
Recover financial tables
Extract tables from public company reports for spreadsheet analysis. Preserve merged headers so year labels stay associated with the right figures.
Prepare research papers for analysis
Turn paper PDFs into extracted text and images that an agent can use to summarize methods, compare results, and inspect figures.
Compare public document revisions
Extract two editions of a government report or business publication, then compare the text and tables to identify changes.
Build a report metadata catalog
Use structured annotations to collect document titles, reporting periods, and summaries in a consistent JSON structure. Process long reports in sections of up to eight pages.
Describe figures for document search
Annotate extracted charts and figures with descriptions that help users find the relevant visual inside a collection of public reports.
More on Mistral document OCR and Hermes
Overview
Mistral document OCR in other agents
Questions about Mistral document OCR in Hermes
Can Hermes use Mistral document OCR?
Yes. Add Spiral to Hermes as an MCP server, and Hermes can find and run Mistral document OCR like any built-in tool.
How much does Mistral document OCR cost in Hermes?
$0.0026 per page ($0.0039 with document or bounding-box annotations). You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Hermes plan is separate.
Do I need a Mistral account to use Mistral document OCR in Hermes?
No. Spiral runs Mistral document OCR on its own Mistral account. You sign in to Spiral once and never paste a key.
How long does it take to set up Mistral document OCR in Hermes?
About two minutes: add the server and sign in, then check it.
Does Hermes wait while Mistral document OCR runs?
Mistral document OCR runs in the background. Hermes starts the run, checks on it and gives you the json when it's ready.
Where does the extracted information come from, and how current is it?
Mistral extracts content from the PDF or image supplied for processing. Its information reflects that document, so processing an older annual report gives you that report's contents.
Can Mistral preserve complex tables?
OCR 3 supports reconstructed tables with merged cells, multi-row blocks, and hierarchical column headers. HTML output can represent cells spanning multiple rows or columns.
How much of a document can structured annotations cover?
Mistral's cookbook documents an eight-page limit for document annotations and recommends splitting longer documents. The annotation stage receives OCR text plus the first eight extracted image bounding boxes.
Does the reported 74% benchmark mean 74% transcription accuracy?
No. Mistral reports a 74% overall win rate against OCR 2 across forms, scans, complex tables, and handwriting; that measures comparative wins rather than the percentage of characters transcribed correctly.
Does OCR 3 return paragraph bounding boxes?
Paragraph-level block extraction requires OCR 4 or newer. Mistral says older models accept the option but return an empty array, so OCR 3 should not be used when paragraph coordinates are required.
Start using Mistral document OCR in Hermes
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Hermes:
set up https://spiral.ai/SKILL.md


