How to Use arXiv metadata harvest in Codex
Returns arXiv metadata records through its OAI-PMH service, including paper license information. Use it to build or refresh a research catalog by metadata modification date.
Prompts to try with arXiv metadata harvest in Codex
Copy an example into Codex, or ask in your own words.
Use arXiv subject sets to identify the computer science harvesting scope, then use arXiv metadata harvest to collect records modified from November 1 through November 7, 2026, for our research catalog.
Use arXiv metadata harvest to look this up and give me the result as a table. Save the result in ./assets.
Pull the latest numbers from arXiv metadata harvest and tell me what changed since last week.
Check arXiv metadata harvest and summarize what you find in three bullet points.
Pull the newest data from arXiv metadata harvest and give me the result as a table.
How to set up arXiv metadata harvest in Codex
Pick the way that suits you. Each takes about two minutes.
Use Spiral's MCP server
- Add the hosted server
codex mcp add spiral --url https://api.spiral.ai/mcp
- Sign in
Codex opens the browser: sign in to Spiral and click Authorize. No API key. codex mcp list then shows Spiral.
codex mcp login spiral
Use the Spiral skill
- Send Codex this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run arXiv metadata harvest
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "alexandria", "model": "arxiv-org/papers/harvest_records", "input": { "set": "<set>" } }'
Then paste one of the prompts above: Codex finds arXiv metadata harvest on Spiral, shows the price and runs it.
arXiv metadata harvest providers and prices
Spiral runs arXiv metadata harvest through Alexandria. Open a card for today's price, with every fee included.
Settings you can ask for
Ask Codex for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Limit | 1 to 1000 | Records to return in this call (1-1000; default 100). |
Every API field of arXiv · Harvest records is on its tool page: open its card above.
What can you do with arXiv metadata harvest in Codex?
Build a research index with arXiv paper records, subject organization, and bibliography entries. Connect those records to the project's reading lists or documentation so each selected reference has an identifiable source.
Build a subject research catalog
Choose subject sets, collect their metadata, and use category listings and topic searches to organize discovery. Add individual paper details and BibTeX citations to each selected catalog entry.
Audit research catalog changes
Define a discipline with subject sets and harvest records modified since the previous collection. Compare stored metadata with individual paper records to review changed titles, abstracts, or publication references.
Compare publication activity by subject
Use subject sets to define comparable scopes and harvested metadata to build a subject-level dataset. Check category listings against the collected records before reporting counts.
Maintain a topical reading website
Define subject coverage, refresh metadata, and combine category browsing with topic searches to select papers. Publish chosen paper descriptions and citation entries, with links to arXiv.
Refresh an existing bibliography
Compare changed metadata with the papers already cited in a research collection. Inspect individual records and retrieve citation entries for references that need review.
More on arXiv metadata harvest and Codex
Overview
arXiv metadata harvest in other agents
Questions about arXiv metadata harvest in Codex
Can Codex use arXiv metadata harvest?
Yes. Add Spiral to Codex as an MCP server, and Codex can find and run arXiv metadata harvest like any built-in tool.
How much does arXiv metadata harvest cost in Codex?
$0.00873 per call. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Codex plan is separate.
Do I need an Alexandria account to use arXiv metadata harvest in Codex?
No. Spiral runs arXiv metadata harvest on its own Alexandria account. You sign in to Spiral once and never paste a key.
How long does it take to set up arXiv metadata harvest in Codex?
About two minutes: add the hosted server, then sign in.
Does Codex wait while arXiv metadata harvest runs?
arXiv metadata harvest runs in the background. Codex starts the run, checks on it and gives you the json when it's ready.
Which research fields does arXiv cover?
arXiv covers eight areas, including physics, mathematics, computer science, economics, and quantitative finance. Its coverage is bounded by those subject areas.
How fresh are arXiv records?
New public announcements normally appear Sunday through Thursday, with none on Friday or Saturday. The bulk metadata service adds new article metadata daily.
Does appearing on arXiv mean a paper passed peer review?
No. arXiv checks submissions through moderation, but that process is separate from peer review.
Can I collect metadata for all of arXiv?
The OAI-PMH service provides metadata for all arXiv articles and is the preferred route for keeping a bulk copy current. Subject sets let you restrict collection to a category, archive, or broader discipline.
Does a harvesting date range identify papers submitted during that period?
No. Harvesting dates follow metadata modifications, so older papers can appear when their records change. They cannot reliably produce a count of papers originally submitted in a particular month.
Start using arXiv metadata harvest in Codex
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Codex:
set up https://spiral.ai/SKILL.md


