How to Use arXiv metadata harvest in Instinct
Returns arXiv metadata records through its OAI-PMH service, including paper license information. Use it to build or refresh a research catalog by metadata modification date.
Prompts to try with arXiv metadata harvest in Instinct
Copy an example into Instinct, or ask in your own words.
Once a day, use arXiv subject sets to identify the computer science scope, then use arXiv metadata harvest to collect records modified since the previous collection and summarize changed paper metadata.
Every Monday at 9am: use arXiv metadata harvest to look this up and give me the result as a table.
Pull the latest numbers from arXiv metadata harvest and tell me what changed since last week.
Check arXiv metadata harvest and summarize what you find in three bullet points.
Pull the newest data from arXiv metadata harvest and give me the result as a table.
How to set up arXiv metadata harvest in Instinct
Pick the way that suits you. Each takes about two minutes.
Use the Spiral skill
- Send Instinct this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use Spiral's MCP server
- Create an API key
In the console, open API keys and create a key for Instinct. Copy it.
- Send Instinct this message
Instinct reads Spiral's skill and asks for your API key.
set up https://spiral.ai/SKILL.md
- Give Instinct the key
When Instinct asks for the key, add it where Instinct keeps secrets, never in the chat itself.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run arXiv metadata harvest
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "alexandria", "model": "arxiv-org/papers/harvest_records", "input": { "set": "<set>" } }'
Then paste one of the prompts above: Instinct finds arXiv metadata harvest on Spiral, shows the price and runs it.
arXiv metadata harvest providers and prices
Spiral runs arXiv metadata harvest through Alexandria. Open a card for today's price, with every fee included.
Settings you can ask for
Ask Instinct for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Limit | 1 to 1000 | Records to return in this call (1-1000; default 100). |
Every API field of arXiv · Harvest records is on its tool page: open its card above.
What can you do with arXiv metadata harvest in Instinct?
Keep an arXiv research catalog and recurring reading brief current as paper metadata changes. Organize the work by subject and preserve the paper identifiers needed to revisit records and citations.
Build a subject research catalog
Choose subject sets, collect their metadata, and use category listings and topic searches to organize discovery. Add individual paper details and BibTeX citations to each selected catalog entry.
Audit research catalog changes
Define a discipline with subject sets and harvest records modified since the previous collection. Compare stored metadata with individual paper records to review changed titles, abstracts, or publication references.
Compare publication activity by subject
Use subject sets to define comparable scopes and harvested metadata to build a subject-level dataset. Check category listings against the collected records before reporting counts.
Maintain a topical reading website
Define subject coverage, refresh metadata, and combine category browsing with topic searches to select papers. Publish chosen paper descriptions and citation entries, with links to arXiv.
Refresh an existing bibliography
Compare changed metadata with the papers already cited in a research collection. Inspect individual records and retrieve citation entries for references that need review.
More on arXiv metadata harvest and Instinct
Overview
arXiv metadata harvest in other agents
Questions about arXiv metadata harvest in Instinct
Can Instinct use arXiv metadata harvest?
Yes. Add Spiral to Instinct as an MCP server, and Instinct can find and run arXiv metadata harvest like any built-in tool.
How much does arXiv metadata harvest cost in Instinct?
$0.00873 per call. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Instinct plan is separate.
Do I need an Alexandria account to use arXiv metadata harvest in Instinct?
You need no Alexandria account. Instinct uses one Spiral API key for every tool, and Spiral runs arXiv metadata harvest on its own Alexandria account.
How long does it take to set up arXiv metadata harvest in Instinct?
About two minutes: create an API key, then send Instinct this message, then give Instinct the key.
Does Instinct wait while arXiv metadata harvest runs?
arXiv metadata harvest runs in the background. Instinct starts the run, checks on it and gives you the json when it's ready.
Which research fields does arXiv cover?
arXiv covers eight areas, including physics, mathematics, computer science, economics, and quantitative finance. Its coverage is bounded by those subject areas.
How fresh are arXiv records?
New public announcements normally appear Sunday through Thursday, with none on Friday or Saturday. The bulk metadata service adds new article metadata daily.
Does appearing on arXiv mean a paper passed peer review?
No. arXiv checks submissions through moderation, but that process is separate from peer review.
Can I collect metadata for all of arXiv?
The OAI-PMH service provides metadata for all arXiv articles and is the preferred route for keeping a bulk copy current. Subject sets let you restrict collection to a category, archive, or broader discipline.
Does a harvesting date range identify papers submitted during that period?
No. Harvesting dates follow metadata modifications, so older papers can appear when their records change. They cannot reliably produce a count of papers originally submitted in a particular month.
Start using arXiv metadata harvest in Instinct
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Instinct:
set up https://spiral.ai/SKILL.md


