How to Use Artificial Analysis model hosting comparison in Hermes
Returns hosting benchmarks for one model, including output speed and latency distributions. Use it to compare hosts for the same model and inspect variation beyond the median.
Prompts to try with Artificial Analysis model hosting comparison in Hermes
Copy an example into Hermes, or ask in your own words.
Every morning, use Artificial Analysis model hosting comparison for DeepSeek V3 and flag hosts whose reported median output speed changes by more than 15 percent since the previous check.
Every Monday at 9am: use Artificial Analysis model hosting comparison to look this up and give me the result as a table.
Pull the latest numbers from Artificial Analysis model hosting comparison and tell me what changed since last week.
Check Artificial Analysis model hosting comparison and summarize what you find in three bullet points.
Pull the newest data from Artificial Analysis model hosting comparison and give me the result as a table.
How to set up Artificial Analysis model hosting comparison in Hermes
Pick the way that suits you. Each takes about two minutes.
Use the Spiral skill
- Send Hermes this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use Spiral's MCP server
- Add the server and sign in
Hermes opens your browser: sign in to Spiral and click Authorize. No API key. When Hermes asks Enable all tools? \[Y/n/select], answer Y: n cancels without saving the server, and select hides the tools you leave out.
hermes mcp add spiral \ --url https://api.spiral.ai/mcp \ --auth oauth \ --connect-timeout 300
- Check it
In a chat that was already open, run /reload-mcp.
hermes mcp list hermes mcp test spiral
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run Artificial Analysis model hosting comparison
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "alexandria", "model": "artificialanalysis-ai/benchmarks/list_model_providers", "input": { "slug": "<slug>" } }'
Then paste one of the prompts above: Hermes finds Artificial Analysis model hosting comparison on Spiral, shows the price and runs it.
Artificial Analysis model hosting comparison providers and prices
Spiral runs Artificial Analysis model hosting comparison through Alexandria. Open a card for today's price, with every fee included.
What can you do with Artificial Analysis model hosting comparison in Hermes?
Get a recurring brief when Artificial Analysis changes the records you follow. Compare each retrieval with your agent's saved snapshot to flag changed benchmark scores or hosting measurements.
Build an internal model shortlist
Find candidate models, inspect their benchmark results, and compare hosting measurements before choosing which combinations to test on your application.
Review candidates for an interactive assistant
Compare model benchmark results alongside output speed and latency. Narrow the hosting choices for candidates that deserve a trial with your conversational workload.
Prepare a model migration review
Compare a replacement model's benchmark record with the model you use today, then assess the measured hosting options for each before running migration tests.
Maintain an internal evaluation brief
Compare newly retrieved model and hosting records with saved snapshots. Highlight changed benchmark results or performance measurements for the team's next evaluation meeting.
Investigate a hosting change
Find the measured endpoints for a model and compare their latency and output speed. Use detailed distributions to decide which hosts warrant application-level testing.
Separate model choice from host choice
Inspect the model benchmark record and compare the hosting measurements separately. Explain which evidence concerns model capability and which concerns serving performance.
More on Artificial Analysis model hosting comparison and Hermes
Overview
Artificial Analysis model hosting comparison in other agents
Questions about Artificial Analysis model hosting comparison in Hermes
Can Hermes use Artificial Analysis model hosting comparison?
Yes. Add Spiral to Hermes as an MCP server, and Hermes can find and run Artificial Analysis model hosting comparison like any built-in tool.
How much does Artificial Analysis model hosting comparison cost in Hermes?
$0.00873 per call. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Hermes plan is separate.
Do I need an Alexandria account to use Artificial Analysis model hosting comparison in Hermes?
No. Spiral runs Artificial Analysis model hosting comparison on its own Alexandria account. You sign in to Spiral once and never paste a key.
How long does it take to set up Artificial Analysis model hosting comparison in Hermes?
About two minutes: add the server and sign in, then check it.
Does Hermes wait while Artificial Analysis model hosting comparison runs?
Artificial Analysis model hosting comparison runs in the background. Hermes starts the run, checks on it and gives you the json when it's ready.
Does Artificial Analysis cover proprietary and open weights models?
Yes. Artificial Analysis benchmarks both proprietary and open weights models, so its comparisons can include both deployment approaches.
How fresh are the performance measurements?
Artificial Analysis runs its standard API performance benchmark every six hours across several workloads. Model and benchmark records update as Artificial Analysis publishes results.
Will the latency figures match users in every region?
The tests run from Google Cloud Run in us-central1. The measurements therefore reflect that network path, which limits how directly they describe response times elsewhere.
Does a model's speed describe every company hosting it?
Model-level performance usually represents the model creator's own endpoint. Artificial Analysis also publishes per-model hosting benchmarks, which let you compare hosts individually.
Can I inspect performance variation beyond a single speed figure?
Artificial Analysis's detailed performance data includes quartiles and percentiles. These distributions help distinguish a typical measurement from the spread of observed results.
Start using Artificial Analysis model hosting comparison in Hermes
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Hermes:
set up https://spiral.ai/SKILL.md


