Spiral gives your agent every tool with one account. Browse the tools →

Hermes · Developer

How to Use Artificial Analysis hosting endpoint search in Hermes

Returns model hosting endpoint records from Artificial Analysis's provider benchmarks. Use it to survey a host's model offerings or find hosting candidates across the leaderboard before comparing one model's hosts.

Prompts to try with Artificial Analysis hosting endpoint search in Hermes

Copy an example into Hermes, or ask in your own words.

Each weekday, use Artificial Analysis hosting endpoint search to check Amazon Bedrock and report newly returned model endpoints or changes in their measured output speed.

Artificial Analysis hosting endpoint searchHermes
Try asking
  • Every Monday at 9am: use Artificial Analysis hosting endpoint search to look this up and give me the result as a table.

  • Pull the latest numbers from Artificial Analysis hosting endpoint search and tell me what changed since last week.

  • Check Artificial Analysis hosting endpoint search and summarize what you find in three bullet points.

  • Pull the newest data from Artificial Analysis hosting endpoint search and give me the result as a table.

How to set up Artificial Analysis hosting endpoint search in Hermes

Pick the way that suits you. Each takes about two minutes.

Use the Spiral skill

  1. Send Hermes this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use Spiral's MCP server

  1. Add the server and sign in

    Hermes opens your browser: sign in to Spiral and click Authorize. No API key. When Hermes asks Enable all tools? \[Y/n/select], answer Y: n cancels without saving the server, and select hides the tools you leave out.

    hermes mcp add spiral \
      --url https://api.spiral.ai/mcp \
      --auth oauth \
      --connect-timeout 300
  2. Check it

    In a chat that was already open, run /reload-mcp.

    hermes mcp list
    hermes mcp test spiral

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run Artificial Analysis hosting endpoint search

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "alexandria",
        "model": "artificialanalysis-ai/benchmarks/search_provider_endpoints",
        "input": {
          "host": "<host>"
        }
      }'

Then paste one of the prompts above: Hermes finds Artificial Analysis hosting endpoint search on Spiral, shows the price and runs it.

Artificial Analysis hosting endpoint search providers and prices

Spiral runs Artificial Analysis hosting endpoint search through Alexandria. Open a card for today's price, with every fee included.

AlexandriaDeveloper
Artificial Analysis · Search provider endpoints
artificialanalysis-ai/benchmarks/search_provider_endpoints

Settings you can ask for

Ask Hermes for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Limit1 to 10020

Results per page (1-100).

Include deprecatedon or off

Include endpoints of deprecated models.

Every API field of Artificial Analysis · Search provider endpoints is on its tool page: open its card above.

What can you do with Artificial Analysis hosting endpoint search in Hermes?

Get a recurring brief when Artificial Analysis changes the records you follow. Compare each retrieval with your agent's saved snapshot to flag changed benchmark scores or hosting measurements.

Build an internal model shortlist

Find candidate models, inspect their benchmark results, and compare hosting measurements before choosing which combinations to test on your application.

Review candidates for an interactive assistant

Compare model benchmark results alongside output speed and latency. Narrow the hosting choices for candidates that deserve a trial with your conversational workload.

Prepare a model migration review

Compare a replacement model's benchmark record with the model you use today, then assess the measured hosting options for each before running migration tests.

Maintain an internal evaluation brief

Compare newly retrieved model and hosting records with saved snapshots. Highlight changed benchmark results or performance measurements for the team's next evaluation meeting.

Investigate a hosting change

Find the measured endpoints for a model and compare their latency and output speed. Use detailed distributions to decide which hosts warrant application-level testing.

Separate model choice from host choice

Inspect the model benchmark record and compare the hosting measurements separately. Explain which evidence concerns model capability and which concerns serving performance.

Questions about Artificial Analysis hosting endpoint search in Hermes

Can Hermes use Artificial Analysis hosting endpoint search?

Yes. Add Spiral to Hermes as an MCP server, and Hermes can find and run Artificial Analysis hosting endpoint search like any built-in tool.

How much does Artificial Analysis hosting endpoint search cost in Hermes?

$0.00873 per call. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Hermes plan is separate.

Do I need an Alexandria account to use Artificial Analysis hosting endpoint search in Hermes?

No. Spiral runs Artificial Analysis hosting endpoint search on its own Alexandria account. You sign in to Spiral once and never paste a key.

How long does it take to set up Artificial Analysis hosting endpoint search in Hermes?

About two minutes: add the server and sign in, then check it.

Does Hermes wait while Artificial Analysis hosting endpoint search runs?

Artificial Analysis hosting endpoint search runs in the background. Hermes starts the run, checks on it and gives you the json when it's ready.

Does Artificial Analysis cover proprietary and open weights models?

Yes. Artificial Analysis benchmarks both proprietary and open weights models, so its comparisons can include both deployment approaches.

How fresh are the performance measurements?

Artificial Analysis runs its standard API performance benchmark every six hours across several workloads. Model and benchmark records update as Artificial Analysis publishes results.

Will the latency figures match users in every region?

The tests run from Google Cloud Run in us-central1. The measurements therefore reflect that network path, which limits how directly they describe response times elsewhere.

Does a model's speed describe every company hosting it?

Model-level performance usually represents the model creator's own endpoint. Artificial Analysis also publishes per-model hosting benchmarks, which let you compare hosts individually.

Can I inspect performance variation beyond a single speed figure?

Artificial Analysis's detailed performance data includes quartiles and percentiles. These distributions help distinguish a typical measurement from the spread of observed results.

Get started

Start using Artificial Analysis hosting endpoint search in Hermes

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Hermes:

Set up Hermes

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options