How to Use Llama 3.1 70B Instruct in Hermes
Llama 3.1 70B Instruct handles document summaries, multilingual support, and coding tasks. Meta recommends it over Llama 3.1 8B Instruct when conversations also need tool calls.
Prompts to try with Llama 3.1 70B Instruct in Hermes
Copy an example into Hermes, or ask in your own words.
Every weekday, use Llama 3.1 70B Instruct to summarize the updates supplied for that run. Return decisions, blockers, and open questions in under 350 words. Cite the update supporting each item.
Each morning, use Llama 3.1 70B Instruct to summarize the support conversations supplied for that run. Identify recurring questions and unanswered requests. Include one representative passage for each theme.
Every Friday, use Llama 3.1 70B Instruct to draft release notes from the engineering updates supplied for that run. Separate user-visible changes from maintenance work and flag incomplete descriptions.
Each week, use Llama 3.1 70B Instruct to draft Spanish and Portuguese versions of the supplied English product update. Preserve product names and technical identifiers. List phrases that need a translator's review.
Each Monday, use Llama 3.1 70B Instruct to generate ten fictional support questions from the help excerpts supplied for that run. Include three cases where the excerpts lack an answer. Follow the approved example format supplied with the task.
How to set up Llama 3.1 70B Instruct in Hermes
Pick the way that suits you. Each takes about two minutes.
Use the Spiral skill
- Send Hermes this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use Spiral's MCP server
- Add the server and sign in
Hermes opens your browser: sign in to Spiral and click Authorize. No API key. When Hermes asks Enable all tools? \[Y/n/select], answer Y: n cancels without saving the server, and select hides the tools you leave out.
hermes mcp add spiral \ --url https://api.spiral.ai/mcp \ --auth oauth \ --connect-timeout 300
- Check it
In a chat that was already open, run /reload-mcp.
hermes mcp list hermes mcp test spiral
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run Llama 3.1 70B Instruct
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "openrouter", "model": "meta-llama/llama-3.1-70b-instruct", "input": { "messages": [ { "role": "system" } ] } }'
Then paste one of the prompts above: Hermes finds Llama 3.1 70B Instruct on Spiral, shows the price and runs it.
Llama 3.1 70B Instruct providers and prices
Spiral runs Llama 3.1 70B Instruct through OpenRouter. Open a card for today's price, with every fee included.
Up to $0.003868 per run at the default inputs. $0.936 per 1M input tokens, $0.936 per 1M output tokens.
Settings you can ask for
Ask Hermes for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Top k | a whole number from 0 | ||
| Top p | 0 to 1 | ||
| Max tokens | 1 to 8192 | The most output tokens to generate. | |
| Temperature | 0 to 2 |
Every API field of Meta: Llama 3.1 70B Instruct is on its tool page: open its card above.
What can you do with Llama 3.1 70B Instruct in Hermes?
Produce recurring summaries of supplied updates, support conversations, and technical notes with Llama 3.1 70B Instruct. Define a fixed reporting format and require evidence for claims that need follow-up.
Decision briefs from long documents
Turn a lengthy proposal or report into a short brief with decisions, supporting passages, and unresolved questions. Request section references so each conclusion can be checked.
Multilingual customer support drafts
Draft replies in the eight supported languages using supplied product information. Preserve product names and separate documented answers from questions that need a support specialist.
Code review and debugging assistance
Review relevant code and error output to propose a focused fix. Ask for the suspected cause, the proposed change, and a test that would confirm the fix.
Meeting summaries with traceable actions
Convert a text transcript into decisions, action items, and open questions. Require transcript evidence for each assigned owner or deadline.
Answers grounded in reference material
Answer questions using supplied help articles or policy excerpts. Request a supporting passage for every answer and an explicit statement when the material does not cover the question.
Support conversation test data
Generate fictional support conversations for evaluation, including follow-up questions and cases with missing information. Review the examples before using them to assess another system.
Release notes from technical changes
Turn commit descriptions and engineering notes into a readable release summary. Keep user-visible changes separate from internal maintenance and flag claims that need confirmation.
More on Llama 3.1 70B Instruct and Hermes
Overview
Llama 3.1 70B Instruct in other agents
Questions about Llama 3.1 70B Instruct in Hermes
Can Hermes use Llama 3.1 70B Instruct?
Yes. Add Spiral to Hermes as an MCP server, and Hermes can find and run Llama 3.1 70B Instruct like any built-in tool.
How much does Llama 3.1 70B Instruct cost in Hermes?
Up to $0.003868 per run at the default inputs. $0.936 per 1M input tokens, $0.936 per 1M output tokens. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Hermes plan is separate.
Do I need an OpenRouter account to use Llama 3.1 70B Instruct in Hermes?
No. Spiral runs Llama 3.1 70B Instruct on its own OpenRouter account. You sign in to Spiral once and never paste a key.
How long does it take to set up Llama 3.1 70B Instruct in Hermes?
About two minutes: add the server and sign in, then check it.
Does Hermes wait while Llama 3.1 70B Instruct runs?
Llama 3.1 70B Instruct runs in the background. Hermes starts the run, checks on it and gives you the text, json when it's ready.
What is Llama 3.1 70B Instruct useful for?
Use it to summarize lengthy text, draft multilingual support replies, and assist with code. Give it the relevant source material and a concrete deliverable, such as a decision list or proposed patch.
How much text can Llama 3.1 70B Instruct consider?
Meta specifies a 128K-token context length. That figure describes context capacity, so do not treat it as a promise of a 128K-token response; set a separate response-length target.
Which languages does Llama 3.1 70B Instruct support?
Meta lists English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Specify the output language and any terminology that must stay unchanged.
Can Llama 3.1 70B Instruct interpret images or generate video?
It is a text model. For a task based on a screenshot or recording, provide a text description or transcript.
What should I check in its answers?
Check factual claims against the supplied sources, especially when an answer sounds certain. Ask it to quote supporting passages and mark missing information, then verify those passages yourself.
Start using Llama 3.1 70B Instruct in Hermes
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Hermes:
set up https://spiral.ai/SKILL.md


