How to Use Llama 3.1 8B Instruct in Grok
Use Llama 3.1 8B Instruct for document summaries, multilingual conversations, and focused coding help. Compared with Llama 3 8B Instruct, it expands context from 8K to 128K tokens and supports eight languages.
Prompts to try with Llama 3.1 8B Instruct in Grok
Copy an example into Grok, or ask in your own words.
Use Llama 3.1 8B Instruct to summarize the report shared in this conversation in five bullets. Include one supporting passage for each bullet and finish with three unanswered questions.
Use Llama 3.1 8B Instruct to draft a Spanish reply to the customer message in this conversation. Follow the supplied support policy, keep it under 120 words, and ask for any missing detail needed to resolve the request.
Use Llama 3.1 8B Instruct to explain the code pasted above to a developer learning Python. Describe what it does, show one input and output example, and identify assumptions the code makes.
Use Llama 3.1 8B Instruct to rewrite the announcement above in plain English for existing customers. Keep it under 150 words and preserve every date, number, and product name.
Use Llama 3.1 8B Instruct to sort the feedback in this conversation into bug reports, feature requests, praise, or uncertain. Use low randomness and give a short supporting phrase for each label.
How to set up Llama 3.1 8B Instruct in Grok
Pick the way that suits you. Each takes about two minutes.
Use the Grok connector
- Add a custom connector
In Grok open Settings › Connect Apps, then Add a custom connector. Name it Spiral, paste this URL, leave Headers empty and click Add MCP.
https://api.spiral.ai/mcp
- Sign in to Spiral and approve
Grok opens Spiral: sign in, pick the organization and click Authorize. Spiral gives the connection its own API key; Grok never sees it, and you can remove the connection under Settings › Connected apps.
- Check that it is connected
Connect Apps › Custom shows Spiral as Connected. It works in every Grok chat and Grok bot.
Use the Spiral skill
- Send Grok this message
Your agent reads Spiral's skill and sets itself up.
set up https://spiral.ai/SKILL.md
- Sign in or paste a key
Approve Spiral in the browser, or give the agent a key from the console.
Use the Spiral CLI
- Install and sign in
Installs the Spiral CLI, signs you in and adds its skill to your coding agents.
npx -y spiral-cli@latest init
Call the Spiral API
- Create an API key
In the console, under API keys.
- Run Llama 3.1 8B Instruct
One request; the result comes back by polling or a webhook.
curl https://api.spiral.ai/v1/runs \ -H "Authorization: Bearer $SPIRAL_API_KEY" \ -H "Content-Type: application/json" \ -H "Idempotency-Key: $(uuidgen)" \ -d '{ "provider": "openrouter", "model": "meta-llama/llama-3.1-8b-instruct", "input": { "messages": [ { "role": "system" } ] } }'
Then paste one of the prompts above: Grok finds Llama 3.1 8B Instruct on Spiral, shows the price and runs it.
Llama 3.1 8B Instruct providers and prices
Spiral runs Llama 3.1 8B Instruct through OpenRouter. Open a card for today's price, with every fee included.
Up to $0.000215 per run at the default inputs. $0.026 per 1M input tokens, $0.052 per 1M output tokens.
Settings you can ask for
Ask Grok for any of these in your prompt.
| Setting | Allowed values | Default | Description |
|---|---|---|---|
| Seed | a whole number | ||
| Min p | 0 to 1 | ||
| Top k | a whole number from 0 | ||
| Top p | 0 to 1 | ||
| Logprobs | on or off | ||
| Max tokens | 1 to 117964 | The most output tokens to generate. | |
| Temperature | 0 to 2 | ||
| Top logprobs | 0 to 20 | ||
| Presence penalty | -2 to 2 | ||
| Frequency penalty | -2 to 2 | ||
| Repetition penalty | 0 to 2 |
Every API field of Meta: Llama 3.1 8B Instruct is on its tool page: open its card above.
What can you do with Llama 3.1 8B Instruct in Grok?
Turn supplied text into concise explanations, summaries, and multilingual reply drafts with Llama 3.1 8B Instruct. Specify the audience, language, and desired length so each response has a clear purpose.
Document briefs
Use Llama 3.1 8B Instruct to turn a long report into a short brief with findings, supporting passages, and unanswered questions.
Multilingual support drafts
Draft replies in English, German, French, Italian, Portuguese, Hindi, Spanish, or Thai using supplied policy text and the customer's message.
Ticket classification
Assign incoming text to a defined set of support categories. Provide labeled examples and an uncertain category for cases that need review.
Structured extraction
Request dates, organizations, and action items from supplied text in a consistent JSON format, with null for missing information.
Code explanations
Ask Llama 3.1 8B Instruct to explain a function, trace its inputs and outputs, and suggest edge cases to check.
Release note drafts
Turn supplied change descriptions into release notes organized by user impact. Ask for separate sections for fixes, additions, and compatibility concerns.
Recurring text digests
Summarize newly collected announcements or support messages into a brief that preserves source dates and separates reported facts from open questions.
More on Llama 3.1 8B Instruct and Grok
Overview
Llama 3.1 8B Instruct in other agents
Questions about Llama 3.1 8B Instruct in Grok
Can Grok use Llama 3.1 8B Instruct?
Yes. Add Spiral to Grok as an MCP server, and Grok can find and run Llama 3.1 8B Instruct like any built-in tool.
How much does Llama 3.1 8B Instruct cost in Grok?
Up to $0.000215 per run at the default inputs. $0.026 per 1M input tokens, $0.052 per 1M output tokens. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Grok plan is separate.
Do I need an OpenRouter account to use Llama 3.1 8B Instruct in Grok?
No. Spiral runs Llama 3.1 8B Instruct on its own OpenRouter account. You sign in to Spiral once and never paste a key.
How long does it take to set up Llama 3.1 8B Instruct in Grok?
About two minutes: add a custom connector, then sign in to Spiral and approve, then check that it is connected.
Does Grok wait while Llama 3.1 8B Instruct runs?
Llama 3.1 8B Instruct runs in the background. Grok starts the run, checks on it and gives you the text, json when it's ready.
What is Llama 3.1 8B Instruct useful for?
Use it to summarize long passages, draft multilingual conversations, and help with focused coding tasks. Meta names these uses for its upgraded 8B and 70B models.
How much text can Llama 3.1 8B Instruct handle?
Its context window is 128K tokens, compared with 8K for Llama 3. That context figure is not a promise of a 128K-token response; give each task a specific output length.
Which languages does Llama 3.1 8B Instruct support?
English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Name the target language in your request and supply examples when terminology or tone matters.
Can Llama 3.1 8B Instruct understand images or audio?
It is a text-only model. For a task involving a recording or screenshot, provide a transcript or text description for it to work from.
Does Llama 3.1 8B Instruct know current events?
Its pretraining knowledge cutoff is December 2023. For newer information, supply dated source text and ask it to base the answer on that material.
Start using Llama 3.1 8B Instruct in Grok
One Spiral account for every tool your agent needs. No subscription; you pay per run.
Paste this into Grok:
set up https://spiral.ai/SKILL.md


