Spiral gives your agent every tool with one account. Browse the tools →

Grok · LLMReleased 2024-07-23

How to Use Llama 3.1 70B Instruct in Grok

Llama 3.1 70B Instruct handles document summaries, multilingual support, and coding tasks. Meta recommends it over Llama 3.1 8B Instruct when conversations also need tool calls.

Prompts to try with Llama 3.1 70B Instruct in Grok

Copy an example into Grok, or ask in your own words.

Use Llama 3.1 70B Instruct to summarize the report text in this conversation in 250 words. Cover the main conclusion, three supporting findings, and unresolved questions. Include section references.

Llama 3.1 70B InstructGrok
Try asking
  • Use Llama 3.1 70B Instruct to draft a French reply to the customer question in this conversation using only the supplied product information. Keep it under 180 words and flag any question the information does not answer.

  • Use Llama 3.1 70B Instruct to turn the meeting transcript in this conversation into decisions and action items. Include an owner or deadline only when the transcript states one, and quote the supporting passage.

  • Use Llama 3.1 70B Instruct to explain the code pasted in this conversation to a junior developer. Describe its inputs, outputs, and likely edge cases in under 500 words. Mark any assumptions.

  • Use Llama 3.1 70B Instruct to draft six fictional customer questions and answers from the help text in this conversation. Include two questions the text cannot answer, with a reply that clearly states the missing information.

How to set up Llama 3.1 70B Instruct in Grok

Pick the way that suits you. Each takes about two minutes.

Use the Grok connector

  1. Add a custom connector

    In Grok open Settings › Connect Apps, then Add a custom connector. Name it Spiral, paste this URL, leave Headers empty and click Add MCP.

    https://api.spiral.ai/mcp
  2. Sign in to Spiral and approve

    Grok opens Spiral: sign in, pick the organization and click Authorize. Spiral gives the connection its own API key; Grok never sees it, and you can remove the connection under Settings › Connected apps.

  3. Check that it is connected

    Connect Apps › Custom shows Spiral as Connected. It works in every Grok chat and Grok bot.

Use the Spiral skill

  1. Send Grok this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run Llama 3.1 70B Instruct

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "openrouter",
        "model": "meta-llama/llama-3.1-70b-instruct",
        "input": {
          "messages": [
            {
              "role": "system"
            }
          ]
        }
      }'

Then paste one of the prompts above: Grok finds Llama 3.1 70B Instruct on Spiral, shows the price and runs it.

Llama 3.1 70B Instruct providers and prices

Spiral runs Llama 3.1 70B Instruct through OpenRouter. Open a card for today's price, with every fee included.

OpenRouterLLM
Meta: Llama 3.1 70B Instruct
meta-llama/llama-3.1-70b-instruct

Settings you can ask for

Ask Grok for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Top ka whole number from 0
Top p0 to 1
Max tokens1 to 8192

The most output tokens to generate.

Temperature0 to 2

Every API field of Meta: Llama 3.1 70B Instruct is on its tool page: open its card above.

What can you do with Llama 3.1 70B Instruct in Grok?

Turn lengthy text into clear summaries and multilingual drafts with Llama 3.1 70B Instruct. Supply the material in the conversation and specify the audience, language, and desired length.

Decision briefs from long documents

Turn a lengthy proposal or report into a short brief with decisions, supporting passages, and unresolved questions. Request section references so each conclusion can be checked.

Multilingual customer support drafts

Draft replies in the eight supported languages using supplied product information. Preserve product names and separate documented answers from questions that need a support specialist.

Code review and debugging assistance

Review relevant code and error output to propose a focused fix. Ask for the suspected cause, the proposed change, and a test that would confirm the fix.

Meeting summaries with traceable actions

Convert a text transcript into decisions, action items, and open questions. Require transcript evidence for each assigned owner or deadline.

Answers grounded in reference material

Answer questions using supplied help articles or policy excerpts. Request a supporting passage for every answer and an explicit statement when the material does not cover the question.

Support conversation test data

Generate fictional support conversations for evaluation, including follow-up questions and cases with missing information. Review the examples before using them to assess another system.

Release notes from technical changes

Turn commit descriptions and engineering notes into a readable release summary. Keep user-visible changes separate from internal maintenance and flag claims that need confirmation.

Questions about Llama 3.1 70B Instruct in Grok

Can Grok use Llama 3.1 70B Instruct?

Yes. Add Spiral to Grok as an MCP server, and Grok can find and run Llama 3.1 70B Instruct like any built-in tool.

How much does Llama 3.1 70B Instruct cost in Grok?

Up to $0.003868 per run at the default inputs. $0.936 per 1M input tokens, $0.936 per 1M output tokens. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Grok plan is separate.

Do I need an OpenRouter account to use Llama 3.1 70B Instruct in Grok?

No. Spiral runs Llama 3.1 70B Instruct on its own OpenRouter account. You sign in to Spiral once and never paste a key.

How long does it take to set up Llama 3.1 70B Instruct in Grok?

About two minutes: add a custom connector, then sign in to Spiral and approve, then check that it is connected.

Does Grok wait while Llama 3.1 70B Instruct runs?

Llama 3.1 70B Instruct runs in the background. Grok starts the run, checks on it and gives you the text, json when it's ready.

What is Llama 3.1 70B Instruct useful for?

Use it to summarize lengthy text, draft multilingual support replies, and assist with code. Give it the relevant source material and a concrete deliverable, such as a decision list or proposed patch.

How much text can Llama 3.1 70B Instruct consider?

Meta specifies a 128K-token context length. That figure describes context capacity, so do not treat it as a promise of a 128K-token response; set a separate response-length target.

Which languages does Llama 3.1 70B Instruct support?

Meta lists English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Specify the output language and any terminology that must stay unchanged.

Can Llama 3.1 70B Instruct interpret images or generate video?

It is a text model. For a task based on a screenshot or recording, provide a text description or transcript.

What should I check in its answers?

Check factual claims against the supplied sources, especially when an answer sounds certain. Ask it to quote supporting passages and mark missing information, then verify those passages yourself.

Get started

Start using Llama 3.1 70B Instruct in Grok

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Grok:

Set up Grok

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options