Spiral gives your agent every tool with one account. Browse the tools →

Perplexity · LLMReleased 2024-07-23

How to Use Llama 3.1 70B Instruct in Perplexity

Llama 3.1 70B Instruct handles document summaries, multilingual support, and coding tasks. Meta recommends it over Llama 3.1 8B Instruct when conversations also need tool calls.

Prompts to try with Llama 3.1 70B Instruct in Perplexity

Copy an example into Perplexity, or ask in your own words.

Use Llama 3.1 70B Instruct to summarize the report text in this conversation in 250 words. Cover the main conclusion, three supporting findings, and unresolved questions. Include section references.

Llama 3.1 70B InstructPerplexity
Try asking
  • Use Llama 3.1 70B Instruct to draft a French reply to the customer question in this conversation using only the supplied product information. Keep it under 180 words and flag any question the information does not answer.

  • Use Llama 3.1 70B Instruct to turn the meeting transcript in this conversation into decisions and action items. Include an owner or deadline only when the transcript states one, and quote the supporting passage.

  • Use Llama 3.1 70B Instruct to explain the code pasted in this conversation to a junior developer. Describe its inputs, outputs, and likely edge cases in under 500 words. Mark any assumptions.

  • Use Llama 3.1 70B Instruct to draft six fictional customer questions and answers from the help text in this conversation. Include two questions the text cannot answer, with a reply that clearly states the missing information.

How to set up Llama 3.1 70B Instruct in Perplexity

Pick the way that suits you. Each takes about two minutes.

Use the Perplexity connector

  1. Add a remote connector

    In Perplexity, open Plugins in the sidebar (or Customize › Connectors if you don't see Plugins yet). Choose Add custom › Add MCP connector, then Remote. Name it Spiral and paste this MCP server URL:

    https://api.spiral.ai/mcp
  2. Sign in to Spiral and approve

    Select the Spiral card on the Plugins page to start sign-in. Spiral opens: sign in, pick the organization and click Authorize. No API key.

Use the Spiral skill

  1. Send Perplexity this message

    Your agent reads Spiral's skill and sets itself up.

    set up https://spiral.ai/SKILL.md
  2. Sign in or paste a key

    Approve Spiral in the browser, or give the agent a key from the console.

Use the Spiral CLI

  1. Install and sign in

    Installs the Spiral CLI, signs you in and adds its skill to your coding agents.

    npx -y spiral-cli@latest init

Call the Spiral API

  1. Create an API key

    In the console, under API keys.

  2. Run Llama 3.1 70B Instruct

    One request; the result comes back by polling or a webhook.

    curl https://api.spiral.ai/v1/runs \
      -H "Authorization: Bearer $SPIRAL_API_KEY" \
      -H "Content-Type: application/json" \
      -H "Idempotency-Key: $(uuidgen)" \
      -d '{
        "provider": "openrouter",
        "model": "meta-llama/llama-3.1-70b-instruct",
        "input": {
          "messages": [
            {
              "role": "system"
            }
          ]
        }
      }'

Then paste one of the prompts above: Perplexity finds Llama 3.1 70B Instruct on Spiral, shows the price and runs it.

Llama 3.1 70B Instruct providers and prices

Spiral runs Llama 3.1 70B Instruct through OpenRouter. Open a card for today's price, with every fee included.

OpenRouterLLM
Meta: Llama 3.1 70B Instruct
meta-llama/llama-3.1-70b-instruct

Settings you can ask for

Ask Perplexity for any of these in your prompt.

SettingAllowed valuesDefaultDescription
Top ka whole number from 0
Top p0 to 1
Max tokens1 to 8192

The most output tokens to generate.

Temperature0 to 2

Every API field of Meta: Llama 3.1 70B Instruct is on its tool page: open its card above.

What can you do with Llama 3.1 70B Instruct in Perplexity?

Turn lengthy text into clear summaries and multilingual drafts with Llama 3.1 70B Instruct. Supply the material in the conversation and specify the audience, language, and desired length.

Decision briefs from long documents

Turn a lengthy proposal or report into a short brief with decisions, supporting passages, and unresolved questions. Request section references so each conclusion can be checked.

Multilingual customer support drafts

Draft replies in the eight supported languages using supplied product information. Preserve product names and separate documented answers from questions that need a support specialist.

Code review and debugging assistance

Review relevant code and error output to propose a focused fix. Ask for the suspected cause, the proposed change, and a test that would confirm the fix.

Meeting summaries with traceable actions

Convert a text transcript into decisions, action items, and open questions. Require transcript evidence for each assigned owner or deadline.

Answers grounded in reference material

Answer questions using supplied help articles or policy excerpts. Request a supporting passage for every answer and an explicit statement when the material does not cover the question.

Support conversation test data

Generate fictional support conversations for evaluation, including follow-up questions and cases with missing information. Review the examples before using them to assess another system.

Release notes from technical changes

Turn commit descriptions and engineering notes into a readable release summary. Keep user-visible changes separate from internal maintenance and flag claims that need confirmation.

Questions about Llama 3.1 70B Instruct in Perplexity

Can Perplexity use Llama 3.1 70B Instruct?

Yes. Add Spiral to Perplexity as an MCP server, and Perplexity can find and run Llama 3.1 70B Instruct like any built-in tool.

How much does Llama 3.1 70B Instruct cost in Perplexity?

Up to $0.003868 per run at the default inputs. $0.936 per 1M input tokens, $0.936 per 1M output tokens. You pay from your Spiral balance as you go, with no subscription, and a failed run is not charged. Your Perplexity plan is separate.

Do I need an OpenRouter account to use Llama 3.1 70B Instruct in Perplexity?

No. Spiral runs Llama 3.1 70B Instruct on its own OpenRouter account. You sign in to Spiral once and never paste a key.

How long does it take to set up Llama 3.1 70B Instruct in Perplexity?

About two minutes: add a remote connector, then sign in to Spiral and approve.

Does Perplexity wait while Llama 3.1 70B Instruct runs?

Llama 3.1 70B Instruct runs in the background. Perplexity starts the run, checks on it and gives you the text, json when it's ready.

What is Llama 3.1 70B Instruct useful for?

Use it to summarize lengthy text, draft multilingual support replies, and assist with code. Give it the relevant source material and a concrete deliverable, such as a decision list or proposed patch.

How much text can Llama 3.1 70B Instruct consider?

Meta specifies a 128K-token context length. That figure describes context capacity, so do not treat it as a promise of a 128K-token response; set a separate response-length target.

Which languages does Llama 3.1 70B Instruct support?

Meta lists English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Specify the output language and any terminology that must stay unchanged.

Can Llama 3.1 70B Instruct interpret images or generate video?

It is a text model. For a task based on a screenshot or recording, provide a text description or transcript.

What should I check in its answers?

Check factual claims against the supplied sources, especially when an answer sounds certain. Ask it to quote supporting passages and mark missing information, then verify those passages yourself.

Get started

Start using Llama 3.1 70B Instruct in Perplexity

One Spiral account for every tool your agent needs. No subscription; you pay per run.

Paste this into Perplexity:

Set up Perplexity

set up https://spiral.ai/SKILL.md
Are you an AI agent? See setup options