ReplicateDataComing soon

openai/gpt-4o-mini

openai/gpt-4o-mini is a data tool from Replicate that runs in the background and returns text. Coming soon: listed with its price, not yet open to runs.

This tool is listed but not yet available to run.

Pricing

Coming soon

Price pending

Limits

Runs
In the background
Returns
text
Longest queue wait
1 hour
Run deadline
30 minutes
Longest run, end to end
225 minutes
Largest inline input
1 MB
Largest input file
500 MB
Largest output
5 GB
Outputs per run
16

Input

FieldKindDefaultDescription
top_pnumber
0 to 1
1

Nucleus sampling parameter - the model considers the results of the tokens with top_p probability mass. (0.1 means only the tokens comprising the top 10% probability mass are considered.)

prompttext—

The prompt to send to the model. Do not use if using messages.

messagesJSON[]

A JSON string representing a list of messages. For example: [{"role": "user", "content": "Hello, how are you?"}]. If provided, prompt and system_prompt are ignored.

image_inputlist[]

List of images to send to the model

temperaturenumber
0 to 2
1

Sampling temperature between 0 and 2

system_prompttext—

System prompt to set the assistant's behavior

presence_penaltynumber
-2 to 2
0

Presence penalty parameter - positive values penalize new tokens based on whether they appear in the text so far, increasing the model's likelihood to talk about new topics.

frequency_penaltynumber
-2 to 2
0

Frequency penalty parameter - positive values penalize the repetition of tokens.

max_completion_tokensnumber (whole)4096

Maximum number of completion tokens to generate

Same request in code

curl https://api.spiral.ai/v1/runs \
  -H "Authorization: Bearer $SPIRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -H "Idempotency-Key: $(uuidgen)" \
  -d '{
    "provider": "replicate",
    "model": "openai/gpt-4o-mini",
    "input": {}
  }'