300 million tokens. $2.99 a month.See the subscription  

model apis · chat / llm

Llama 3.3 70B Instruct API

Run Llama 3.3 70B Instruct by Meta through one OpenAI-compatible endpoint. Pay per use against your deeprelay balance. No instance to rent, no deployment to manage.

Available now

Llama 3.3 70B Instruct API pricing

Live catalog rates, billed per use against your deeprelay balance, no minimums. Llama 3.3 70B Instruct is priced per use rather than included in the $2.99-a-month flat plan.

TierRate
Serverless
Input tokens: $1.10 / 1MOutput tokens: $1.10 / 1M

rates are read every few minutes from the live model catalog and metered per request

Call Llama 3.3 70B Instruct in one request

Any OpenAI SDK works: set the base URL to https://api.deeprelay.ai/v1 and use your deeprelay API key.

curl
curl https://api.deeprelay.ai/v1/chat/completions \
  -H "Authorization: Bearer $DEEPRELAY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "deeprelay/llama-3.3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'
Python (OpenAI SDK)
from openai import OpenAI

client = OpenAI(
    base_url="https://api.deeprelay.ai/v1",
    api_key="YOUR_DEEPRELAY_API_KEY",
)

response = client.chat.completions.create(
    model="deeprelay/llama-3.3-70b-instruct",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(response.choices[0].message.content)
JavaScript (OpenAI SDK)
import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.deeprelay.ai/v1",
  apiKey: process.env.DEEPRELAY_API_KEY,
});

const response = await client.chat.completions.create({
  model: "deeprelay/llama-3.3-70b-instruct",
  messages: [{ role: "user", content: "Hello!" }],
});
console.log(response.choices[0].message.content);

Llama 3.3 70B Instruct on deeprelay

Model iddeeprelay/llama-3.3-70b-instruct
ModalityChat / LLM
AuthorMeta
Context window32,768 tokens
StreamingSupported
Aliasesllama-3.3-70b, llama-3.3-70b-instruct, llama3.3-70b
Flat planNot included: pay as you go

faq

Llama 3.3 70B Instruct API questions

How much does the Llama 3.3 70B Instruct API cost?

Llama 3.3 70B Instruct on deeprelay currently costs $1.10 / 1M (input tokens), $1.10 / 1M (output tokens), billed against your deeprelay balance as you go. There are no minimums. It is priced per use rather than included in the $2.99-a-month flat plan, which covers a named set of models.

Is the Llama 3.3 70B Instruct API OpenAI-compatible?

Yes. Point any OpenAI SDK at https://api.deeprelay.ai/v1 with a deeprelay API key and request model "deeprelay/llama-3.3-70b-instruct". No proprietary client needed.

What is the context window of Llama 3.3 70B Instruct?

Llama 3.3 70B Instruct supports a 32,768-token context window on deeprelay.

How does billing work?

Chat models bill per input and output token at the listed per-million-token rates, metered per request against your deeprelay balance. Where a cached-input rate is listed, the part of a prompt the serving partner answers from its prompt cache (reported as prompt_tokens_details.cached_tokens) bills at that lower rate instead of the input rate.