TEXTREASONINGTOOL-USEOPEN-WEIGHTSSTRUCTURED-OUTPUT
128K
CONTEXT WINDOW
8.2K
MAX OUTPUT TOKENS
$0.22
INPUT PRICE / 1M TOKENS
$0.22
OUTPUT PRICE / 1M TOKENS
Call it in one request.
OpenAI-compatible: change the base URL, and the setup is complete.
curl https://enterprise.blackbox.ai/v1/chat/completions \
-H "Authorization: Bearer $BLACKBOX_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "blackboxai/meta/llama-3.1-8b",
"messages": [{ "role": "user", "content": "Hello!" }],
"stream": true
}'import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ.get("BLACKBOX_API_KEY"),
base_url="https://enterprise.blackbox.ai/v1",
)
stream = client.chat.completions.create(
model="blackboxai/meta/llama-3.1-8b",
messages=[{"role": "user", "content": "Hello!"}],
stream=True,
)
for chunk in stream:
print(chunk.choices[0].delta.content or "", end="", flush=True)import OpenAI from 'openai';
const client = new OpenAI({
apiKey: process.env.BLACKBOX_API_KEY,
baseURL: 'https://enterprise.blackbox.ai/v1',
});
const stream = await client.chat.completions.create({
model: 'blackboxai/meta/llama-3.1-8b',
messages: [{ role: 'user', content: 'Hello!' }],
stream: true,
});
for await (const chunk of stream) {
process.stdout.write(chunk.choices[0]?.delta?.content || '');
}The full spec sheet.
Context, pricing, modalities, routing, and deployment: everything Llama 3.1 8B Instruct supports, in one table.
- MODEL ID
- blackboxai/meta/llama-3.1-8b
- DEVELOPED BY
- Meta
- MODEL TYPE
- Text
- RELEASED
- Jul 23, 2024
- CONTEXT WINDOW
- 128K
- MAX OUTPUT TOKENS
- 8.2K
- INPUT MODALITIES
- text
- OUTPUT MODALITIES
- text
- INPUT PRICE
- $0.22 / 1M tokens
- OUTPUT PRICE
- $0.22 / 1M tokens
- REASONING
- Supported
- DATA RETENTION
- Standard retention
- DEDICATED DEPLOYMENT
- Enterprise · single-tenant
- SUPPORTED PARAMETERS
- max_tokenstemperaturestoptoolstool_choicereasoninginclude_reasoningresponse_formatstructured_outputs