Llama 3.1 70B Instruct

llama-3.1-70b-instruct

STABLE

128,000 context

Starting at $0.72/M input tokens

Starting at $0.72/M output tokens

Streaming

Providers for Llama 3.1 70B Instruct

LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.

AWS Bedrock

aws-bedrock/llama-3.1-70b-instruct

Context Size

128k

Stability

STABLE

Pricing

Input

$0.72

/M

Cached

—

Output

$0.72

/M

Capabilities

Streaming

Try in Playground