Try Bifrost Enterprise free for 14 days.
Request access

llama-3.1-8b-instruct-fp8 Cost Calculator - Cloudflare

Calculate the cost of using llama-3.1-8b-instruct-fp8 from Cloudflare for your AI applications

Pricing data last updated:

llama-3.1-8b-instruct-fp8 Cost Calculator

Mode: Chat

Max: 32,000 tokens

Max: 32,000 tokens

Cost Breakdown

Input Cost$0.00015200
Output Cost$0.00028700
Total Cost$0.00043900

Pricing Details

Input: $0.0000001520 per token
Output: $0.0000002870 per token
[ WE'RE OPEN SOURCE ]

Scale with the Fastest LLM Gateway

Built for enterprise-grade reliability, governance, and scale. Deploy in seconds.

Model Specifications

Limits

Max Input Tokens32,000
Max Output Tokens32,000
Max Tokens32,000

About llama-3.1-8b-instruct-fp8

llama-3.1-8b-instruct-fp8 is a chat model from Cloudflare, one of 52 chat models they offer. It is priced at $0.15 per 1M input tokens and $0.29 per 1M output tokens, ranking 613 out of 2661 chat models by cost and cheaper than 77% of models in this category. It accepts up to 32K input tokens.

Pricing Information

Input Cost$0.15 per 1M tokens
Output Cost$0.29 per 1M tokens

Note: Use the interactive calculator above to estimate costs for your specific usage patterns.

Technical Specifications

Maximum Input Tokens32,000
Maximum Output Tokens32,000
Maximum Total Tokens32,000

Pro Tip

Use the maximum token limits shown above to understand the model's capacity. This model can handle up to 32,000 input tokens. The maximum output length is 32,000 tokens.

How llama-3.1-8b-instruct-fp8 Pricing Compares

At $0.15 per 1M input tokens and $0.29 per 1M output tokens, llama-3.1-8b-instruct-fp8 ranks 613 out of 2661 chat models by input cost. It is more affordable compared to the median of $0.50 for chat models, and is cheaper than 77% of models in this category.

ModelProviderInput / 1M tokensOutput / 1M tokensvs llama-3.1-8b-instruct-fp8
zephyr-7b-betaAnyscale$0.15$0.15-1%
gemma-7b-itAnyscale$0.15$0.15-1%
Llama-2-7b-chat-hfAnyscale$0.15$0.15-1%

Alternatives to llama-3.1-8b-instruct-fp8

Similar chat models from other providers

Anyscale
zephyr-7b-beta
$0.15/1M input
-1% vs llama-3.1-8b-instruct-fp8
Anyscale
gemma-7b-it
$0.15/1M input
-1% vs llama-3.1-8b-instruct-fp8
Anyscale
Llama-2-7b-chat-hf
$0.15/1M input
-1% vs llama-3.1-8b-instruct-fp8
Anyscale
Meta-Llama-3-8B-Instruct
$0.15/1M input
-1% vs llama-3.1-8b-instruct-fp8
Anyscale
Mistral-7B-Instruct-v0.1
$0.15/1M input
-1% vs llama-3.1-8b-instruct-fp8

Frequently Asked Questions

Is llama-3.1-8b-instruct-fp8 cheaper than zephyr-7b-beta?

No. llama-3.1-8b-instruct-fp8 costs $0.15 per 1M input tokens while zephyr-7b-beta costs $0.15 per 1M input tokens, making zephyr-7b-beta 1% more affordable for input. However, llama-3.1-8b-instruct-fp8 may offer different capabilities or performance characteristics that justify the price difference.

How does llama-3.1-8b-instruct-fp8 pricing compare to the average chat model?

llama-3.1-8b-instruct-fp8 input pricing is $0.15 per 1M tokens, which is 70% below the median of $0.50 for chat models. It ranks 613 out of 2661 chat models by input cost, making it cheaper than 77% of models in this category. For output, it costs $0.29 per 1M tokens compared to the median of $1.44.

What makes llama-3.1-8b-instruct-fp8 different from other Cloudflare models?

Among Cloudflare's 52 chat models, llama-3.1-8b-instruct-fp8 ranks 17 by input cost.

What are the best alternatives to llama-3.1-8b-instruct-fp8?

The most comparable chat models to llama-3.1-8b-instruct-fp8 are: zephyr-7b-beta from Anyscale ($0.15/1M input tokens); gemma-7b-it from Anyscale ($0.15/1M input tokens); Llama-2-7b-chat-hf from Anyscale ($0.15/1M input tokens); Meta-Llama-3-8B-Instruct from Anyscale ($0.15/1M input tokens). These alternatives were selected based on similar capabilities, pricing, and provider diversity. You can compare any of these models in detail using the Bifrost Model Library.

How do I calculate llama-3.1-8b-instruct-fp8 costs?

llama-3.1-8b-instruct-fp8 is priced based on input and output tokens. Use the interactive calculator at the top of this page to estimate costs for your specific workload. Enter your expected input and output tokens volume and the calculator will show the total cost breakdown. For reference, processing 1M input tokens costs $0.15 and generating 1M output tokens costs $0.29.