AI Rate Card

Llama-3.1-8B-Instruct vs GPT OSS 120B: API price and specs

Llama-3.1-8B-Instruct is 26% cheaper than GPT OSS 120B on input price.

Llama-3.1-8B-Instruct is 80% cheaper than GPT OSS 120B on output price.

Llama-3.1-8B-Instruct is 48% cheaper than GPT OSS 120B on a 1M-in / 200k-out workload.

Llama-3.1-8B-Instruct has a 52.6% larger context than GPT OSS 120B.

FieldLlama-3.1-8B-InstructGPT OSS 120B
Lowest input, per 1M$0.02$0.027 +35%
Median input, per 1M$0.0211$0.15 +610.9%
Lowest output, per 1M$0.02$0.098 +390%
Median output, per 1M$0.05275$0.60 +1037.4%
Lowest unit price$0.0015 / request—
Cost of 1M in + 200k out$0.024$0.0466 +94.2%
Context200K131K +34.5%
Max output131K131K
Providers16 +62.8%43
RegionsEU, GLOBAL, USEU, GLOBAL, US
Acceptstextfile, text
Returnstexttext
TypeText modelsText models
Free optionnoyes
Cheapest provideraihubmixkilo

Your own workload: how many tokens the model gets (input) and gives back (output) - for example, in a month. The "Cost" row of the table above is recalculated for these numbers, for each model.

Computed from current offers each time the page opens; the best value of a row is bold, the percent is how far behind the best.

Providers selling both

aihubmix, cloudflare-workers-ai, cortecs, deepinfra, edenai, fastrouter, helicone, huggingface, jiekou, kilo, novita, openrouter, poe, requesty, trustedrouter, vercel

Frequently asked questions

Which is cheaper, Llama-3.1-8B-Instruct or GPT OSS 120B?

Llama-3.1-8B-Instruct is 26% cheaper than GPT OSS 120B on input price. Llama-3.1-8B-Instruct is 80% cheaper than GPT OSS 120B on output price. Llama-3.1-8B-Instruct is 48% cheaper than GPT OSS 120B on a 1M-in / 200k-out workload.

Which has the larger context, Llama-3.1-8B-Instruct or GPT OSS 120B?

Llama-3.1-8B-Instruct: 200K tokens; GPT OSS 120B: 131K tokens.

Where can I use both Llama-3.1-8B-Instruct and GPT OSS 120B?

aihubmix, cloudflare-workers-ai, cortecs, deepinfra, edenai, fastrouter, helicone, huggingface, jiekou, kilo, novita, openrouter, poe, requesty, trustedrouter, vercel