Llama-3.1-8B-Instruct vs Hermes 2 Pro Llama 3 8B: API price and specs

Llama-3.1-8B-Instruct is 86% cheaper than Hermes 2 Pro Llama 3 8B on input price.

Llama-3.1-8B-Instruct is 86% cheaper than Hermes 2 Pro Llama 3 8B on output price.

Llama-3.1-8B-Instruct is 86% cheaper than Hermes 2 Pro Llama 3 8B on a 1M-in / 200k-out workload.

Llama-3.1-8B-Instruct has a 52.6% larger context than Hermes 2 Pro Llama 3 8B.

Field	Llama-3.1-8B-Instruct	Hermes 2 Pro Llama 3 8B
Lowest input, per 1M	$0.02	$0.14 +600%
Median input, per 1M	$0.0211	$0.14 +563.5%
Lowest output, per 1M	$0.02	$0.14 +600%
Median output, per 1M	$0.05275	$0.14 +165.4%
Lowest unit price	$0.0015 / request	—
Cost of 1M in + 200k out	$0.024	$0.17 +600%
Context	200K	131K +34.5%
Max output	131K	131K
Providers	16	3 +81.2%
Regions	EU, GLOBAL, US	—
Accepts	text	text
Returns	text	text
Type	Text models	Text models
Free option	no	no
Cheapest provider	aihubmix	helicone

Your own workload: how many tokens the model gets (input) and gives back (output) - for example, in a month. The "Cost" row of the table above is recalculated for these numbers, for each model.

Computed from current offers each time the page opens; the best value of a row is bold, the percent is how far behind the best.

Providers selling both

helicone, novita, trustedrouter

Frequently asked questions

Which is cheaper, Llama-3.1-8B-Instruct or Hermes 2 Pro Llama 3 8B?

Llama-3.1-8B-Instruct is 86% cheaper than Hermes 2 Pro Llama 3 8B on input price. Llama-3.1-8B-Instruct is 86% cheaper than Hermes 2 Pro Llama 3 8B on output price. Llama-3.1-8B-Instruct is 86% cheaper than Hermes 2 Pro Llama 3 8B on a 1M-in / 200k-out workload.

Which has the larger context, Llama-3.1-8B-Instruct or Hermes 2 Pro Llama 3 8B?

Llama-3.1-8B-Instruct: 200K tokens; Hermes 2 Pro Llama 3 8B: 131K tokens.

Where can I use both Llama-3.1-8B-Instruct and Hermes 2 Pro Llama 3 8B?

helicone, novita, trustedrouter