AI Rate Card

How to save on prompt caching and batch requests: a calculator with live prices

Updated Nov 7, 2026

Two levers cut an AI API bill without changing the model. Prompt caching: when the start of your prompt repeats - a long system prompt, a document, tool definitions - many sellers charge the repeated part at a lower "cache read" price. Batch and flex: if the answer can come minutes or hours later, some sellers sell the same model cheaper as a batch or low-priority (flex) offer. The cache and batch calculator shows what both do for your volume, at every seller of the model.

How to use the calculator

  1. Model id. Copy it from the model's page - it is under the name, for example anthropic/claude-sonnet-5-5.
  2. Input and output tokens a month. Your monthly volume; the token counter on /tools helps if you only know requests and text length.
  3. Share of input read from cache. The part of each prompt that repeats exactly from one request to the next. A chatbot with a 3,000-token system prompt and 1,000-token questions is about 75%; a RAG answer over fresh documents is near 0%.
  4. The job can wait. Tick it when the results are not needed in real time - nightly reports, classification, evaluation runs. Then the seller's batch / flex offers are counted too.

The table lists every seller: the plain price, the price with the cache (where the seller publishes a cache-read price), and what you pay - the lower of the two.

Two examples from today's prices

What the calculator does not count

← Articles