Businesspublished

Fable Cache Becomes Cheaper After 24 Reuses When Gemini Misses

The pricing crossover is real for repeated input, but it rests on stable prefixes, closely timed Fable requests and a low enough Gemini implicit-cache hit rate. Output tokens can still decide the actual bill.

By 4 min read
Fable Cache Becomes Cheaper After 24 Reuses When Gemini Misses
Fable Cache Becomes Cheaper After 24 Reuses When Gemini Misses

Listen to this story

The audio brief

About 1:35
0:001:35
Read transcript
Fable’s explicit cache can beat Gemini 3.8 Flash on repeated prompts—but only after 24 successful reuses with the five-minute option, or 39 with the one-hour option. That result assumes Fable writes the cache once, every Fable reuse hits, and Gemini’s implicit cache misses every time. The pricing starts sharply in Gemini’s favor: standard input costs seventy-five cents per million tokens, while cached input costs seven and a half cents. Fable charges twelve dollars and fifty cents per million tokens to create a five-minute cache, twenty dollars for one hour, then twenty-five cents per million tokens for each hit. So Fable pays back its expensive write only through frequent, repeated reads. The comparison is narrower than a full workload. It holds the repeated prefix constant and excludes output and changing suffixes. That matters because Fable output costs fifty dollars per million tokens, versus three dollars and seventy-five cents for Gemini. The crossover also depends on cache behavior. Fable can reuse prefixes as short as 512 tokens; Gemini requires 4,096. Fable’s five-minute window refreshes on a hit, but generation time counts against it, and a changed prefix creates a new entry. If Gemini caches at least 74.074 percent of reuse tokens, Fable never becomes cheaper under this single-write model. The practical question is therefore empirical: measure cache-hit metadata, prefix changes, request intervals, and output tokens before switching providers.

Story brief

3 key points

Fable’s explicit caching only undercuts Gemini 3.8 Flash in a narrow, repeat-heavy scenario: Gemini must miss on more than 25.926% of reuse tokens, while requests must arrive within Fable’s five-minute or one-hour window and preserve the prefix. Fable’s break-even points are 24 reuses for the five-minute cache and 39 for the one-hour option, assuming one successful write. The comparison excludes output and changing...

  1. 01

    Gemini’s cached-input rate is $0.075 per million tokens versus Fable’s $0.25 hit price.

  2. 02

    Gemini’s implicit cache requires 4,096-token prefixes; Fable can cache repeated prefixes from 512 tokens.

  3. 03

    Fable’s five-minute cache refreshes on hits, but generation time consumes the five-minute retention window.

Fable’s cache can become cheaper than Gemini 3.8 Flash for a repeated prompt, but only after many successful Fable hits and frequent Gemini misses. With equal billed prefix-token counts, 24 Fable reuses beat Gemini with no Gemini cache hits; the one-hour Fable option requires 39. This isolates repeated input, not the cost of a complete AI workload.

The comparison starts with two very different pricing structures. Through December 31, 2026, Fable 5.1 charges $12.50 per million tokens to create a five-minute cache, $20 for a one-hour cache and $0.25 for each cache hit. Gemini 3.8 Flash charges $0.75 per million standard input tokens and $0.075 for cached context.

Fable therefore begins at a steep disadvantage, then benefits from a low read price. If every Fable reuse hits while every Gemini reuse is billed as standard input, one five-minute Fable write plus 24 reads costs less than Gemini’s initial request and 24 reuses. The higher-priced one-hour write reaches that point at 39 reuses.

Prompt length does not change those thresholds once both services can cache the same prefix: the calculation is per million repeated-prefix tokens, so equal token counts cancel out. That simplification excludes output and any changing prompt suffix, which are separate billable components.

The zero-hit case is deliberately harsh on Gemini. Its documented cached-context rate is already lower than Fable’s $0.25 read price. The pivotal question is whether a request receives that rate. Gemini enables implicit caching by default on newer models and returns cache-hit tokens in response usage metadata, but Google does not guarantee a hit for similar requests.

At a Gemini cache-hit fraction of 74.074% or more of reuse tokens, Fable never becomes cheaper under the model’s single-successful-write assumption. Gemini’s expected marginal reuse price then reaches $0.25 per million tokens or less, matching or beating Fable’s read price while Gemini retains the cheaper initial input.

Below that boundary, there is no single crossover point. For a Gemini hit fraction h below 74.074%, the minimum Fable reuse count is floor((W-0.75)/(0.5-0.675h))+1. W is 12.50 for the five-minute Fable write and 20 for the one-hour version. This is a price equation, not a forecast of Gemini’s cache performance in a particular application.

Three constraints behind the crossover

  • Eligibility matters first. Fable can cache repeated prefixes from 512 tokens, while Gemini 3.8 Flash implicit caching requires at least 4,096 tokens. Between those limits, Gemini cannot record an implicit-cache hit.
  • Fable needs continuity. A five-minute cache hit refreshes the entry without another write, but a request after expiry requires another costly write. If every request arrives after expiry, Gemini is cheaper even with no Gemini cache hits.
  • The prefix must remain stable. Fable caches the complete prompt prefix through its breakpoint, so a change at or before that point creates a different cache entry.

Fable’s default cache lifetime is five minutes, measured from the start of the request that writes or reads the entry. Generation time counts against that window. A long-running response can leave little time for the follow-up request needed to preserve the low-read sequence. The one-hour setting extends the window, but its $20 write charge explains the later 39-reuse crossover.

Gemini’s documented 24-hour implicit-cache retention is an upper retention limit, not a hit commitment. Google advises sending similar prefixes within a short interval. That makes Gemini’s economics potentially better for distributed reuse, but the rate card alone cannot convert the longer retention period into guaranteed savings.

The analysis cannot identify the cheaper application overall. Fable output costs $50 per million tokens, versus $3.75 for Gemini 3.8 Flash. A workload that generates substantial text can erase any savings from its repeated prompt prefix, even if Fable wins the narrow cache calculation.

The practical test is a token and timing audit. Anthropic’s Usage and Cost API separates uncached input, cached input, cache creation and output tokens at the organization level. Gemini reports cached tokens in response metadata. Those measurements, plus the size of changing suffixes and the interval between requests, determine whether either provider’s cache economics hold in production.

Editorial analysis

Our Read

This is a useful reminder that cache pricing is really an application-design question. Fable gives developers direct control over the cache point and a very cheap successful read, but only a product with bursts of stable prompts can exploit that structure. Gemini’s automatic caching is less controllable from the application side, yet its lower cached-input price makes hit measurement essential. The next meaningful evidence is a production reconciliation of cache creation, reads, uncached input and output tokens, paired with request timing. Anthropic already exposes those categories through its organization-level usage tools; Gemini exposes cached-token counts in individual responses.

Citation desk / original work

Cite this

Permanent attributionView citation
Finding 01

This is a useful reminder that cache pricing is really an application-design question.

/posts/fable-cache-becomes-cheaper-after-24-reuses-when-gemini-misses#finding-1

Sources

  1. ai.google.devGemini Developer API pricing  |  Gemini API  |  Google AI for Developers
  2. platform.claude.complatform.claude.com
  3. ai.google.devContext caching  |  Gemini API  |  Google AI for Developers
  4. platform.claude.complatform.claude.com
  5. platform.claude.comUsage and Cost API