Token Harbor’s cache drop: is it fixed yet?

Token Harbor's cache drop: is it fixed yet? - 1,890 raw API calls, 2 cache field drops (0.11%)
この記事は約8分で読めます。

Token Harbor’s pricing page now estimates 4.9k+ requests for DeepSeek V4.1 Flash, up from 2.3k+. I re-ran the input cache test I published last month, using this provider alone. Across 1,890 raw API calls, the cache field dropped 2 times (0.11%).

Key Takeaways

  • The drop rate fell: 2 of 1,890 calls lost the cache field (0.11%), versus 11 of 490 (2.24%) before
  • Both drops clustered: they hit 7 and 21 minutes after the run started, and the next 1,667 calls had none
  • The page estimate doubled, but so did its assumption: 8K of the 10K input is now counted at the cache rate
  • Cold requests still hide the gap: the API omits the field entirely rather than returning cached_tokens: 0

The drop rate is now 0.11%

The main numbers first.

  • 2 of 1,890 calls lost the cache field (0.11%)
  • The same condition last month was 11/490 = 2.24%, and the confidence intervals do not overlap
  • Both drops landed early in the run, with 0 of the next 1,667 calls dropping
  • Cold requests still omit the field, so a drop looks identical to a cold miss

The pricing page number is not a plain 2x

The pricing page’s “estimated requests” now lists 4.9k+ for DeepSeek V4.1 Flash, up from 2.3k+. The assumption behind it changed at the same time. It now counts 8K of the 10K input at the cache rate, so this is not a doubling of usable volume.

The previous test

Last month I compared two providers and found that only one of them dropped the cache field.

What changed this time is the scope. I dropped the comparison and measured tokenharbor-p alone.

Conditions

ItemValue
Date2026-11-07
Targettokenharbor-p / deepseek-v4.1-flash
ClientPython 3.14 urllib (raw HTTP)
Shared prefixabout 29,200 chars / prompt_tokens 6,688–6,690
max_tokens8
Total calls1,890

The 6.7k-token prefix kept the total bill at about $0.13 despite 12.64M input tokens. I did not retest with a large prefix.

Results: 2 drops out of 1,890 calls

ConditionnDropsMedian
Same prefix 150 (sleep 1.5)15012.22s
Same prefix 200 (sleep 1.0)20012.31s
developer role 404002.06s
Same prefix 200 (sleep 1.0)20002.16s
Stream 100 (sleep 1.0)10001.93s
Same prefix 400 (sleep 0.6)40002.31s
Burst 200 (sleep 0)20001.93s
Soak 600 (sleep 0.8)60002.04s
Total1,89022.13s
  • Drop rate 0.11% (95% CI 0.03%–0.39%)
  • Previous same-prefix run was 11/490 = 2.24% (95% CI 1.26%–3.97%)
  • The intervals do not overlap, so the rate is lower

Whenever the field was present, cached_tokens came back as 6,656 almost every time. The prefix was identical, so a working cache yields the same count.

Both drops clustered in 20 minutes

TimeLatencyUsage keys returned
Start +7 min51.14sprompt_tokens / completion_tokens / total_tokens
Start +21 min51.87ssame as above

Neither prompt_tokens_details nor cache_read_input_tokens was present. The field is removed entirely rather than returned as cached_tokens: 0.

Both drops fell inside the first 20 minutes of the run. The 1,667 calls after the second one had no drops, so this is not constant.

Cold requests still behave the same

Five calls with a unique prefix each returned no cache field at all.

RunCache fieldLatency
1none1.64s
2none1.61s
3none2.12s
4none2.16s
5none2.45s

An explicit cached_tokens: 0 appeared zero times again. A cold miss and a dropped field are still indistinguishable from the JSON alone.

pi reads a missing field as cacheRead = 0, so a drop shows the whole input at full price. That display problem is still unfixed on the provider side.

The response headers offer no hint

As of 2026-11-08 the headers carried a routing decision.

x-th-route-decision  {"model":"deepseek-v4.1-flash","tier":"low","cache_hit":false}

cache_hit was false on both hits and cold calls. It cannot be used to detect a drop.

Summary

  • The pricing page lists 2.3k+ → 4.9k+ estimated requests for DeepSeek V4.1 Flash
  • The assumption changed too (8K counted at the cache rate), so it is not a plain 2x
  • Across 1,890 calls against tokenharbor-p alone, the cache field dropped 2 times (0.11%)
  • The rate is below the previous 2.24%, with non-overlapping confidence intervals
  • The drops are not zero, and cold requests still cannot be told apart

コメント

タイトルとURLをコピーしました