I find it hard to understand why nobody in this thread considers that the current pricing might still be below cost. The discount was supposed to end on May 5, and then shortly after that they extended it to May 31. They clearly made a judgment call there, rather than treating it as a desperate loss-leader.
If you have actually used DeepSeek, you would notice that the cache-hit rate is extremely high, and the cache invalidation window is much longer than every other provider's. That suggests DeepSeek is simply much better at utilizing its infrastructure than other vendors.
I am also highly skeptical that the average user's input is worth more than the API cost of processing it. Do people really think DeepSeek researchers enjoy panning for gold in a river of boilerplate and half-baked code?
DeepSeek's KV cache is tiny compared to other open weight models. This actually makes very large inference batches viable even on consumer hardware, even when resorting to SSD offload for weights. Once support is added to the main inference frameworks, it should be an absolute game changer for SOTA local inference.
If you have actually used DeepSeek, you would notice that the cache-hit rate is extremely high, and the cache invalidation window is much longer than every other provider's. That suggests DeepSeek is simply much better at utilizing its infrastructure than other vendors.
I am also highly skeptical that the average user's input is worth more than the API cost of processing it. Do people really think DeepSeek researchers enjoy panning for gold in a river of boilerplate and half-baked code?