Where do you guys get deepseek? I'm hearing a lot of good reviews and want to try it with my pi config. from the deeepseek themselves, openrouter, or anywhere else? does it make a difference?
[edit]: whoa it is really fast. will take some time to evaluate quality thou
For hosted APIs, it's a lot cheaper to use their own infra, caching seems a hell of a lot better there compared to OpenRouter, and indeed the tok/s seems higher. They also have peak/off-peak pricing, so if you can hold off with your request, you get a pretty big discount.
Otherwise, if you're trying to run it locally, even really low quantizations like DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix seem to actually not be so dumb compared to smaller models with same quantization, might be worth a try if you're sitting on a lot of RAM/VRAM yet not industry-scale amount :)
Opencode-go gives you $60 worth of DS V4 api usage for $10 per month. Right now I think it's hard to exhaust that when using flash exclusively, and plain API use might even be cheaper! Anyway, for DS usage it's a good deal.
Opencode also have a ZDR (zero data retention) deal with them – if I recall correctly, that's not something you can enable as an individual DeepSeek subscriber.
I really like OpenCode - BUT: there is a loophole the size of Portugal in that ZDR language. All they say is that their providers follow a ZDR policy. I haven’t found anything promising that OpenCode themselves don’t retain Go usage data. Something to be mindful of.
Anecdotal data from my own tests: allow only one provider if you want good cache usage on OR. 80 cents is probably 4x the price you should have paid.
Providers' cache hit stats are available to consult, and only 1-2 of them behave properly if I remember correctly, zero if you request providers that don't store and train on sessions.