Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Are you buying from a provider that isn't listed on open router already

I am using openrouter with zdr guardrail which routes to any provider that supposedly doesnt train on user data. I also use fireworks (directly, not via openrouter) which is a provider promising zdr and has a bunch of open weights models. My issue is that these zdr providers dont transparently disclose caching/tokens etc and so they end up being far more expensive than directly using DS.



Have you tried Novita? They're zdr and I find they usually have better cache hit rates than fireworks. No affiliation.


Thanks for the input. Let me check it out.


> OpenRouter has taken the stance that in-memory caching of prompts is not considered “retaining” data, and we therefore allow endpoints/models with implicit caching to be hit when a ZDR routing policy is in effect. [0]

OpenRouter doesn’t list DeepSeek as ZDR combined with Caching. Thanks for the tip of Fireworks as Fireworks has Zero Data Retention by default. [1]

[0] https://openrouter.ai/docs/guides/features/zdr

[1] https://docs.fireworks.ai/guides/security_compliance/data_ha...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: