No. Prefix caching is just an optimisation on the server side. What Kimi CLI does is insert <system> tags that include a checkpoint marker with an id.
The model is then given a tool that allows the model to decide to roll back to a checkpoint + a message containing any additional useful information.
It's specifically instructed to use that tool[1] in cases like when it has inadvertendly read a large file where most of the content is not relevant to the task, or after a web search where it's found what it's looking for but most of the content isn't needed, or when it's written code that didn't work as expected, or similar.
It basically lets the model backtrack and "forget" irrelevant details at the end of the context but give itself hints on how it should continue from the checkpoint.
Though, interestingly they seem to be abandoning it in their new CLI (kimi-code), unless it's been folded into other functionality. Not sure if they just feel it's not needed any more with their newer models or if it just didn't work as well as they expected.
Prefix caching automatically detects priorly read tokens -> more fained grained checkpoints then. With prefix caching you don't have to ask for a checkpoint, its automatic.
One way or the other, a prefix is saved. Only the additional info how to continue is new.
Are you able to just re-run the data for the timeframe, or is "fixing it" a more manual process? And what observability are you working with into the process?
Them you are free to not install them? Why ban them outright?
I'm using https://github.com/cjpais/Handy whichseems to be doing exactly what this app does, and has a very similar background story (author couldn't type die to injury).
In this case it feels like it's a feature that the operating system should be providing or something that could be marked as an accessibility tool, which would allow it to use that API.
The problem from Apples perspective could be that there is a ton of tools that require access to the accessibility API because they want to do stuff that Apple have deemed a security risk and the only way to do it is by abusing the API. Some of these are also because macOS simply lacks certain APIs.
I think Apple overreacting due to previous API misuse by other apps.
"In their defense, the OS is even more insane with mandatory forced application updates that you have no control of". I hope I won't ever happen to have you representing me as a defense attourney!
I see, that's a really fair point. And I can understand that banking field example. So I can see why they're guarding against it. My disagreement was less with the rule itself and whether Whisperpad's specific use case for users with mobility needs falls on the right side of it.
Most streaming services commission their own content, yes, but they do so to market original content - Netflix Originals don't pretend to be Wes Anderson movies, and get slid into your playlist when you aren't looking
So if they played a short annoncement beforehand so people know its an Original, it would be fine? Originals get advertised heavily, next-movie, so I assume putting it in the same playlist is fine.
Amazon Originals, Netflix Originals. Disney Originals. Paramount Originals. I'm just wondering what is different between series and music, that for music its very bad morally to create your own and to put your own in the front row. While for other streaming its accepted.
One big difference is that these shows and movies are not "ghost," they credit their crew and talent like any other production, and those folks negotiate their pay rates similar to other productions. If you are a grip on a Netflix original movie, you will get listed in the credits like any other movie.
The other big difference is that TV and movie productions have always been "assemble when needed." Production companies are typically very thin business shells who hire in 99% of what they need per show. As opposed to a band or artist like Taylor Swift or The Rolling Stones, where the core persistent business unit is the talent itself.
> One big difference is that these shows and movies are not "ghost," they credit their crew and talent like any other production, and those folks negotiate their pay rates similar to other productions. If you are a grip on a Netflix original movie, you will get listed in the credits like any other movie.
The only reason is because unions in the movie business negotiated this. That's it.
There are no unions of note in the music business, and artists get shafted left and right.
The difference is how they're consumed you don't sit down on Netflix and say "put some scifi on shuffle for 8h", you sit down and choose a show.
If you're the kind of person who would manually queue up 100% of your songs for the day then Spotify Generic songs aren't an issue. If you just hit a "2020s R&B" playlist and go that's where it feels more sketchy.
I'd agree with this. I'll seek out work by specific bands, their members and side projects. I'll do the same for actors in film and TV but Spotify is commissioning work from session musicians I have no relationship to and offering a fictitious name. I'm sure these musicians are capable, but I'd rather discover new, novel music — not something commissioned by a company for a specific mood or playlist. That feels antithetical to what makes music or art interesting.
> This time, I tried to learn from that: facts are stored as instants, reasoning happens in local days of the jurisdiction that cares.
I think that's how the JavaScript Temporal proposal works. Convert your instant to the timezone, make the comparisons/calculations, hope you didn't jump an hour due to summertime, convert back.
i can write that in like 2 minutes in any language you want.
`pseudo
main(
return True
)`
There's a difference between "Need a tree cut down? I am licensed and bonded and cut down trees; call ###" and the sort of things that we all consider "ads". If someone can't see a difference, then that someone probably receives money from advertising.
One of the few sorts of ads I'm okay with are those sort of ads for local businesses on the paper placemats at local restaurants. Those stick around and are seen by countless people so if it's a scam word will get around.
reply