Where would the control come from? Software installed on the client's computer, or software installed connecting to an AI agent, or something else, something more external, something more interactive?
Yes, we install a small piece of software on their computers because we also separately control GUI of legacy windows apps. But we also need to control web based apps as well.
I wonder if this is willful sabotage on the part of the model. In other words, if you ask the model to craft a defense for a morally questionable case, will the model execute the defense in good faith? Or will it apply a training or system prompt bias in subtle ways?
Context compaction? I noticed llm seem to forget partially or completely the original task when context compaction happens. The problem is more serious with local llm with low context size.
LLMs bleed context from the conversation/attachments into the output. This has always been a problem with no real solution other than some crafty iteration/loops.
Sadly there's not much credibility for any participant in this industry. There's simply to much financial entanglement to take any statement at face value.
So... No. Even if he means what he's saying, it's irresponsible of us not to consider his possible motivations.
reply