Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> This is a bit of a strawman. The parent comment wasn't suggesting that the inherent defects magically disappear

The parent comment literally said that the common LLM defects would go away.

Direct quote:

> all of the common LLM defects will go away



Clearly it was meant that they will go away only if you use a custom harness, without the defects that now exist in all vendor-controlled harnesses, because of the non-aligned goals of the vendor and of the user.

While it was not spelled explicitly, it should be obvious that nothing can be improved if you run locally an LLM in the same way as the vendor. But you should not do that. It is easy to use better methods for sampling procedures and for prompt and context handling.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: