Hacker Newsnew | past | comments | ask | show | jobs | submit | cmcollier's commentslogin

I'm curious to know what proportion of the training data at frontier model shops is composed of their scanned book text vs the internet.


this is a good question, and I wonder if its even open to the public. My limited knowledge knows that Anthropic settled a lawsuit of I believe ~1.3billion for scanned textbooks if I'm not mistaken.


One would hope that a "public benefit corporation", such as OpenAI, would be transparent about the stuff that is being ingested by sausage factory. The literal legal entity is about benefiting the public after all.

Since the leadership is obviously not going to say anything factually true or psychologically honest, I wonder if anyone has tried invoking some aspect of corporate or constitutional law, given their legal status (as nonprofit that controls a PBC) to force such disclosures.


Tinkering and thinking about the hacker news data in relation to some machine learning ideas.

Here's my data and search engine with all the HN data:

* https://orangewords.com/


https://orangewords.com

Orange Words. My hobby project, a hacker news search system. It was initially created by hand and now I use AI augmented development. It's a good low risk environment for experimenting.


Working on small improvements to my hacker news search engine:

- https://orangewords.com


Ah, so this is why I suddenly got a bunch of email.

Hey all, site owner here. Thanks for the visits and all the fun stories! I really miss this era of computing. Feel free to let me know if you have something that should be added to the site.

Here's some site meta-history too:

https://telnet.org/history/


Cool site! I especially like the list of RFCs.

Just fyi, towel.blinkenlights.nl:23 still works for me, though I think maybe that's an IPv6 version, there's a note about ipv6 at the start that I was too slow to read. Maybe it should be re-listed? :)


Thanks! I did notice there are mixed stories about it working, and I got some email about it too. I'll check it out and make an update.


it's possible one of those emails might have been from me ;)


There's a lot of potential here. I'm hopeful this turns out well for the community of Abilene.


Writing code that runs down hole or otherwise connects back to the real world would be fun. Maybe I should pickup firmware skills. Good luck with your hiring!


It is a ton of fun! I've been hooked for years!


For Vespa there's a managed version hosted by the Vespa company in their cloud environment, and then the open source version is easily run locally or in any environment of your choosing. It takes some attention to detail, but it's quite flexible. I have a long running single node instance on an Intel NUC, but I've also run more complex cluster variations across different cloud environments.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: