Honestly this is a really cool idea and i am glad that there are companies being built in this space. This is closest to the vision of what i want to do next.

Great responses in this thread

I agree, i have seen a decent change in the outputs when i remember and operate it as a program instead of just random set of instructions

But that problem can be solved.

It can be solved, yes. But it almost certainly won't be, in aggregate.

I like the analogy on ways to make small model useful.

This is so cool

Wrote this sometime ago - https://aishwarya-48913.medium.com/startup-pivots-how-we-ite...

some of the learnings are not applicable anymore, but i benefited a lot from the framework we created

This looks great. going to try it

Thank you! Let me know how it goes and share your tok/s results

Short answer - stress word started feeling like a joke

which hardware?

8 Nvidia B200s. Crazy from an individual perspective, costly for a small business!