We could make LLM inference 100x cheaper to run at home efficiently, but that so... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

ttoinou 41 days ago | parent | context | favorite | on: Kimi-K3 on HuggingFace

We could make LLM inference 100x cheaper to run at home efficiently, but that solution might need to be updated every 1-2 years, whereas current GPU are useful for various others tasks and last longer

nektro 40 days ago [–]

> We could make LLM inference 100x cheaper to run at home efficiently

do you genuinely think that's going to happen?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact