Please don’t use Ollama.

https://sleepingrobots.com/dreams/stop-using-ollama/

Doesn't Ollama use llama.cpp so their point stands even if they used it directly?

No, because Ollama is buggy. The first step to answering GPC’s question is to try using an up to date llama.cpp.

lol jealous hater

Huh?

Thank you!

afaik ollama relies on llama.cpp and mmap. mmap loads pages on demand and doesn't use the same explicit cache or parallel reads like my engine. Most likely ollama/llama.cpp will be way slower in this case