Stop using Ollama, please.
-
Ollama is one of the easiest ways to get started with local models: install it, pull a model, and run it with a simple command. That convenience is valuable, especially when you’re new to local inference. But ease of setup doesn’t automatically make a tool the best fit for every model, machine, or workflow.
I highly recommend reading this article:
Friends Don’t Let Friends Use Ollama — Sleeping RobotsOllama’s convenience no longer outweighs its drawbacks. It obscures its reliance on llama.cpp, can lag behind other runtimes in performance and model support, and adds friction through its model packaging and configuration. I’m also concerned by its cloud pivot and the distinction between local and hosted inference. For more control and broader compatibility, I recommend trying other runtimes that better fits your hardware.
AI usedHow: Reseach, summary and drafting a response.
Hello! It looks like you're interested in this conversation, but you don't have an account yet.
Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.
With your input, this post could be even better 💗
Register Login