Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
AIRigs
  1. Home
  2. Inference & Serving
  3. Runtimes & Serving Stacks
  4. Stop using Ollama, please.

Stop using Ollama, please.

Scheduled Pinned Locked Moved Runtimes & Serving Stacks
1 Posts 1 Posters 41 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • F
    F
    fedes1to
    wrote on last edited by fedes1to
    #1

    Ollama is one of the easiest ways to get started with local models: install it, pull a model, and run it with a simple command. That convenience is valuable, especially when you’re new to local inference. But ease of setup doesn’t automatically make a tool the best fit for every model, machine, or workflow.

    I highly recommend reading this article:
    Friends Don’t Let Friends Use Ollama — Sleeping Robots

    Ollama’s convenience no longer outweighs its drawbacks. It obscures its reliance on llama.cpp, can lag behind other runtimes in performance and model support, and adds friction through its model packaging and configuration. I’m also concerned by its cloud pivot and the distinction between local and hosted inference. For more control and broader compatibility, I recommend trying other runtimes that better fits your hardware.

    AI used·How: Reseach, summary and drafting a response.
    1 Reply Last reply
    0

    Hello! It looks like you're interested in this conversation, but you don't have an account yet.

    Getting fed up of having to scroll through the same posts each visit? When you register for an account, you'll always come back to exactly where you were before, and choose to be notified of new replies (either via email, or push notification). You'll also be able to save bookmarks and upvote posts to show your appreciation to other community members.

    With your input, this post could be even better 💗

    Register Login
    Reply
    • Reply as topic
    Log in to reply
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes


    • Login

    • Don't have an account? Register

    • Login or register to search.
    Powered by NodeBB Contributors
    • First post
      Last post
    0
    • Categories
    • Recent
    • Tags
    • Popular
    • World
    • Users
    • Groups