Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • robber@lemmy.ml
    link
    fedilink
    English
    arrow-up
    4
    ·
    4 hours ago

    I currently run Qwen3.6-27b on llama.cpp and use it via openwebui. Mostly, I use it for web research via tavily, to a lesser extent for coding and interactively learning about things that are new to me but common in training data (such as basic math or ML concepts).