Not sure if this goes here or if this post will be hated upon? but i want to host ai like llms and comfyuis newer models locally but im not sure what type of setup or parts would work best on a possible slim budget? im not sure either if now is the time with inflation and such.

I dont have a price in mind yet but im wondering how much it would cost or what parts i may need?

If you have any questions or concerns please leave a comment.

  • one_old_coder@piefed.social
    link
    fedilink
    Français
    arrow-up
    8
    ·
    7 hours ago

    AI said:

    To run AI models locally, you’ll need a computer with a capable CPU, sufficient RAM, and a powerful GPU

    While it’s possible to run some AI models on a laptop, a dedicated desktop setup with a powerful GPU will generally offer better performance. The cost of building a dedicated AI PC can range from around $800 for a budget build to $2,500 for a performance-oriented system

    Hope that helps /s

    • paper_moon@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      6 hours ago

      I wonder if it took into account when generating the price estimated, all the hikes in RAM pricing that it itself is causing…🤔

      Stupid fucking AI data centers…