• blackbeans@lemmy.zip
    link
    fedilink
    English
    arrow-up
    32
    ·
    3 months ago

    Personally, I find myself using the Chinese alternatives more and more as they are just way cheaper.

    • abbadon420@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      27
      arrow-down
      4
      ·
      3 months ago

      The good thing is that a deepseek can be run locally relatively well with consumer hardware. I trust chinese companies as much as i trust american companies with my data and my prompts.

        • De Lancre@lemmy.worlddeleted by creator
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          edit-2
          3 months ago

          You don’t need 170+ GB of VRAM. Whole model can be run at around 1 token/second on a modern hardware from an ssd. Which is slow, don’t get me wrong, but it still somewhat useable.

          Upd.Once again, for those who use AI because struggles to read: it is slow, but it is usable. Which is, by definition, means that you don’t need 170+ GB of VRAM to run this model. Period. It runs from ssd. That is a fact.

    • mesa@piefed.social
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      3 months ago

      Theres a lot of good models free online that are open source/Chinese and the only cost is a bit of slowness on my rig. No token limit or whatever. Totally agree.

      Its about as good as commercial products now…