• Capybara_mdp@reddthat.com
    link
    fedilink
    English
    arrow-up
    5
    ·
    14 hours ago

    When- they don’t have “stubbornness“- they have a weights set (a weighted probbility table) and a training model (a text file filled with compressed text coordinates) that the llm cant write to to give positive feedback to the weights. It’s less of a matter of “convincing“ and more of an issue of “making the resulting statement logically concurrent with the probability table thats inbuilt into the system by injesting stack overflow vote talley, reddit posts voted most popular” - that makes it hard to “convince”. Since making those weights is very expensive (an energy intensive), the developers usually incorporate the old model into the new one. TLDR: yet again, lazy programming, google up: the y2k date folks in the 70’s.

    • Snowclone@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      7 hours ago

      another point. the ‘diversity’ in the system is running the model 10k times within the same model, that’s like saying you have a brain trust of 10k experts, except it’s just 10k copies of Gary. they seriously lack creative skills and abstract thought processes because they’re a very complex monoculture with no diversity in the models. and the reason that don’t have 10k unique models running is because that would be incredibly complicated and time consuming and this is a product to sell, not a need being filled.