Same, getting ~3 trillion parameters in consumer hardware is rough.
If Nvidia has any foresight they’ll see the writing on the wall and start getting higher memory Spark style SMB inference machines, few people in the long run are going to pay retail API token costs,
Same, getting ~3 trillion parameters in consumer hardware is rough.
If Nvidia has any foresight they’ll see the writing on the wall and start getting higher memory Spark style SMB inference machines, few people in the long run are going to pay retail API token costs,
Especially giving the lack of trust organizations rightfully have in big AI companies
Exactly, having the mustard toddler pull fable because of, who knows? That burned trust in the west’s AI companies.
And there is also the question of what they’re doing with the data you send into the models.