A lot has been made about the tokens being subsidized, and at the frontier models I believe that’s very true. I also believe that we’re getting to where the frontier may be better, but not necessary, in order to get value out of using the LLM - and a couple of steps back from the frontier is becoming quite affordable now.
I’d be very interested to try out a GLM-5.2 instance on about a $100K server (8 bit quantitized) - which should cost under $20K per year to operate and maintain (although with component prices inflating the way they are that number continues to climb)… if that setup is as useful as, say, Claude Opus 4.5, that’s a reasonable price level for a system that should be able to serve a department of 6-10 users pretty well. If GLM-5.2 isn’t “there yet” - it’s likely just a matter of time before one gets there.
A lot has been made about the tokens being subsidized, and at the frontier models I believe that’s very true. I also believe that we’re getting to where the frontier may be better, but not necessary, in order to get value out of using the LLM - and a couple of steps back from the frontier is becoming quite affordable now.
I’d be very interested to try out a GLM-5.2 instance on about a $100K server (8 bit quantitized) - which should cost under $20K per year to operate and maintain (although with component prices inflating the way they are that number continues to climb)… if that setup is as useful as, say, Claude Opus 4.5, that’s a reasonable price level for a system that should be able to serve a department of 6-10 users pretty well. If GLM-5.2 isn’t “there yet” - it’s likely just a matter of time before one gets there.