Bluesky Thread

there are reports that anthropic does this — serves a reduced quant under hig...

View original thread
there are reports that anthropic does this — serves a reduced quant under high load
tweet from @_xjdr:

you should legally be required to disclose what quantization level you are serving your current model at like it was a nutrition label. you should also be banned from dynamically adjusting quantization based on demand without notification. (you know who you are ...)
24 1
i guess claude really does get tired
7
3 hours later
frog with the reputation rescue, sort of
doomslide & @doomslide • 49m
• • •
It pains me to say this but Anthropic has a significantly more sophisticated approach to RL compared to any other lab right now. A lot of it is unfortunately overshadowed by iffy practices and silly optimization targets like e.g. engagement metrics on safety blogging.
3
24 likes 1 reposts

More like this

×