Reducing language model entropy makes writing more generic, not more diverse

Original: @dejavucoder no, I tried un-collapsing entropy and it made a model more generic in writing voice - just more widely distributed. base models memorize cliches for the same reason they are cliches

Source: x.com ↗