Language models naturally organize concepts into hierarchical categories

Original: LLMs represent concepts as vectors. Strikingly, taxonomies (organism → animal → bird) appear as hierarchies in embedding space. Led by my student @AndresNava, we show this comes from co-occurrence sta

Source: arxiv.org ↗