Why neural network features get stuck and never activate

Original: On the Relationship Between Activation Outliers and Feature Death in Sparse Autoencoders

Source: arxiv.org ↗