Embedding layer learning rate drives hyperparameter transfer at scale

Original: Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate

Source: arxiv.org ↗