This is a great paper. Between this, the categorical jacobian paper, the transfer learning paper, and the species bias paper, it's been a great year for explainability studies of PLMs and the effects of scale on their performance

My only regret is that I don't understand influence functions -at all- and can't appreciate that component of this study