Scaling Inherently Interpretable Language Models
Interpretability is often treated as a tax on capability: language models are trained as opaque systems, then explained after the fact, with methods whose reliability is difficult to establish. In...
arxiv.org