Skip to content
{
ken ashe
}
Building
Topics
Blog
Building
Topics
Blog
←
Blog
/
Tags
// tag
transformers
5 posts tagged
transformers
.
Sparse Weight Decomposition makes circuit extraction less expensive
Aug 5, 2026
Depth breaks rank before it breaks loss
Jul 16, 2026
Transformer circuits may be lower-dimensional than they look
Jul 14, 2026
PEHT makes traffic forecasting less about bigger Transformers
Jun 29, 2026
Tapered Language Models and the Free Lever in Layer Width
Jun 23, 2026