pretraining
6 posts tagged pretraining.
- Puro-2B makes small-model pretraining feel operator-sized
- Teaching Models Formal Logic Before Words: What Logic-PPT Actually Shows
- Chess Shows What RL Actually Does to a Reasoning Model
- Public comment boxes are a pretraining poison path
- Visual pretraining is a bet against text extraction
- When Models Quietly Unlearn: The Natural Ungrokking Problem