Benign Fine-Tuning Erodes Safety, and You Can't Tell From the Data How Much
We fine-tuned three models on a retailer's real customer service emails. No lies, no harmful content. Harm avoidance dropped, lying went up, and nothing we changed in the data predicted how much.
Oct 16, 2026
Read more