Toxicity predictors struggle to beat simple baselines on approved drugs
- Toxicity predictors, from fingerprint QSAR to foundation-model encoders and dedicated tools, were tested on approved drugs flagged by black-box warnings or market withdrawal.
- Learned representations gave no gain over plain fingerprints; most dedicated tools, liver-injury ones included, hovered near chance and trailed a chemistry-free approval-year baseline.
- Preprint, not yet peer reviewed; the authors say exposure and metabolism data are needed.
If an approval-year baseline with zero chemistry beats a liver-injury model, the labels are mostly encoding era and regulatory history, so the split deserves suspicion before the models do. Even so, near-chance DILI tools on approved drugs are not something to use as a gate. Bigger encoders adding nothing over fingerprints is worth remembering before any GPU spend. There is no prospective test, though.
Toxicity Prediction Tools Do Not Generalize to Novel Chemistry ↗