AI Insight
This study systematically evaluates machine learning pipelines for predicting antimicrobial resistance from whole-genome sequencing data across nine species-antibiotic combinations. The researchers found that key parameters like k-mer length selection and relabeling isolates with current breakpoints significantly improved model performance, with F1 scores increasing by over 20 points in some cases. Random cross-validation splits performed as well or better than phylogeny-aware splits for predicting clinical outcomes, and over 95% of predictive features corresponded to identifiable genomic elements, supporting the interpretability of tree-based models.
Why it matters
Accurate prediction of antimicrobial resistance from genomic data could accelerate clinical decision-making and help combat the global threat of drug-resistant infections. This work provides evidence-based guidance for developing more reliable machine learning tools that clinicians could use to quickly determine appropriate antibiotic treatments.
Understand the Science
⚠️ Preprint – Noch nicht peer-reviewed
Dieser Artikel wurde noch nicht von unabhängigen Experten begutachtet. Die Ergebnisse sind vorläufig und sollten mit Vorsicht interpretiert werden.
Motivation: Antimicrobial resistance (AMR) has been identified as a top global public health threat. Accurate AMR phenotype prediction from whole-genome sequencing data is an essential tool for accelerating clinical decision-making and mitigating resistance spread. Although many previous works have explored the use of tree-based machine learning (ML) models to predict resistance, the field lacks a systematic evaluation of the training pipeline across a variety of pathogenic species and antibiotics. Results: Using nine clinically relevant species-antibiotic combinations from the NCBI antimicrobial susceptibility testing database, we present a detailed analysis of the ML pipeline and identify key factors affecting model performance and evaluation. We begin by relabelling all isolates using current CLSI minimum inhibitory concentration breakpoints to resolve inconsistencies and increase available data, resulting in up to a 19% label swap and 56% data enlargement per species-antibiotic combination. We identify several key training parameters including k-mer length, which can increase classification F1 scores by over 20 points compared to commonly used k-values, feature matrix truncation, which can induce polynomial time reductions with limited performance reduction, and ML model class. By comparing 5-fold cross-validation with evaluation on an unseen clinical dataset, we show that random cross-validation splits–often criticized as overly optimistic–can act as a strong proxy for downstream clinical performance, yielding closer F1 scores than phylogeny-aware splits in all cases. We finally present an interpretability study which shows that over 95% of k-mers used by our models are associated with identifiable genomic features. Our results highlight the importance of feature design, evaluation protocol, and biological analysis in genomic AMR prediction, and support tree-based models as a robust and interpretable method.
Source: A systematic analysis of machine learning pipelines for robust antimicrobial resistance prediction