Deutsch
 
Datenschutzhinweis Impressum
  DetailsucheBrowse

Datensatz

DATENSATZ AKTIONENEXPORT
  Cross-Validation Strategy Impacts the Performance and Interpretation of Machine Learning Models

Sweet, L.-b., Müller, C., Anand, M., Zscheischler, J. (2023): Cross-Validation Strategy Impacts the Performance and Interpretation of Machine Learning Models. - Artificial Intelligence for the Earth Systems, 2, 4, e230026.
https://doi.org/10.1175/AIES-D-23-0026.1

Item is

Dateien

einblenden: Dateien
ausblenden: Dateien
:
Crossvalidation_accepted_230704.pdf (Preprint), 2MB
 
Datei-Permalink:
-
Name:
Crossvalidation_accepted_230704.pdf
Beschreibung:
-
Sichtbarkeit:
Privat
MIME-Typ / Prüfsumme:
application/pdf
Technische Metadaten:
Copyright Datum:
-
Copyright Info:
-
Lizenz:
-
:
28570oa.pdf (Verlagsversion), 6MB
Name:
28570oa.pdf
Beschreibung:
-
Sichtbarkeit:
Öffentlich
MIME-Typ / Prüfsumme:
application/pdf / [MD5]
Technische Metadaten:
Copyright Datum:
-
Copyright Info:
-
Lizenz:
-

Externe Referenzen

einblenden:

Urheber

einblenden:
ausblenden:
 Urheber:
Sweet, Lily-belle1, Autor
Müller, Christoph2, Autor              
Anand, Mohit1, Autor
Zscheischler, Jakob1, Autor
Affiliations:
1External Organizations, ou_persistent22              
2Potsdam Institute for Climate Impact Research, ou_persistent13              

Inhalt

einblenden:
ausblenden:
Schlagwörter: -
 Zusammenfassung: Machine learning algorithms are able to capture complex, nonlinear interacting relationships and are increasingly used to predict yield variability at regional and national scales. Using explainable artificial intelligence (XAI) methods applied to such algorithms may enable better scientific understanding of drivers of yield variability. However, XAI methods may provide misleading results when applied to spatiotemporal correlated datasets. In this study, machine learning models are trained to predict simulated crop yield from climate indices, and the impact of model evaluation strategy on the interpretation and performance of the resulting models is assessed. Using data from a process-based crop model allows us to then comment on the plausibility of the ‘explanations’ provided by XAI methods. Our results show that the choice of evaluation strategy has an impact on (i) interpretations of the model and (ii) model skill on heldout years and regions, after the evaluation strategy is used for hyperparameter-tuning and feature-selection. We find that use of a cross-validation strategy based on clustering in feature-space achieves the most plausible interpretations as well as the best model performance on heldout years and regions. Our results provide first steps towards identifying domain-specific ‘best practices’ for the use of XAI tools on spatiotemporal agricultural or climatic data.

Details

einblenden:
ausblenden:
Sprache(n): eng - Englisch
 Datum: 2023-03-312023-07-032023-07-102023-10
 Publikationsstatus: Final veröffentlicht
 Seiten: 14
 Ort, Verlag, Ausgabe: -
 Inhaltsverzeichnis: -
 Art der Begutachtung: Expertenbegutachtung
 Identifikatoren: Organisational keyword: RD2 - Climate Resilience
PIKDOMAIN: RD2 - Climate Resilience
Working Group: Land Use and Resilience
MDB-ID: No data to archive
Model / method: LPJmL
Model / method: Machine Learning
Regional keyword: Global
Research topic keyword: Food & Agriculture
OATYPE: Green Open Access
DOI: 10.1175/AIES-D-23-0026.1
 Art des Abschluß: -

Veranstaltung

einblenden:

Entscheidung

einblenden:

Projektinformation

einblenden:

Quelle 1

einblenden:
ausblenden:
Titel: Artificial Intelligence for the Earth Systems
Genre der Quelle: Zeitschrift, other, oa
 Urheber:
Affiliations:
Ort, Verlag, Ausgabe: -
Seiten: - Band / Heft: 2 (4) Artikelnummer: e230026 Start- / Endseite: - Identifikator: CoNE: https://publications.pik-potsdam.de/cone/journals/resource/2769-7525
Publisher: American Meteorological Society (AMS)