Over het archief
Het OWA, het open archief van het Waterbouwkundig Laboratorium heeft tot doel alle vrij toegankelijke onderzoeksresultaten van dit instituut in digitale vorm aan te bieden. Op die manier wil het de zichtbaarheid, verspreiding en gebruik van deze onderzoeksresultaten, alsook de wetenschappelijke communicatie maximaal bevorderen.
Dit archief wordt uitgebouwd en beheerd volgens de principes van de Open Access Movement, en het daaruit ontstane Open Archives Initiative.
Basisinformatie over ‘Open Access to scholarly information'.
DIRESA, a Distance-Preserving Nonlinear Dimension Reduction Technique Based on Regularized Autoencoders
De Paepe, G.; De Cruz, L. (2025). DIRESA, a Distance-Preserving Nonlinear Dimension Reduction Technique Based on Regularized Autoencoders. Artificial Intelligence for the Earth Systems 4(3): e240034. https://dx.doi.org/10.1175/AIES-D-24-0034.1
In: Artificial Intelligence for the Earth Systems. American Meteorological Society: Boston. ISSN 2769-7525; e-ISSN 2769-7525, meer
|
| Author keywords |
Atmosphere-ocean interaction;Nonlinear dynamics;Software;Deep learning;Dimensionality reduction;Machine learning;model |
| Auteurs | | Top |
- De Paepe, G.
- De Cruz, L., meer
|
|
|
| Abstract |
In meteorology, finding similar weather patterns or analogs in historical datasets can be useful for data assimilation, forecasting, and postprocessing. In climate science, analogs in historical and climate projection data are used for attribution and impact studies. However, most of the time, those large weather and climate datasets are nearline. This means that they must be downloaded, which takes a lot of bandwidth and disk space, before the computationally expensive search can be executed. We propose a dimension reduction technique based on autoencoder (AE) neural networks to compress the datasets and perform the search in an interpretable, compressed latent space. A distance-regularized Siamese twin autoencoder (DIRESA) architecture is designed to preserve distance in latent space while capturing the nonlinearities in the datasets. Using conceptual climate models of different complexities, we show that the latent components thus obtained provide physical insight into the dominant modes of variability in the system. Compressing datasets with DIRESA reduces the online storage and keeps the latent components uncorrelated, while the distance (ordering) preservation and reconstruction fidelity robustly outperform principal component analysis (PCA) and other dimension reduction techniques such as Uniform Manifold Approximation and Projection (UMAP) or variational autoencoders. |
IMIS is ontwikkeld en wordt gehost door het VLIZ.
