Niels Drost

and 15 more

The eWaterCycle platform(https://www.ewatercycle.org/) is a fully Open Source system designed explicitly to advance the state of Open and FAIR Hydrological modelling. Reproducibility is a key ingredient of FAIR, and one of the driving principles of eWaterCycle. While working with Hydrologists to create a fully Open and FAIR comparison study, we noticed that many ad-hoc tools and scripts are used to create input (forcing, parameters) for a hydrological model from the source datasets such as climate reanalysis and land-use data. To make this part of the modelling process better reproducible and more transparent we have created a common forcing input processing pipeline based on an existing climate model analysis tool: ESMValTool (https://www.esmvaltool.org/). Using ESMValTool the eWaterCycle platform can perform commonly required pre-processing steps such as cropping, re-gridding, and variable derivation in a standardized manner. If needed, it also allows for custom steps for a Hydrological model. Our pre-processing pipeline directly supports commonly used datasets such as ERA-5, ERA-Interim, and CMIP climate model data, and creates ready-to-run forcing data for a number of Hydrological models. Besides creating forcing data, the eWaterCycle platform allows scientists to run Hydrological models in a standardized way using Jupyter notebooks, wrapping the models inside a container environment, and interfacing to these using BMI, the Basic Model Interface (https://bmi.readthedocs.io/). The container environment (based on Docker) stores the entire software stack, including the operating system and libraries, in such a way that a model run can be reproduced using an identical software environment on any other computer. The reproducible processing of forcing and a reproducible software environment are important steps towards our goal of fully reproducible, Open, and FAIR Hydrological modelling. Ultimately, we hope to make it possible to fully reproduce a Hydrological model experiment from data pre-processing to analysis, using only a few clicks.

Christian Page

and 5 more

Researchers using climate data are facing challenge to analyze the data they need. Data volumes are increasing very rapidly, and the ability to download all needed data is often not a possibility anymore. A platform called climate4impact (C4I) has been designed and developed to enhance the use of research data, to support researchers with analytics and to support other climate portals. It is currently under development within the European Project IS-ENES3 and builds on previous developments from previous IS-ENES projects, CLIPC and C3S-Magic. C4I offers a front-end and standard services (with APIs) on top of the climate data infrastructure, and it can be visited at https://climate4impact.eu. The current version provides processing services include climate indicator calculations, country based statistics and polygon extraction. C4I makes use of the DKRZ Birdhouse framework, which is an extendable and modular processing framework based on PyWPS. Data is obtained from various ESGF nodes using secure OpenDAP. C4I provides a personal basket where users can upload their own data and do research with the provided tools. The software is open, reusable, modular and packaged. Components are available via docker containers to enable easy re-use. The on-demand calculations are taking place on the front-end server, and this is not scalable and can lead to performance problems. Within the DARE project, delegation of the calculations on the DARE Platform using the DARE API has been implemented and tested in a prototype, using EUDAT B2DROP as an intermediate storage service. It is to be noted that the DARE Platform as well as the EUDAT B2 Services should be interoperable with the European Open Science Cloud (EOSC). This prototype service delegation will be made operational during the upcoming year. In the IS-ENES3 project, the web portal will be redesigned with a completely new architecture using a micro-services and containerized approach, building on experience gained during the previous projects. The next version of the portal will be built using the React framework, which allows for creating large web applications which can change data, without reloading the page. We are actively seeking input from current as well as potential users at this time, to make the next version of C4I useful to as many people as possible. The material presented here is made possible because the IS-ENES3 project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement N°824084.