finch [distributed data processing for ICON data]¶

https://github.com/MeteoSwiss-APN/finch/blob/main/images/201903_Zebra_finch_lo.png?raw=true — Image distributed through Creative Commons License from https://commons.wikimedia.org/wiki/File:201903_Zebra_finch.svg¶

Finch is a Python library for setting up, running and analyzing runtime experiments for data processing operators with dask.

Warning

Finch is currently in development. The documentation might at some places be outdated or incomplete.

Overview¶

Finch provides parallelized prototypes for ICON data processing operators for a distributed infrastructure with SLURM. It is designed as a library for setting up experiments plus a run script, which runs configurable experiments. The documentation of finch is available on github pages.