Soham
07/28/2023, 8:56 PMto_zarr. This function doesn't terminate when using Prefect's DaskTaskRunner, but it works fine with normal Dask execution.
The to_zarr function implementation seems simple, involving regular math computations and converting objects to zarr format for local writing. Each task writes its individual file, and there is nothing complicated happening within to_zarr.
For reference, here is the implementation of the to_zarr function: to_zarr function.
I would greatly appreciate any insights or assistance in resolving this issue with the to_zarr function while using Prefect's DaskTaskRunner.