Soham
07/28/2023, 8:56 PMto_zarr
. This function doesn't terminate when using Prefect's DaskTaskRunner, but it works fine with normal Dask execution.
The to_zarr
function implementation seems simple, involving regular math computations and converting objects to zarr format for local writing. Each task writes its individual file, and there is nothing complicated happening within to_zarr
.
For reference, here is the implementation of the to_zarr
function: to_zarr function.
I would greatly appreciate any insights or assistance in resolving this issue with the to_zarr
function while using Prefect's DaskTaskRunner.