https://prefect.io logo
Title
l

Lewis Bails

08/11/2020, 6:05 AM
Hi there, I have a task that is being wrongfully executed multiple times despite only showing up once in the flow. Has anyone had this issue before? Edit: I'm using Prefect 0.13.1, with Dask 2.22.0, LocalEnvironment with DaskExecutor
m

Michael Ludwig

08/11/2020, 6:25 AM
Yes I have the same issue. Might be this issue: https://github.com/PrefectHQ/prefect/issues/3124
l

Lewis Bails

08/11/2020, 7:07 AM
@Michael Ludwig thanks, looks about right! I'm using DaskExecutor, not LocalDaskExecutor, you said in the issue you didnt have problems with that executor? My setup:
flow.environment = LocalEnvironment(
            executor=DaskExecutor(
                adapt_kwargs={
                    "minimum": args.min_workers,
                    "maximum": args.max_workers
                },
            ),
        )
m

Michael Ludwig

08/12/2020, 11:25 AM
We use LocalDaskExecutor and had problems with that. I think the other ones don’t have this issue. But also the newest version released yesterday I think has this fixed. We stopped using mappings for now because of other unsolved issues, so I can’t tell for sure