Matt Alhonte
05/03/2022, 9:35 PMKilled
) and the mapping stays in a mapped
stateAnna Geller
05/03/2022, 9:40 PMprefect diagnostics
?
3. I assume you mean a Dask Cloud provider Fargate cluster given you mentioned CloudWatch?
4. Why are you using Client directly - do you use it to make some API calls to Prefect backend before doing mapping? Can you share some flow code?Matt Alhonte
05/03/2022, 9:44 PMECSRun
. I'm on Cloud.prefect diagnostics
output:
{
"config_overrides": {},
"env_vars": [],
"system_information": {
"platform": "Linux-4.14.193-149.317.amzn2.x86_64-x86_64-with-glibc2.10",
"prefect_backend": "cloud",
"prefect_version": "1.2.0",
"python_version": "3.8.8"
}
}
Anna Geller
05/03/2022, 9:49 PMMatt Alhonte
05/03/2022, 10:16 PMmapped
or pending
state. And I see in the logs for the Scheduler that it says
distributed.scheduler - INFO - Close client connection: Client-67d0a242-cb2b-11ec-8013-06a62f0d58e7
Anna Geller
05/03/2022, 10:18 PMKevin Kho
05/03/2022, 10:19 PMMatt Alhonte
05/03/2022, 10:20 PMecd087e5-821c-4f0c-a5b7-b6ea708acfbb
Anna Geller
05/03/2022, 10:39 PMMatt Alhonte
05/03/2022, 10:40 PMLocalDaskExecutor
?Anna Geller
05/03/2022, 10:41 PMKevin Kho
05/03/2022, 10:52 PMdistributed
so itโs not a good testMatt Alhonte
05/03/2022, 11:17 PM.npz
file and now it all works fine!Kevin Kho
05/04/2022, 12:11 AMMatt Alhonte
05/04/2022, 12:13 AM