Darragh
06/29/2020, 11:04 AMUnexpected error: KilledWorker('run_task-a6bb0ba3-e74f-4e26-8cc4-2bcc8f8c217c', <Worker '<tcp://127.0.0.1:41917>', name: 1, memory: 0, processing: 1>)
Doesn’t seem to matter what the flow is, getting this on all flows, even after restarting Prefect Server and the Fargate Agent..Avi A
06/29/2020, 11:48 AMKilledWorker
exceptions yesterday, due to a very large series of tasks I was running. Probably not your case b/c you’re saying it’s just a test flow, but what helped me was tweaking the dask distributed config file to better fit my reqsDarragh
06/29/2020, 12:10 PMadapt_kwargs
arg, I just don’t know what to pass to itjosh
06/29/2020, 1:25 PMn_workers
to your executor.
DaskExecutor(n_workers=4)
The interface to work with environments and executors was improved in 0.12.1
so you can now instantiate the executor object at build time https://docs.prefect.io/orchestration/execution/local_environment.html#examplesDarragh
06/29/2020, 1:35 PMprefecthq/prefect:0.12.1-python3.6
flow.environment = LocalEnvironment(executor=DaskExecutor(n_workers=partition_count))
josh
06/29/2020, 1:45 PM0.12.1
and then putting it into an image that has 0.12.1
or vice versaTyler Wanner
06/29/2020, 1:46 PMDarragh
06/29/2020, 1:46 PMFROM prefecthq/prefect:0.12.1-python3.6
COPY scripts /usr/local/scripts
And then I’ve done a pip upgrade of my local version to 0.12.1.
I shouldn’t have to upgrade the server side as well yet, right? More accurately, I know that I will but my assumption is that I don’t need to get to that yet just to have my Flow build locallyjosh
06/29/2020, 1:50 PMprefect_version="0.12.1"
and see if that fixes itTyler Wanner
06/29/2020, 1:50 PMDarragh
06/29/2020, 1:51 PMprefect_version="0.12.1"
Avi A
06/29/2020, 1:54 PMTyler Wanner
06/29/2020, 1:55 PMjosh
06/29/2020, 1:58 PMTyler Wanner
06/29/2020, 1:58 PMDarragh
06/29/2020, 2:00 PMMissing required parameter in containerDefinitions[0].repositoryCredentials: "credentialsParameter"
I don’t have any credentials configured in the containerDefintion section in my Fargate agent, and from looking at the related PR from a few days ago the text suggests that this is an ‘optional’ configuration ??josh
06/29/2020, 3:12 PMDarragh
06/29/2020, 3:13 PMjosh
06/29/2020, 3:23 PMDarragh
06/29/2020, 3:26 PMjosh
06/29/2020, 3:28 PMDarragh
06/29/2020, 3:29 PMprefect_version=master
• Locally/Server pip3 install prefect@master
???josh
06/29/2020, 3:32 PMpip install git+<https://github.com/PrefectHQ/prefect.git@master>
Darragh
06/29/2020, 3:33 PMjosh
06/29/2020, 4:22 PMDarragh
06/29/2020, 4:30 PMjosh
06/29/2020, 4:34 PMDarragh
06/29/2020, 4:53 PMTyler Wanner
06/29/2020, 5:12 PMDarragh
06/29/2020, 7:33 PM