Adam Roderick
07/28/2020, 11:34 PMStep 19/22 : COPY C:\Users\myuser\AppData\Local\Temp\tmppldichwe\tmpksbpr1xh\pkt-pipeline-staging.flow /opt/prefect/flows/pkt-pipeline-staging.prefect
COPY failed: stat /var/lib/docker/tmp/docker-builder941483285/C:UsersmyuserAppDataLocalTemptmppldichwetmpksbpr1xhpkt-pipeline-staging.flow: no such file or directory
flow.register()
, because it happens after our Dockerfile steps are completeChris White
Adam Roderick
07/29/2020, 2:25 AMChris White
Adam Roderick
07/29/2020, 6:28 PMChris White
Adam Roderick
07/29/2020, 10:25 PMChris White
Adam Roderick
07/30/2020, 2:02 PMERROR: distributed 2.21.0 has requirement cloudpickle>=1.5.0, but you'll have cloudpickle 1.3.0 which is incompatible.
Attempting to run any script using prefect then gives me pkg_resources.ContextualVersionConflict: (cloudpickle 1.3.0 (c:\dev\datateer\pkt-pipeline\venv\lib\site-packages), Requirement.parse('cloudpickle>=1.5.0'), {'distributed'})
Seems like version requirements of the dependencies have moved on. So I installed distributed 1.26.1 and the version conflict went away.
However, on creating the flow's storage, I see what looks like a docker error. Not sure how to interpret it:
[2020-07-30 14:01:54] INFO - prefect.Docker | Building the flow's Docker storage...
Traceback (most recent call last):
File "c:\dev\datateer\pkt-pipeline\venv\lib\site-packages\docker\api\client.py", line 261, in _raise_for_status
response.raise_for_status()
File "c:\dev\datateer\pkt-pipeline\venv\lib\site-packages\requests\models.py", line 941, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: <http+docker://localnpipe/v1.40/build?t=136548492218.dkr.ecr.us-east-1.amazonaws.com%2Fpkt-pipeline-staging%3A2020-07-30t14-01-54-745473-00-00&q=False&nocache=False&rm=False&forcerm=True&pull=False&dockerfile=.%5Ctmpgqqnhoef%5CDockerfile>
Chris White
Adam Roderick
07/31/2020, 8:42 PMChris White
Adam Roderick
07/31/2020, 8:43 PM