) - Does anyone know how I can visualise the Dask Diagnostics when running Prefect flows? I know I can look at the individual mapped tasks, but I just wanted to see if there's a similar visualisation to how Dask does it
requests.exceptions.ConnectionError: HTTPConnectionPool(host='host.docker.internal', port=4200): Max retries exceeded with url: /graphql (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd0e8943640>: Failed to establish a new connection: [Errno 101] Network is unreachable')) ^C[2021-01-25 19:55:03,534] INFO - agent | Keyboard Interrupt received: Agent is shutting down.
My flow like this:
FROM python:3.7 WORKDIR /app COPY requirements.txt . RUN pip install -r requirements.txt COPY . .
When I try to register the flow, it seems to have issues with finding the
(...) storage = Docker(dockerfile="../Dockerfile") with Flow("Generate Report", result=LocalResult(), storage=storage) as flow: (...)
file needed to create the image:
My folder is structure is like this:
[2021-01-25 15:21:03-0800] INFO - prefect.Docker | Building the flow's Docker storage... Step 1/14 : FROM python:3.7 ---> ca194d6afe58 Step 2/14 : WORKDIR /app ---> Using cache ---> a729913b700e Step 3/14 : COPY requirements.txt . COPY failed: stat /var/lib/docker/tmp/docker-builder883681743/requirements.txt: no such file or directory Traceback (most recent call last): File "/Users/fina/Documents/github/concierge_iro_reporting/etl/register_all_flows.py", line 53, in <module> register_locally() File "/Users/fina/Documents/github/concierge_iro_reporting/etl/register_all_flows.py", line 21, in register_locally report_lt_target.register(project_name=project_name) File "/Users/fina/.pyenv/versions/3.7.3/lib/python3.7/site-packages/prefect/core/flow.py", line 1675, in register idempotency_key=idempotency_key, File "/Users/fina/.pyenv/versions/3.7.3/lib/python3.7/site-packages/prefect/client/client.py", line 783, in register serialized_flow = flow.serialize(build=build) # type: Any File "/Users/fina/.pyenv/versions/3.7.3/lib/python3.7/site-packages/prefect/core/flow.py", line 1450, in serialize storage = self.storage.build() # type: Optional[Storage] File "/Users/fina/.pyenv/versions/3.7.3/lib/python3.7/site-packages/prefect/storage/docker.py", line 363, in build self._build_image(push=push) File "/Users/fina/.pyenv/versions/3.7.3/lib/python3.7/site-packages/prefect/storage/docker.py", line 431, in _build_image "Your docker image failed to build! Your flow might have " ValueError: Your docker image failed to build! Your flow might have failed one of its deployment health checks - please ensure that all necessary files and dependencies have been included.
Why is it looking for the requirements.txt inside
App -->prefect_flows -->my_flow.py requirements.txt Dockerfile
instead of the App’s directory? What am I missing? (The container runs normally when I use docker-compose to build and run the app)