Wilson Bilkovich
08/21/2021, 11:32 PMWilson Bilkovich
08/21/2021, 11:33 PM% python demo_flow.py
[2021-08-21 19:26:39-0400] INFO - prefect.FlowRunner | Beginning Flow run for 'increment a random sample'
[2021-08-21 19:26:39-0400] INFO - prefect.DaskExecutor | Creating a new Dask cluster with `dask_kubernetes.core.KubeCluster`...
Creating scheduler pod on cluster. This may take some time.
Forwarding from 127.0.0.1:61151 -> 8786
Forwarding from [::1]:61151 -> 8786
Handling connection for 61151
Handling connection for 61151
/Users/wilson.bilkovich/.pyenv/versions/3.9.6/envs/addemart/lib/python3.9/site-packages/distributed/client.py:1105: VersionMismatchWarning: Mismatched versions found
+-------------+-----------+-----------+---------+
| Package | client | scheduler | workers |
+-------------+-----------+-----------+---------+
| blosc | None | 1.10.2 | None |
| dask | 2021.08.0 | 2021.08.1 | None |
| distributed | 2021.08.0 | 2021.08.1 | None |
| lz4 | None | 3.1.3 | None |
+-------------+-----------+-----------+---------+
warnings.warn(version_module.VersionMismatchWarning(msg[0]["warning"]))
Handling connection for 61151
[2021-08-21 19:27:05-0400] INFO - prefect.DaskExecutor | The Dask dashboard is available at <http://localhost:8787/status>
INFO:prefect.DaskExecutor:The Dask dashboard is available at <http://localhost:8787/status>
Handling connection for 61151
Handling connection for 61151
Handling connection for 61151
Handling connection for 61151
[2021-08-21 19:27:25-0400] INFO - prefect.FlowRunner | Flow run SUCCESS: all reference tasks succeeded
INFO:prefect.FlowRunner:Flow run SUCCESS: all reference tasks succeeded
Kevin Kho
flow.run()
? What happens when you register?Kevin Kho
flow.storage.build()
Kevin Kho
Kevin Kho
local_script_path
here . I think that will clarify the behavior?Wilson Bilkovich
08/21/2021, 11:41 PMWilson Bilkovich
08/21/2021, 11:42 PMKevin Kho
.build()
is a good way to test.Kevin Kho
Wilson Bilkovich
08/21/2021, 11:46 PMKevin Kho
Wilson Bilkovich
08/21/2021, 11:49 PMKevin Kho
storage.add_flow(f)
storage.build()
Kevin Kho
flow.register("project_name")
, the storage adds the flow and is built so these are called for you so you don’t need those lines (I think you know but just making sure)