Juan
09/11/2020, 1:50 PMnicholas
09/11/2020, 2:13 PMJuan
09/11/2020, 3:26 PMflow = Flow("sklearn-iris-flow-dask", tasks=[load_data,fit_model,make_predictions,sumarize_fit_model])
flow.register(project_name="sklearn-iris")
from prefect.engine.executors import DaskExecutor
executor = DaskExecutor(address="<tcp://ip-scheduler>:port")
flow.run(executor=executor)
And I am getting this error:
[2020-09-11 12:36:45] INFO - prefect.FlowRunner | Beginning Flow run for 'sklearn-iris-flow-dask'
[2020-09-11 12:36:46] INFO - prefect.FlowRunner | Flow run FAILED: some reference tasks failed.
Any advice?
Thanks !!nicholas
09/11/2020, 3:31 PMflow.run
will run your flow locally (with your given executor); since it doesn't look like any tasks started, I'd guess your Dask cluster isn't available. Please take a look at the links I posted above to run the flow from the UI.Juan
09/14/2020, 7:11 AMflow = Flow("sklearn-iris-flow", tasks=[load_data,fit_model,make_predictions,sumarize_fit_model])
and it worked. Although after some successful executions Prefect GUI shows all flows as scheduled even if I start a flow manually from GUI.nicholas
09/14/2020, 1:23 PMJuan
09/14/2020, 1:31 PM