Juan09/11/2020, 1:50 PM
nicholas09/11/2020, 2:13 PM
Juan09/11/2020, 3:26 PM
flow = Flow("sklearn-iris-flow-dask", tasks=[load_data,fit_model,make_predictions,sumarize_fit_model])
from prefect.engine.executors import DaskExecutor
executor = DaskExecutor(address="<tcp://ip-scheduler>:port")
And I am getting this error:
Any advice? Thanks !!
[2020-09-11 12:36:45] INFO - prefect.FlowRunner | Beginning Flow run for 'sklearn-iris-flow-dask' [2020-09-11 12:36:46] INFO - prefect.FlowRunner | Flow run FAILED: some reference tasks failed.
nicholas09/11/2020, 3:31 PM
will run your flow locally (with your given executor); since it doesn't look like any tasks started, I'd guess your Dask cluster isn't available. Please take a look at the links I posted above to run the flow from the UI.
Juan09/14/2020, 7:11 AM
and it worked. Although after some successful executions Prefect GUI shows all flows as scheduled even if I start a flow manually from GUI.
flow = Flow("sklearn-iris-flow", tasks=[load_data,fit_model,make_predictions,sumarize_fit_model])
nicholas09/14/2020, 1:23 PM
Juan09/14/2020, 1:31 PM