Nimesh Kumar
03/09/2023, 5:20 AMNimesh Kumar
03/09/2023, 5:29 AMJeff Hale
03/09/2023, 2:20 PMDaskTaskRunner
and the submit
method. The second example on that page shows how to connect to a running Dask Cluster - like one that could be provided by Coiled. See more about task runners in the Prefect docs.
2. You can copy Python code into a Jupyter Notebook and run it in Jupyter Lab.Nimesh Kumar
03/09/2023, 3:15 PMJeff Hale
03/09/2023, 5:00 PMNimesh Kumar
03/10/2023, 4:13 AMres_1 = generate_jobID.submit(algo_id, job_id)
res_2 = get_file.submit(file_path)
res_4 = choose_valid_file.submit(prev_task=res_2)
With task runner = DaskTaskRunner
if yes, I might be wrong here but what i read till now this will make task run in parallel (referring this https://docs.prefect.io/tutorials/dask-ray-task-runners/#running-parallel-tasks-with-dask) but not the flows.Jeff Hale
03/10/2023, 1:41 PM