jeff sadler
06/23/2020, 5:04 PM[2020-06-23 16:56:03] INFO - prefect.FlowRunner | Beginning Flow run for 'run_model'
[2020-06-23 16:56:03] INFO - prefect.FlowRunner | Starting flow run.
distributed.scheduler - INFO - Receive client connection: Client-6c8e597e-b572-11ea-ace9-ac1f6b4e4528
distributed.core - INFO - Starting established connection
distributed.scheduler - INFO - Remove client Client-6c8e597e-b572-11ea-ace9-ac1f6b4e4528
distributed.scheduler - INFO - Remove client Client-6c8e597e-b572-11ea-ace9-ac1f6b4e4528
distributed.scheduler - INFO - Close client connection: Client-6c8e597e-b572-11ea-ace9-ac1f6b4e4528
[2020-06-23 16:56:05] INFO - prefect.FlowRunner | Flow run FAILED: some reference tasks failed.
It's hard to know where to start with only Flow run FAILED: some reference tasks failed.
Zachary Hughes
06/23/2020, 5:06 PMjeff sadler
06/23/2020, 5:08 PMJim Crist-Harif
06/23/2020, 5:09 PMflow.run()
. It sounds like you're doing the latter.Zachary Hughes
06/23/2020, 5:09 PMJim Crist-Harif
06/23/2020, 5:09 PMDaskExecutor
configuration?jeff sadler
06/23/2020, 5:10 PMflow.run()
Jim Crist-Harif
06/23/2020, 5:11 PMDaskExecutor
?jeff sadler
06/23/2020, 5:11 PMJim Crist-Harif
06/23/2020, 5:12 PMjeff sadler
06/23/2020, 5:13 PMJim Crist-Harif
06/23/2020, 5:15 PMjeff sadler
06/23/2020, 5:16 PMdask-worker-space
directory that gets created where I see what looks like a subdirectory for each of my workers. Each of those has a storage
directory. But those are all empty. Does that help at all?Jim Crist-Harif
06/23/2020, 5:21 PMjeff sadler
06/23/2020, 5:22 PMJim Crist-Harif
06/23/2020, 5:25 PMflow.run()
(the state object), which has a .result
attribute. If you iterate through that you may be able to inspect the errors on the failed tasks to learn what went wrong.jeff sadler
06/23/2020, 6:09 PMresult
I'll look into thatresult
gave me what I needed. Thanks! Idk if it's true for every case, but it could be useful to print out the individual task error beyond just the flow error. That's what helped me get back on my way.Jim Crist-Harif
06/23/2020, 6:18 PM