https://prefect.io logo
Title
a

Adam Eury

01/26/2023, 8:41 PM
Hi everyone, does anyone have experience dealing with this or similar issues?
prefect.exceptions.UpstreamTaskError: Upstream task run 'None' did not reach a 'COMPLETED' state.
It doesn't appear to happen consistently, so it has been difficult to debug. We are currently on Prefect
2.1.1
.
t

Tony Alfonse

01/26/2023, 8:42 PM
Any context/code?
a

Adam Eury

01/26/2023, 8:46 PM
Unfortunately I'm unable to share the exact code as is, but I think this is the gist of it
item_ids, filepaths = zip(*get_output_filepaths(context.item_ids))

temp_data_items = import_file.map(item_ids, filepaths)

load_futures = load_items_into_lookup.map(temp_data_items, unmapped(lookup_name))
In the Prefect Cloud application, I see a few of the
import_file
tasks crashed, but the
Run Count
is 0.
All Prefect Cloud shows for the crashed
import_file
tasks is
Crash detected! Execution was interrupted by an unexpected exception.
z

Zanie

01/26/2023, 9:33 PM
If you turn on DEBUG logs you’ll get a traceback for the crash
That seems like the root of your issue (downstreams complaining that an upstream failed is normal — they shouldn’t run in this case)
a

Adam Eury

01/26/2023, 9:34 PM
Thank you! We will try enabling debug logs and yes that makes sense.