Hello all, I'm running a Prefect flow in a Kuberne...
# prefect-community
j
Hello all, I'm running a Prefect flow in a Kubernetes cluster via DaskTaskRunner. My task is erroring out with
Crash detected! Execution was interrupted by an unexpected exception.
(full logs in thread). I'm trying to figure out the best way to debug this further. In general – and to help diagnose this particular case – I'd like to shuttle logs to our DataDog instance: I found this discussion on the topic, but is there something more recent / more complete for Prefect v2? Aside from getting logs out, any other ideas for diagnosing this terse error?
Copy code
downloading file, entity_type=abstracts, download_url=<long_url>
05:38:13 PM
download_reshape_upload-8c37f7f7-48
reading JSON lines into DataFrame, local_file=/tmp/tmpxavexr8v
05:39:36 PM
download_reshape_upload-8c37f7f7-48
Crash detected! Execution was interrupted by an unexpected exception.
m
Hey James we have a Logging FAQ in discourse that covers a variety of different topics that may help in configuring logging for this https://discourse.prefect.io/t/prefect-logging-faq/1476
j
Thank you @Mason Menges! Checking that now