Matthew Seligson
05/26/2022, 6:44 PMRenuka
05/26/2022, 6:53 PMPatrick Tan
05/26/2022, 7:50 PMVarun Srinivasan
05/26/2022, 11:15 PMclass MyFlow(prefect.core.Flow):
def __init__(flow_name, state_handlers, **kwargs):
state_handlers = [log_stdout, on_flow_start, on_flow_finish]
super().__init__(flow_name, state_handlers, **kwargs)
def on_flow_finish(flow: Flow, old_state: State, new_state: State) -> Optional[State]:
if new_state.is_finished() and get_flow_state_name(new_state) == 'Failed':
exception_trace: str = "".join(traceback.format_list(traceback.extract_tb(list(new_state.result.values())[0].result.__traceback__)))
## do something with exception_trace
While running it on prefect cloud, the new_state.result
dict is empty resulting in a IndexError
. When we run it locally, the new_result.result comes back with a length of the number of tasks in the flow. What's the right way to trap exceptions from a task in the flow's scope?Dileep Damodaran
05/27/2022, 5:07 AMJoshua Greenhalgh
05/27/2022, 9:53 AMprefect-job-foo
not sure how I can isolate one flow from another?Volker L
05/27/2022, 11:27 AMTarek
05/27/2022, 11:51 AMNaga Sravika Bodapati
05/27/2022, 12:02 PMThomas Opsomer
05/27/2022, 1:06 PMShriram Holla
05/27/2022, 2:23 PMflow.run()
, it errors out with this message:
TypeError: can't pickle _thread.lock objects
Note: I’m running the flow through a build system (bazel)Jai P
05/27/2022, 3:59 PMWill Skelton
05/27/2022, 4:46 PMIlhom Hayot o'g'li
05/27/2022, 4:53 PMKayvan Shah
05/27/2022, 4:53 PMJuan Valle
05/27/2022, 5:52 PMIlhom Hayot o'g'li
05/27/2022, 6:38 PMAmarpal Singh
05/27/2022, 6:51 PMLin Lin
05/27/2022, 8:00 PMDharit Sura
05/27/2022, 8:06 PMEdmondo Porcu
05/28/2022, 1:52 AMSumant Agnihotri
05/28/2022, 4:56 PM~/.aws/config
and did prefect auth login
using my API Token. Then I'm running the prefect agent ecs start
command, expecting an Agent to be created in Fargate and linked to my Cloud, but I'm getting the following error:
ERROR - agent | Failed to infer default networkConfiguration, please explicitly configure using `--run-task-kwargs`
Traceback (most recent call last):
...
ValueError: Failed to infer default networkConfiguration, please explicitly configure using `--run-task-kwargs`
What am I doing wrong?Ofir
05/29/2022, 1:59 PMOfir
05/29/2022, 1:59 PMOfir
05/29/2022, 2:00 PMOfir
05/29/2022, 2:01 PMJoshua Greenhalgh
05/29/2022, 5:46 PM12:09:39 ERROR prefect-server.ZombieKiller.TaskRun No heartbeat detected from the remote task; marking the run as failed.
12:22:53 INFO prefect-server.Lazarus.FlowRun Rescheduled by a Lazarus process. This is attempt 1.
I am running on GKE autopilot - any ideas how to debug cause of such events and mitigate against their occurence?Jean M
05/29/2022, 10:13 PMAhmed Ezzat
05/30/2022, 7:37 AMEfraim Globus
05/30/2022, 8:42 AM