Need help for this. This is on server as the backend. On exception I am using "raise SystemExit(0)", but the flow is not quitting immediately and takes 15 minutes or so for the flow to fail. What is the issue?
Copy code
@task()
def mainprocess(a):
global df_single_record
try:
for indx in df_data_extracted.index + 1:
df_single_record = df_data_extracted.iloc[indx - 1:indx]
converttojson(df_single_record)
postjsontoqapi(df_json_data)
except Exception as e:
logger = get_logger()
logger.error(str(get_pst_time())
+ '==========ERROR IN mainprocess() WHILE CONVERTING TO JSON/POSTING TO Q-API: '
+ str(e))
raise SystemExit(0)
z
Zanie
02/26/2021, 8:12 PM
Hi @S K this is likely not captured by our standard exception handling because
@Zanie After following the above, I am able to fail the task successfully, but other subsequent tasks are executed which I don't want. I want to fail the complete flow if any of the tasks fails, how to achieve this?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.