Hi folks, I have a problem of failed code passed as success. For instance in the T part of my ETL( which is simply a os.system...) I've put a test and even if it fails Prefect still declares it a success.

There are no stupid questions! Can you by any chance share the example flow you were using? Could it be that you have some try/except block that traps the exception without raising it?

I think the reason is that

os.system

runs the Python interpreter to run the specified Python script, and the exception is raised in that script, which doesn't then propagate to this Prefect task since it is an external script. You might need to say, check for a non-zero return value for

os.system

then raise an exception within the Prefect task, e.g., Prefect's

FAIL

signal.

You’re right that this is the part that causes troubles. You can call such tasks using ShellTask - here is an example

Thanks a lot girls!