Prefect 2.0 question here - I have three scripts I want to orchestrate in a flow by utilizing the ’shell_run_command” and passing in the command to execute a script. The scripts are not idempotent, and I’d like to cache their completed status if there is a failure between the scripts. Shell_run_command is a ‘task’ object type, and I cannot call a task from within a task to utilize the task cache key. What should I be doing instead?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.