@Marvin Is it possible to retry a flow (set_state AwaitingRetry) with a change in an ENV variable?

To retry a flow with a change in an environment variable, you have a couple of options, although the Prefect documentation and source code directly do not point out a built-in mechanism to modify environment variables during flow state transitions such as

AwaitingRetry

. You might need to create a custom state handler that sets the environment variable or updates your flow's configuration before moving it into an

AwaitingRetry

state. Here are some general steps you could follow to achieve this, considering Prefect's customization capabilities: 1. Create a Custom State Handler: Implement a state handler that checks if the flow is in a failure state and if it should be retried. Within this handler, set up logic to change the environment variable as needed. 2. Use the Custom State Handler: Attach the custom state handler to your flow so that it is invoked when the flow's state changes. 3. Set the Flow to

AwaitingRetry

: In your custom handler upon encountering a failure, set the flow to an

AwaitingRetry

state with a scheduled time for the next run. Ensure this logic also updates the environment variable. Since the documentation did not provide a direct guide on how to do this, the steps above are more of a general guideline based on Prefect's customization capabilities. Also, you can consider the use of Prefect's global configurations for retries, though they don't directly relate to changing environment variables. I'd suggest exploring community forums, Prefect's GitHub issue tracker, or reaching out to the Prefect community for a more specific example if the exact mechanism does not exist in the documentation or existing issues.