...is there any chance that ditching the DAG with Orion could maybe allow for hot-reloading of Flow code? (So like Error->Push changes->Restart from where you were, but with changes incorporated on downstream Tasks)
(this might be a terrible idea though lol)
01/20/2022, 8:42 PM
This actually came up in a recent discussion and we are thinking of it
01/20/2022, 8:43 PM
Not sure about restarts, but this will work already in Orion:
• Error->Push changes->Start a new flow run from your deployment
This works because Orion doesn’t require a preregistration and as long as your changed code lives in the same location as the one defined in your flow’s DeploymentSpec, it will work out of the box.
This is only about the actual flow definition - if your dependency changed (e.g. custom modules your flow depends on), then you need to make sure those are updated in the environment your FlowRunner from the deployment points to.