@Marvin is it possible to dynamically load data to a task after the task has already started ?

It looks like there are no direct references in the documentation to dynamically load data into a task after the task has already started. However, a common approach for dynamically loading or modifying task data involves the use of Prefect's shared state features or external storage systems. Tasks can pull data from such sources based on task run context or external triggers. For more detailed guidance, you might want to consult Prefect's forums or specific integration documentation based on your workflow requirements: • Prefect AWS: https://docs.prefect.io/latest/integrations/prefect-aws/ecs_worker/ • Prefect Databricks Jobs: https://docs.prefect.io/latest/integrations/prefect-databricks/jobs/ For further exploration and up-to-date features, referring directly to Prefect's latest documentation or community discussions is advised.