Is there a way to pass in result_storage as a parameter to a flow from a deployment? I want to have the results stored for a given run based on the bucket I am using as an input parameter to the flow
n
Nate
12/20/2023, 12:32 AM
do you want to save the result for the flow that is the entrypoint of your deployment? if you want to do it for a subflow / task, you can do my_task.with_options(result_storage=…)(*args, **kwargs) (same for subflows). if it’s the result of the entrypoint flow you want to dynamically config result storage for you’d have to get more creative (may not be directly supported)
d
Derek Heyman
12/20/2023, 12:35 AM
Yeah I was trying to do it for the entrypoint. Let me know if you have any ideas. Thanks!
n
Nate
12/20/2023, 12:36 AM
well you could just wrap what was going to be your return value in a no op task and call that with options
Nate
12/20/2023, 12:37 AM
it’s kinda silly, but the task will save its return value to its result storage on exit and then you can return the tasks return from your flow
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.