Can I parameterize checkpointing at the task level?
ex:
Copy code
with Flow('foo') as f:
chck = Parameter('checkpointing') # Let's say we pass in False
do_stuff = task(some_python_callable, checkpoint=chck)()
k
Kevin Kho
04/20/2022, 9:25 PM
I think the answer here is not at all as that is handled at registration. You need to use the result interface inside the task to get that flexibility, and then you can parameterize whether or not to save
k
kevin
04/20/2022, 9:26 PM
gotcha thanks for clarifying i figured i was oversimplifying 😄
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.