Hi all, new here and to prefect, but I wrote / use...
# ask-community
a
Hi all, new here and to prefect, but I wrote / used pipelines in other workflow managers in the past (bpipe, nextflow if it matters). I am in process of writing some flows in and have a question for y'all: what are the strategies you are using to re-use tasks in multiple flows? For example, a
load_data
task could be fairly generic and used in two different flows such as
apply_model
or
train_model
. How to go about it? Write each task in a file and load as needed in each flow file? Cheers!
s
All our flows come from the same repo and image, so yeah, we have files with collections of utility tasks, data loads, serialisers, etc, that are shared.
gratitude thank you 1