Felipe Saldana
09/02/2021, 1:54 PMFelipe Saldana
09/02/2021, 2:06 PMlake2_staging
, lake2_prepublish
, lake1_publish
, lake2_publish
etc.
lake1_root_dir = Parameter("lake1_root_dir", required=True)
lake2_root_dir = Parameter("lake2_root_dir", required=True)
publish_dir = Parameter("publish_dir", required=True)
output_dir = Parameter("output_dir", required=True)
staging_dir = Parameter("staging_dir", required=True)
prepublish_dir = Parameter("prepublish_dir", required=True)
source_data_dir = Parameter("source_data_dir", required=True)
lake2_staging = lake2_root_dir + "/" + staging_dir
lake2_prepublish = lake2_root_dir + "/" + prepublish_dir
lake1_publish = lake1_root_dir + "/" + publish_dir + "/" + output_dir
lake2_publish = lake2_root_dir + "/" + publish_dir + "/" + output_dir
Kevin Kho
@task
def make_path(root, env, output):
return f"{root}/{env}/{output}"
Felipe Saldana
09/02/2021, 2:11 PMFelipe Saldana
09/02/2021, 2:13 PMmake_path
and any proper parameters into the actual taskKevin Kho
Felipe Saldana
09/02/2021, 2:21 PM