Jon
11/01/2022, 8:31 PMMason Menges
11/01/2022, 8:33 PMJon
11/01/2022, 8:33 PMtask_a = always_the_same_a()
task_b = always_the_same_b(task_a)
task_c = something_new_each_time(task_b)
task_d = always_the_same_c(task_c)
Mason Menges
11/01/2022, 8:39 PMJon
11/01/2022, 8:41 PMMason Menges
11/01/2022, 9:01 PMJon
11/01/2022, 9:02 PM@prefect.task
def extract_task(
extract_module_path: str,
extract_function_name: str,
credentials: str,
bronze_file_downloads_dir: str,
) -> list[str]:
extract_function = getattr(
importlib.import_module(extract_module_path), extract_function_name
)
return extract_function(credentials, bronze_file_downloads_dir)
Mason Menges
11/01/2022, 9:04 PMJon
11/01/2022, 9:07 PM