Andrew Stewart
02/09/2022, 3:05 PMKevin Kho
02/09/2022, 3:10 PMAndrew Stewart
02/09/2022, 3:11 PMKevin Kho
02/09/2022, 3:11 PMCollecting flows...
======================== 0 registered ========================
or
Registering 'unique logger'... Skipped (metadata unchanged)
================== 0 registered, 1 skipped ==================
Andrew Stewart
02/09/2022, 3:14 PMKevin Kho
02/09/2022, 3:16 PMZanie
02/09/2022, 3:19 PMAndrew Stewart
02/09/2022, 3:27 PMZanie
02/09/2022, 3:37 PMprefect run
or prefect register
look for flows in your file, we do not find them.def get_flow():
with Flow("etl") as flow:
airport = Parameter("airport", default="IAD")
radius = Parameter("radius", default=200)
reference_data = extract_reference_data()
live_data = extract_live_data(airport, radius, reference_data)
transformed_live_data = transform(live_data, reference_data)
load_reference_data(reference_data)
load_live_data(transformed_live_data)
return flow
flow = get_flow()
if __name__ == "__main__":
flow.run(airport="DCA", radius=10)
Andrew Stewart
02/09/2022, 3:43 PMKevin Kho
02/09/2022, 4:02 PM