Dylan
06/01/2022, 9:33 PMwith Flow(
name=FLOW_NAME,
storage=Local(
add_default_labels=False,
stored_as_script=True,
path="flows/order_list_ingest.py",
),
run_config=KubernetesRun(
image=f"{config.ECR_REGISTRY}/{config.PROJECT}:{config.IMAGE_TAG}",
labels=[config.ENVIRONMENT],
job_template_path="templates/base-flow-template.yaml",
service_account_name=config.S3_BUCKET,
),
executor=LocalExecutor(),
) as flow:
client = OrderApi()
raw_data = get_order_list(client, **seed_params())
save(raw_data, PREFIX)
prefect register --project parcel-planet-ingest -p flows/order_list_ingest.py
Anna Geller
06/01/2022, 9:42 PMDylan
06/01/2022, 9:42 PMAnna Geller
06/01/2022, 9:53 PMKevin Kho
06/01/2022, 10:26 PMDylan
06/01/2022, 10:32 PMKevin Kho
06/01/2022, 10:36 PMDylan
06/01/2022, 10:37 PMget_order_list
in the flow when I meant to call api_get_order_list
, there isn’t a get_order_list
. So I wonder if the __pycache__
came into play at all. Could obvi be a rabbit hole for no good reason but it was definitely strange to see code being executed, whose function name didn’t quite exist.Kevin Kho
06/01/2022, 10:39 PMflow.run()
or Cloud flow? Could happen if there was no re-registration?Dylan
06/01/2022, 10:47 PM.run()
on anything in the flow itself.Kevin Kho
06/01/2022, 10:49 PMAnna Geller
06/01/2022, 11:12 PM