Dylan
06/01/2022, 9:33 PMwith Flow(
name=FLOW_NAME,
storage=Local(
add_default_labels=False,
stored_as_script=True,
path="flows/order_list_ingest.py",
),
run_config=KubernetesRun(
image=f"{config.ECR_REGISTRY}/{config.PROJECT}:{config.IMAGE_TAG}",
labels=[config.ENVIRONMENT],
job_template_path="templates/base-flow-template.yaml",
service_account_name=config.S3_BUCKET,
),
executor=LocalExecutor(),
) as flow:
client = OrderApi()
raw_data = get_order_list(client, **seed_params())
save(raw_data, PREFIX)
prefect register --project parcel-planet-ingest -p flows/order_list_ingest.py
Anna Geller
Dylan
06/01/2022, 9:42 PMAnna Geller
Kevin Kho
Dylan
06/01/2022, 10:32 PMKevin Kho
Dylan
06/01/2022, 10:37 PMget_order_list
in the flow when I meant to call api_get_order_list
, there isn’t a get_order_list
. So I wonder if the __pycache__
came into play at all. Could obvi be a rabbit hole for no good reason but it was definitely strange to see code being executed, whose function name didn’t quite exist.Kevin Kho
flow.run()
or Cloud flow? Could happen if there was no re-registration?Dylan
06/01/2022, 10:47 PM.run()
on anything in the flow itself.Kevin Kho
Anna Geller