John
07/27/2022, 4:04 PM@task
def update_task(file_type: str):
update_files(file_type=file_type)
@flow
def update_flow(file_type: str):
update_task(file_type=file_type)
if __name__ == '__main__':
update_flow(file_type="incremental")
I am running it as python -m tasks.prefect_flows.update_flow
. This takes 10+ minutes to run. By comparison, just running the same code with a click CLI takes 10s. Any idea what's going on?Taylor Curran
07/27/2022, 4:46 PMKhuyen Tran
07/27/2022, 4:49 PMexport PREFECT_LOGGING_LEVEL='DEBUG'
Taylor Curran
07/27/2022, 4:51 PMbreakpoint()
(native python) inside my flow/task code then running the file python flow_file.py
with a good ol’ if name == main block. That way I can step through each line.John
07/27/2022, 4:55 PMTaylor Curran
07/27/2022, 4:58 PM