https://prefect.io logo
Title
i

Isara Ovin

06/28/2022, 8:41 AM
im getting an error
zsh: segmentation fault  python app.py
when im trying to run a flow using
LocalDaskExecutor
using threads can someone please help
My Flow
with Flow("local-reader", executor=LocalDaskExecutor(scheduler="threads")) as flow:
   
    directory = Parameter('directory', required=True) 

    path_list = locate_local_files(directory)
    data = local_file_reader.map(path_list)
    output = filter_empty_responses(data)
k

Kevin Kho

06/28/2022, 3:11 PM
I think this is an out of memory thing. you can try to garbage collect more by saving out the data and reading it in the next task?
i

Isara Ovin

06/30/2022, 3:00 PM
wrapping
flow.run()
around
if __name__ == "__main__":
solved this without doing any changes