Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hey everyone! I'm trying to use the multiprocessing module in conjunction with prefect tasks/flows and I'm getting an error:
```Finished in state Failed("Task run encountered an exception: _pickle.PicklingError: Can't pickle &lt;function ExtractLargeSQLServerData.extract_chunk_of_table_from_sql_server_to_blob at 0x00000209400FB600&gt;: import of module '__prefect_loader__' failed\n")```
extract_chunk_of_table_from_sql_server_to_blob is the function I'm trying to spin up in parallel. is there a way to do this with multiprocessing or do I need to rewrite it to use Prefect's built in dask parallel processing?