classes to hold database connection and HTTP connection pools while I map over everything in my Dask cluster. Is it not possible to share a connection pool across a Dask mapped pipeline (thinking about it now, it would be difficult)? If not how should I go about mapped reading & writing? Thanks.
Aiden Price
01/15/2021, 12:38 AM
Something I forgot to mention, I'm also trying to cache the result in this instance, which will then lead to mapping downstream of this point.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.