Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Is it recommended to use a Postgres backend when using Dask? I am getting the following errors with the default SQLite implementation. `sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) unable to open database file`

i could run tasks with DaskTaskRunner with sqlite (prefect2)

&gt; Is it recommended to use a Postgres backend when using Dask
IMO yes since you will most likely come across issues with concurrent writes which won't work with SQLite

Postgres or just using Cloud - both works: <https://app.prefect.cloud/>

I need to setup a local testing environment, otherwise we will be using cloud for production and staging areas. Thank you

The DB is happy since I switched to Posgres. Thank you!