https://prefect.io logo
t

Tim Enders

08/16/2022, 1:59 PM
Is it recommended to use a Postgres backend when using Dask? I am getting the following errors with the default SQLite implementation.
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) unable to open database file
1
m

Marcin Grzybowski

08/16/2022, 2:19 PM
i could run tasks with DaskTaskRunner with sqlite (prefect2)
a

Anna Geller

08/16/2022, 2:28 PM
Is it recommended to use a Postgres backend when using Dask
IMO yes since you will most likely come across issues with concurrent writes which won't work with SQLite Postgres or just using Cloud - both works: https://app.prefect.cloud/
👍 1
t

Tim Enders

08/16/2022, 2:37 PM
I need to setup a local testing environment, otherwise we will be using cloud for production and staging areas. Thank you
The DB is happy since I switched to Posgres. Thank you!
🙌 1
5 Views