https://prefect.io logo
Title
m

madhav

02/24/2022, 5:34 PM
Hi! We are writing out some telemetry and logs to our own postgres instance (stuff that sits outside of the purview of the prefect logs). We have a LogHandler for this, and it calls out to sqlalchemy. Is it recommended to use the PostgresExecute task as opposed to using our own bespoke DB handlers? In that case, we might handle the ORM call out with PostgresExecute.run(..)
Additionally, it looks like the PostgresExecutor creates a new connection every time, could the executor support connection pooling in the future?
k

Kevin Kho

02/24/2022, 10:44 PM
Sorry I missed this. I’d say use what is best for you. The reason for the connection every time is because of being able to support mapping over Dask