Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi! We are writing out some telemetry and logs to our own postgres instance (stuff that sits outside of the purview of the prefect logs). We have a LogHandler for this, and it calls out to sqlalchemy. Is it recommended to use the PostgresExecute task as opposed to using our own bespoke DB handlers? In that case, we might handle the ORM call out with PostgresExecute.run(..)

Additionally, it looks like the PostgresExecutor creates a new connection every time, could the executor support connection pooling in the future?

Sorry I missed this. I’d say use what is best for you. The reason for the connection every time is because of being able to support mapping over Dask