Also, is there any support from Prefect Core to store flow and task metadata in a Postgres db? For example, store each flow and task runs ID and their states? Thank you.

I believe you could use state handlers to populate a postgres db, or anywhere really: https://docs.prefect.io/core/concepts/notifications.html#state-handlers Also, the newly released prefect server stores metadata at its own postgres server, which is used to provide you with information in the prefect server UI. That may be too overkill a solution to just store metadata though.

Thank you for your reply. I was using state handlers to monitor the tasks, didnt think about using them to store the metadata, you're absolutely right 🙂