Hi there, could you share what you use (or what are some of the best tools to use) for tracking execution of jobs in Prefect? We can use UI to check every flow, but if our flow consist of for instance 20 parts (sql queries, etc…) do you use something to track execution time. I know we can use DB to check query execution, but is there some tool recommended by Prefect for these types of tracking? That tool in dream world would show execution for every part of the flow so we can check over time what is going on or which jobs are problematic

They are poeple interested about using prometheus to monitor job/task prefect. They are an issue open you are welcome to add your input. Is it the type of monitoring you are looking for ? https://github.com/PrefectHQ/server/issues/266

We don’t really have a specific requirement, but would like to have something in place atm we can use Snowflake query_history and check execution time, etc… and also connect it to Tableau or basically any other tool, but would be nice to see if someone has a solution in place, that could be used Previously for something similar (Snowflake query usage) we used Looker (they had a pre-built monitoring in place and it was a matter of one click, good thing was that you could create notifications for long running queries… Something like that (also simpler) would be interesting to check out