Hello everyone! Do you have any suggestions on how to calculate and distribute prefect costs to different projects that are running flows on the same prefect kubernetes deployment?
We have a prefect 1.4 deployment in Azure Kubernetes Service that runs flows for different projects. The problem is that some projects consume a lot of resources while others consume almost nothing. How can we keep track of what resources/costs where consumed form which project?
We are thinking of doing some custom calculations using logs from promitheus or some even more custom solutions but I was wondering if there is a good solution already out there.
06/30/2023, 2:29 PM
My move is to label all workloads with cost attribution metadata, this can be done in Prefect the work pool level!