Hello everyone! Do you have any suggestions on how to calculate and distribute prefect costs to different projects that are running flows on the same prefect kubernetes deployment?
We have a prefect 1.4 deployment in Azure Kubernetes Service that runs flows for different projects. The problem is that some projects consume a lot of resources while others consume almost nothing. How can we keep track of what resources/costs where consumed form which project?
We are thinking of doing some custom calculations using logs from promitheus or some even more custom solutions but I was wondering if there is a good solution already out there.
✅ 1
g
George Coyne
06/30/2023, 2:29 PM
My move is to label all workloads with cost attribution metadata, this can be done in Prefect the work pool level!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.