Hey again everyone is anyone implementing prefect while init

Question

Hey again everyone is anyone implementing prefect while initializing local agents inside kubernetes pods When our kubernetes pods die off and restart for whatever reason the old agents continue to live in a dead state in prefect Eventually the agents accumlate and slow the whole UI down and deteriorate the performance Anyone else have this problem or know a way to manage the agents in code

Kevin Kho · Answer

A bit curious why the local agent in the Kubernetes pods I personally haven t seen anyone do it but wouldn t know if there is some here who does

Joshua Weber · Answer

We initialize them in the start script for the ETL ```prefect agent local start l $ EDW l chizzle a $ PREFECT SERVER APOLLO URL show flow logs amp ``` We re looking for a way to use the prefect agents but we have to find a way to copy the whole DBT code repo to the agents

Joshua Weber · Answer

We end up with a `local agent` for each replication instance of the ETL and they eventually die out then accumulate

Kevin Kho · Answer

You could <https www prefect io blog orchestrating elt on kubernetes with prefect dbt and snowflake part 2 |clone the dbt> repo into the Kubernetes pod through the image entrypoint or through Python code Have you seen that setup

Joshua Weber · Answer

Is there examples or documentation to look at

Kevin Kho · Answer

The post above is a link to a blog

Joshua Weber · Answer

lol you linked to it

Joshua Weber · Answer

Thanks

Joshua Weber · Answer

I ll check it out