I have created an Azure VM with Docker and Prefect Agent using the marketplace template "Prefect Agents". My flows and dependencies are stored in an Azure Container Registry. I used Cloud Prefect for my UI and got everything running as expected. I wanted to verify what happens with the authentication from the VM to the Container Registry if the VM ever has to restart. Once i restarted the VM, I noticed in the Cloud Prefect UI that the agent stopped polling. I am assuming that the VM restart, did not restart the Prefect Agent on the VM.
Has anyone experienced this specifically when creating a VM with the marketplace template? Maybe this is a bug in the marketplace template that doesnt account for VM restarts. Under normal circumstances i would think there would almost never be a restart, but i know Azure isnt perfect, plus if there are updates that need to get done to the VM.
a
Anna Geller
01/21/2022, 2:10 PM
Thanks for raising this! I will check with my integrations colleagues whether this is something we can address. Usually, when starting a local or docker agent yourself, we recommend using Supervisor so that the agent is automatically restarted if it fails for some reason
k
Kirk Quinbar
02/11/2022, 4:53 PM
@Anna Geller was there any followup to this? can the integrations people make changes to the marketplace template? and when?
a
Anna Geller
02/11/2022, 7:14 PM
We have an open ticket for that, there are just so many things to do 😅 I'm sick atm so I can't look into it myself. I'd suggest if you need an immediate solution, you can follow the steps from this documentation page and once we update the Azure template I will make sure to update you
Anna Geller
02/11/2022, 7:16 PM
@Marvin open "Azure marketplace Docker agent needs to be adjusted to ensure that agent process gets restarted on VM reboot"
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.