Hamza Mogni
12/26/2024, 1:18 PMDeployment
stack, each deployment in its own file, each file has a deployment.apply()
which would deploy it when run.
We are currently migrating to using prefect.yaml
(our understanding is that Deployment
is getting deprecated). My question is: is it normal to put all deployments in same file? this would lead to a huge yaml file that could easily become unmaintainable, if not, what do you guys use as patterns to circumvent this?Yaron Levi
12/26/2024, 1:50 PMYaron Levi
12/26/2024, 1:50 PMYaron Levi
12/26/2024, 1:52 PMYaron Levi
12/26/2024, 1:53 PMprefect --no-prompt deploy --all
as usual, as we've just programatically created the yaml file.Yaron Levi
12/26/2024, 1:54 PMHamza Mogni
12/26/2024, 2:06 PMHamza Mogni
12/26/2024, 2:07 PMYaron Levi
12/26/2024, 2:40 PMYaron Levi
12/26/2024, 2:40 PMYaron Levi
12/26/2024, 2:40 PMNate
12/26/2024, 3:19 PMprefect deploy
so you dont have to keep all your definitions in the same yaml fileNate
12/26/2024, 3:20 PMNate
12/26/2024, 3:25 PMhow do you manage flows that have multiple deployments linked to it?im not sure I understand the question, you can always create many deployments from one flow - what do you see as the organizational challenge as it relates to that?
Hamza Mogni
12/26/2024, 8:45 PM--prefect-file
but my understanding is that it only takes one file path as an argument, meaning there would be a need for a preprocessing step to merge definitions from separate yaml files into a single one and then feed the output to --prefect-file.Nate
12/26/2024, 8:47 PMNate
12/26/2024, 8:47 PMHamza Mogni
12/26/2024, 8:49 PMglobal-definitions.yaml
which would be automatically picked up by prefect before applying deployments from different yaml filesNate
12/26/2024, 8:52 PMHamza Mogni
12/26/2024, 8:55 PMNate
12/26/2024, 8:55 PMHamza Mogni
12/26/2024, 8:56 PMHamza Mogni
12/27/2024, 11:20 AM