Hi everyone,
1. Can anyone please share how you s...
# ask-communitya
Awaish Kumar
11/21/2023, 9:13 AMHi everyone,
1. Can anyone please share how you structure your prefect project in github?
2. Also do you run deploy build and apply commands locally?
3. Or do we maintain the deployment yaml files in github?
E.g: something similar like below.
├── Business_logic
├── data
├── env
├── pipelines
│ │ │── transformations.py
│ │ │── utils.py
│ │ │
│ │ │
└── README.md
└── Makefile
└── requirements.txt
y
Yaron Levi
11/21/2023, 9:23 AMWe are using the ECS push work pools with the prefect.yaml
Yaron Levi
11/21/2023, 9:23 AMWe have two workspaces (staging and prod).
Yaron Levi
11/21/2023, 9:24 AMWe a github action that run “prefect deploy --all” to publish the deployments in the prefect.yaml
Yaron Levi
11/21/2023, 9:24 AMYaron Levi
11/21/2023, 9:25 AMTo run locally we just do it directly via vscode
Yaron Levi
11/21/2023, 9:25 AMlike in the Prefect docs
Yaron Levi
11/21/2023, 9:26 AMThe prefect.yaml:
Yaron Levi
11/21/2023, 9:26 AMa
Awaish Kumar
11/21/2023, 9:33 AMAh ok, thank you so much for the details.
So flow goes like this:
Development -> push to github-> github action triggers and register flows with prefect cloud -> prefect run the tasks on schedule on provided infrastructure ( ECS push in your case) ? And here you are providing the work pool information in prefect.yaml file for all the flows instead of providing it for every single flow?
y
Yaron Levi
11/21/2023, 9:35 AMyes exactly. The work pool is defined once, and used by all deployments.
🙌 1
a
Awaish Kumar
12/04/2023, 9:24 AMHi @Yaron Levi I added GCP push as my architecture with similar prefect.yml as yours. But when trying to trigger the flow run I am getting below error. Do you have any idea what's happening? Many thanks
Copy code
Failed due to a(n) InfrastructureError Flow run infrastructure exited with non-zero status code: Exited with non 0 code. (Error Code: 1). This may be caused by attempting to run an image with a misspecified platform or architecture.y
Yaron Levi
12/04/2023, 9:25 AMI have no clue actually. I would ask this in the community group
a
Awaish Kumar
12/04/2023, 9:31 AMNo Worries thank you 🙂
👍 1
4 Views