Hi, I am trying to solve a problem with different ...
# ask-communityp
Parwez Noori
09/21/2022, 12:48 PMHi, I am trying to solve a problem with different repos using prefect 2.
I have a repo for prefect itself and then repos for the DS projects. Each have virtual environments setup.
I have simple flows setup that:
1. Creates a yaml file for each deployment and applying a schedule for each deployment visible in prefect cloud.
2. Run the scheduled tasks as k8s jobs.
However when I'm pushing deployments from the DS repo it is registered but never actually run/triggered. I have also created another storage block for DS project, but this has not solved the problem.
k
Khuyen Tran
09/21/2022, 3:16 PMDid you start the agent with the same work queue as the deployment when running the deployment?
p
Parwez Noori
09/22/2022, 7:47 AMYes I did.
k
Khuyen Tran
09/22/2022, 3:34 PMHave you tried to use the process infrastructure to see if the deployment runs?
p
Parwez Noori
09/27/2022, 7:26 AMNo I will do that now!
Parwez Noori
10/04/2022, 8:03 AMHi @Khuyen Tran it does not run as an process either. What else can be done?
k
Khuyen Tran
10/04/2022, 2:28 PMCan you paste the command you use to create the deployment?
p
Parwez Noori
10/05/2022, 1:55 PMprefect deployment build run_model.py:run_xgboost
Copy code
-n run_model_xgboost Copy code
-i kubernetes-job Copy code
-sb azure/azure-block Copy code
--cron "15 8,9 * * *"Parwez Noori
10/05/2022, 1:55 PMprefect deployment apply ./yaml-files/run_xgboost.yaml
k
Khuyen Tran
10/05/2022, 1:57 PMAnd what is your agent run command like?
p
Parwez Noori
10/05/2022, 1:59 PMcommand:
- prefect
- agent
- start
- '-q'
- kubernetes
Parwez Noori
10/05/2022, 2:00 PMMy normal deployments from the "prefect repo" works great.
Parwez Noori
10/05/2022, 2:00 PMHowever, as soon as I'm in another path on my local pc then it does not work.
Parwez Noori
10/05/2022, 2:01 PMC:\Users\username\github\prefect_repo works
C:\Users\username\github\data_science does not
Parwez Noori
10/05/2022, 2:02 PMThe deployment is visible in UI, but when it should actually run the deployment. It does never run.
k
Khuyen Tran
10/05/2022, 2:53 PMIt should work independent of the name of the path. Is there a difference in dependencies between prefect_repo and data_science?
✅ 1
p
Parwez Noori
10/05/2022, 3:06 PMYES Khuyen!
Parwez Noori
10/05/2022, 3:06 PMThank you a lot. There was a difference between the dependencies.
Parwez Noori
10/05/2022, 3:07 PMAppreciate the help!!! 🙌
3 Views