Does anyone know if it is possible to kick off a script in a different git repo in a prefect flow?

Arun Giridharan

08/06/2021, 5:24 PM

Does anyone know if it is possible to kick off a script in a different git repo in a prefect flow?

Allyson Lubimir

08/06/2021, 6:42 PM

hi Arun! you should be able to grab the script and run it as a task. you may want to use a ShellTask to capture the output you need from it!

Arun Giridharan

08/06/2021, 6:43 PM

Hi Allison! How would I point to the command that is located on a different repo?

Allyson Lubimir

08/06/2021, 7:59 PM

I'm not quite sure I follow your question, could you explain what you're looking for?

Arun Giridharan

08/06/2021, 8:04 PM

Sure, There's a python script

foo.py

located in a git repo

repo1

. I've set up my prefect flow in a different repo

repo2

. As part of my flow, I want to run this

foo.py

script, so it would look something like this

Copy code

with Flow("hello-world") as flow:
     script_output = ShellTask(repo1.foopy)

Arun Giridharan

08/06/2021, 8:22 PM

I'm not bound to ShellTask, alternatives are welcome too 🙂

Allyson Lubimir

08/06/2021, 8:43 PM

thanks for that! Looking at your example, I think the best plan would be to register your dependent script as a Flow, and use the

StartFlowRun

task to call it when you need it. Hope that helps, let us know if you need more info!

5 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.