Hi We are trying to integrate our prefect flows with github. But I am getting segmentation fault while trying to deploy. And on running the flow it give below E*rror,* Could you please help me idenitify the issue here?

State Message
Flow could not be retrieved from deployment. Traceback (most recent call last): File "<frozen importlib._bootstrap_external>", line 846, in exec_module File "<frozen importlib._bootstrap_external>", line 982, in get_code File "<frozen importlib._bootstrap_external>", line 1039, in get_data FileNotFoundError: [Errno 2] No such file or directory: 'flow_name.py' The above exception was the direct cause of the following exception: ScriptError: Script at 'flow_name.py' encountered an exception: FileNotFoundError(2, 'No such file or directory')

Below is our dir structure in github

└── src
    ├── dev
    │   └── flows
    │       ├── flow
    │       │   ├── README.md
    │       │   ├── flow_name.py
    │       │   ├── flow_deployment.py

And the deployment file is like this

from flow import flow
from prefect.blocks.system import JSON
from prefect.deployments import Deployment
from prefect.filesystems import GitHub

storage = GitHub.load("gh-poc")

FLOW_NAME = "flow_name"


deployment = Deployment.build_from_flow(
    flow=flow_name,
    name=FLOW_NAME,
    parameters={},
    storage=storage,
    path="src/dev/flows/flow_name",
    skip_upload=True,
)

if __name__ == "__main__":
    deployment.apply()
    print("Deployment applied")

The path you are using doesn’t look relative to root? The path of the actual flow from your directory looks like:

/src/dev/flows/flow/flow_name

Does it also depend on from which directory I am running the deployment?

if you are importing the flow, that’s relevant to the path, but otherwise those variables are important for how to retrieve the flow

It worked after setting entrypoint. Ran with this

path="src/dev/flows/flow_name",

I'm running into a similar issue where the files and flows cannot be found. How can I ensure it is pulling the github repo and proper branch? I believe the docker image is in /opt/prefect, however I'm not sure where it is cloning the flow into.

Downloading flow code from storage at 'performance-aggregation-table'
FileNotFoundError: [Errno 2] No such file or directory: '/opt/prefect/performance-aggregation-table'

└── githubrepo
    ├── performance-aggregation-table
    │   └── performance_aggregation_table.py

github_block = GitHub(
            repository = "XXX",
            reference = "github-test", #Branch name
            access_token ="XXX",
        )

deployment = Deployment.build_from_flow(
            path="performance-aggregation-table",
          entrypoint="performance_aggregation_table.py:run_perf_agg",

HI Mitch -

/opt/prefect

would be the default working directory that a clone would occur into

Got it. I will give it a try. Thanks Christopher

Out of curiosuity, have you tested using the new

prefect deploy

way? I’ll be honest, it’s been a hot minute since I’ve done the pythonic deployment + a github repo block, so it’s possible my steps aren’t right here either. It looks like it’s trying to download from that path (first line) not the cloned repo

From the CLI? No, we are migrating everything over from prefect 1 so just have been trying to setup everything to make it easiest. We have around 150 scripts and it gets complicated managing all of them and having to use the cli to deploy everything

Hey Mitch, if you’re using enterprise, you should have access to support@prefect.io and the team should be able to assist you

It appears that when I specify a path, the code is not downloaded from github.