Jan Nitschke
04/04/2022, 9:52 AMfrom tasks import my_task
from prefect.storage import GitHub
from prefect import Flow
from prefect.run_configs import ECSRun
storage = GitHub(
repo="repo", # name of repo
path="path/to/myflow.py", # location of flow file in repo
access_token_secret="GITHUB_ACCESS_KEY", # name of personal access token secret
)
with Flow(name="foobar",
run_config=ECSRun(),
storage=storage) as flow:
my_task()
The problem seems to be that the GitHub storage only clones the single file and not the entire project which causes my import to fail. (ModuleNotFoundError("No module named 'tasks'")
) I've seen that there has been some discussion around this issue but it hasn't really helped me to solve the issue.... Is my only option to clone the repo into the custom image that I use for my ECS task? But that would mean that I would have to rebuild that image every time I change something to my underlying modules, right?Jan Nitschke
04/04/2022, 10:57 AM