https://prefect.io logo
Powered by
Title
m

Mateo Merlo

08/02/2022, 2:46 PM
Hi there! I am having an issue with Prefect 1.2.4 running a flow of flows. I followed the tutorial https://www.prefect.io/guide/blog/flow-of-flows-orchestrating-elt-with-prefect-and-dbt/ that is great and helped me a lot to connect DBT with other flows. This was working fine but suddenly start to fails with this error: Error during execution of task: ValueError("Flow 'ETL' not found.")
The ETL flow is there and when I run it manually it works. Seems like the problem is when the "flow of flows" call the ETL flow and is not able to find it. Anyone else have this issue?
n

Nate

08/02/2022, 5:07 PM
Hi @Mateo Merlo a couple questions: • where are you seeing this error? (e.g. Prefect Cloud logs, on your machine, someplace else?) • what is your 
run_config
/ runtime infrastructure?
m

Mateo Merlo

08/02/2022, 5:41 PM
Hi @Nate! Thanks for your response. 1. In Prefect Cloud logs. 2. I'm using GCS as storage and the run_config: 
flow.run_config = DockerRun(
            image="europe-west1-docker.pkg.dev/bi-project/project-etl/project-etl:latest",
            labels=["prod"],
            env={"PREFECT__CLOUD__HEARTBEAT_MODE": "thread"}
        )
The custom image is built from this `Dockerfile`: 
FROM prefecthq/prefect:1.2.4-python3.8

COPY requirements.txt /app/

RUN pip install --upgrade pip && \
    pip install --no-cache-dir -r app/requirements.txt

COPY . /app/

WORKDIR /app
RUN pip install -e .
@Nate sorry to ping you again but do you have any idea where this issue can come from?
n

Nate

08/03/2022, 1:54 PM
Hi @Mateo Merlo, apologies for the delay I'm not immediately sure but later today I'll look at that tutorial and try to reproduce that issue
m

Mateo Merlo

08/03/2022, 3:52 PM
@Nate I just solved it. It was a typo error in the StartFlowRun params 🤦‍♂️
Thanks so much for your help! 😒imple_smile:
👍 1
n

Nate

08/03/2022, 4:04 PM
great to hear!
5 Views
#prefect-communityJoin Slack
Powered by