Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Screen Shot 2022-01-12 at 10.29.18 PM.png

Screen Shot 2022-01-12 at 10.31.59 PM.png

Hello, glad to join the Prefect community. I have a question on the flow that i registered on the UI, but it always shows this error and pointing to a directory different than my teammates. Just feel like on the UI it is using a different of the version of the getApplicant task. But it can be executed locally with no error. see screenshots below. What would be the cause for this? Thanks

Hi <@U02TMGX6V2A>, did you re-register the flow after changing it?

Yes i did. It showed up as a new version on the UI.but still has same error.

If it’s script based like Github, I think you didn’t update the version in Git?

um, i tripple checked that the tasks are up to date with our production codebase. And also checked diff with others in the company. pretty sure they are the same code. It is weird that after i register it to UI, it will error out.

i think the only thing to help here is add more logging statements and see if they populate in your Flow?

Are you using Docker/Kubernetes for the Flow?

Yes we do use Docker images. But I was told that it would need update if there are new packages used. What are some of the checks I need to do with using Docker image?

Do you use the `DockerRun` and `docker agent` with Prefect? Or do you just run `local agent` inside a Docker container?

Can you share your storage and run config definition?

```STORAGE = S3(bucket="aven-etl-workflows")
RUN_CONFIG = ECSRun(
    task_definition_arn="prefect-ecs-ml-tasks:2",
    labels=["prod", "ecs"],
    run_task_kwargs=dict(
        cluster="prefect-ecs-tasks",
        launchType="FARGATE",
        networkConfiguration={
            'awsvpcConfiguration': {
                'subnets': [
                    'subnet-0a989b19518b3206e', 'subnet-0f893d51e54868283', 'subnet-0859b2ff39561515b',
                ],
                'securityGroups': [
                    'sg-0090032547625a7c2',
                ],
                'assignPublicIp': 'DISABLED'
            }
        },
    ),
)```


This looks pretty fine and should work as long you re-register. This just uses the default prefect image to run right? You don’t have any configuration on the agent side?

<@U02TMGX6V2A> it looks like some packaging issue. Are you sure the getApplicants is baked into the Docker image that you are using? What is your process for packaging dependencies and building the image?