Hello everyone, I'm trying to execute a flow using an existent dask cluster but I'm getting the following error:

[2021-03-23 17:16:53+0000] ERROR - prefect.my-flow | Unexpected error occured in FlowRunner: ModuleNotFoundError("No module named 'prefect'")

This is what I'm doing:

executor = DaskExecutor("my-dask-cluster-ip")
flow.run(executor=executor)

If I use other executors (LocalExecutor or LocalDaskExecutor) it runs fine. Any idea on what I can do to address this issue?

hey guys! i have the following error:

INTERNAL_SERVER_ERROR: Variable "$input" got invalid value null at
        "input.states[0].task_run_id"; Expected non-nullable type UUID! not to be null.

The GraphQL query was:

    mutation($input: set_task_run_states_input!) {
            set_task_run_states(input: $input) {
                states {
                    message
                    status
                    id
            }
        }
    }

The passed variables were:

    {"input": {"states": [{"state": {"message": "Trigger was \"all_successful\" but some of the upstream tasks failed.", "_result": {"location": null, "__version__": "0.14.11", "type": "Result"}, "cached_inputs": {}, "context": {"tags": []}, "__version__": "0.14.11", "type": "TriggerFailed"}, "task_run_id": null, "version": null}]}}

what is the issue? I'm not sure how to debug this

Hi there 🙂 Is it by design that scheduled flow will not use updated flow default parameters. e.g. • schedule a flow • let them run • update the default params • for the next run the old/wrong default values are used On Prefect local server 0.14.12 Btw: There is no way, to specify params for a specific schedule, right? That would be awesome and necessary in a way.

Hi, we are running prefect server with the helm chart installation on a GKE kubernetes cluster. We noticed that some flows fail without us being able to see why. In particular we receive as the final log that marks a working flow

Finished task run for task with final state: 'Running'

after that the flows state is completely off and it get’s hard to understand what happens. But already that log seems wrong. Any clue about why and when a task might finish with a running state?

Is it right, that a run with warnings will not be reflected in the gui (e.g. with a yellow color)? or is this a setting?

Anyone got any ideas of how to force the postgres chart used in the helm chart to deploy on a particular node pool? Have tried this;

postgresql:
      postgresqlPassword: ***
      nodeSelector:
        <http://cloud.google.com/gke-nodepool|cloud.google.com/gke-nodepool>: some-node-pool

I have also just bumped my version to

core-0.14.12

and I am getting this error;

{'type': ['Unsupported value: Module']}

Has module storage been removed?

Hello Prefect team! I was curious about agent monitoring; do agents publish metrics? If so, how does that work? We're looking to start the hybrid model w/ cloud and wanted to see how this would work

Hi prefect team, I happen to see you “run prefect on prefect” in one of your job postings, so I am wondering how you run services via prefect? Are tasks/flows supposed to be short living?

Hello everyone! I am working with a server shared between JupyterLab and Prefect, and it happened to me recently that when running a code in JupyterLab, it turned out wrong and caused JupyterLab to crash, and along with it, Prefect UI as well. As a result of this I was investigating 2 things but I did not find much information in the documentation and that is why I turn to you. 1: Is it possible to have 2 servers, one for JupyterLab and the other for Prefect, but where you can still work hand in hand with both? (I would use this to solve the issue by ensuring that, if one of them falls, the other one doesn't, but if you come up with another solution I am all ears) 2: Is there a way for Prefect to notify me when the UI goes down?

Hey, i’m getting

ModuleNotFoundError: No module named 'data_flows'

when I try to register my flow locally using docker storage (specifically it’s failing the

cloudpickle_deserialization_check

healthcheck). we’re using fully qualified imports in our flows (e.g.

from data_flows.utils.data_extraction tasks import thing

) to satisfy mypy, so i’m hoping there’s a way to get this working as well. i think the config matches the tutorial, and i’ve tried different values for the python path without any luck. Here’s our Docker setup:

Docker(
    registry_url=ecr_registry_url,
    python_dependencies=python_dependencies,
    files={
        "/Users/jilliankozyra/projects/projectname/data_flows/utils/__init__.py": "/data_flows/utils/__init__.py",
        "/Users/jilliankozyra/projects/projectname/data_flows/utils/install_dependencies.py": "/data_flows/utils/install_dependencies.py",
        "/Users/jilliankozyra/projects/projectname/data_flows/utils/data_extraction_tasks.py": "/data_flows/utils/data_extraction_tasks.py"
    },
    env_vars={
        "PYTHONPATH": "$PYTHONPATH:data_flows/"
    },
)

Congrats on the release of 0.14.13! I am just wondering if we could use prefect build to validate the flows/tasks in our code before registering them? Or are you planing to do something like prefect validate?

Hey Prefect Team! My team is moving towards Cloud, and we wanted to know if there was any docs on the following enterprise features: • SLA service for configuring special alerts • SSO integration • Special Types of Cloud Hooks for notificaitons • Audit trail of tenant activity • Secure Runtime Secrets

What versions of kubernetes are supported for the helm chart deployment of prefect-server? I'm trying to target 1.14.8

Hey Prefect Team! I see that to use gitlab storage we have to use access tokens, which i've tested and worked great! However, our team's standards typically use deploy tokens for services. Is this supported?

How do I get the k8s logs from a

RunNamespacedJob

task?

Hi there Is there a way to disable the quick run? Also in the upcoming runs... It's quite dangerous...

Hi Team, I'm evaluating Prefect as data flow pipeline and started learning and trying out. My setup is Prefect Server, LocalAgent running inside a docker and creating task from jupyter Notebook and registering flow using S3 storage. I could all but when I run getting error "Failed to load and execute Flow's environment: AttributeError("'NoneType' object has no attribute 'setup'")"I know making some simple mistake, any help would be appreciated. Flow is simple hello world.

Hey folks, a question about Schedules here: When a Flow is run, if the hard-coded Schedule/Clock is different from the Schedule/Clock in the API, will anything strange/bad happen? Or is updating the API over the hard-coded values how the UI does scheduling? For example, let's say I code up a Flow with a Schedule and a few Clocks, then register it to Prefect Server. I can go to the API and query my Flow and see its schedule and all that. If I use the API to mutate my flow's Clock(s), I'm assuming that whatever data is in the API will be what the Agent will look at to see if it's time to run the Flow. But when the Flow actually goes to run, will the Schedule objects match whatever is coming from the API or will they come from the hard-coded Flow? I want to avoid having the API say "Run this flow at 3am with Params X, Y, and Z" but when the Flow actually goes to run, it says, "This flow will run at 2pm with Params A, B, and C."

Is there a way to specify a resource manager when using the imperative API?

I'm getting errors whenever I try pushing a prefect flow that's about 1500 tasks big. Is there a reason this happens?

Hi, is it possible to use

prefect.engine.flow_runner.FlowRunner

or

prefect.engine.cloud.flow_runner.CloudFlowRunner

with a prefect server backend? I am wanting to run a flow and get task results so wanting to use the arg

return_tasks=[task1,task2]

. But I don't think I can do this with

prefect.Client().create_flow_run(version_group_id="redacted")

?

Hello everyone! I built a simple ETL and it is working perfectly. When I run the agent in the cloud I get an error saying "cannot pickle psycopg2", any clues?

Hi, how do I delete a tenant which I created like this? Thank you.

prefect server create-tenant -n data-eng

I set up a virtual environment in my ubunutu machine for prefect. my question is why are results saved in the home/ubuntu/.prefect/results and not on the environment

Hi folks, Im running into this weird error where the default prefect tables are not getting created when the server starts up for the first time. I actually got the whole thing working in our staging env, but when I pushed to our prod env, it seems like the default tables don’t exist. I don’t see the tables in prod hasura, like the ones I see in our staging hasura. Any insight/help would be much appreciated!

I was able to get prefect installed, register a flow on prefect cloud, and now I would like to use prefect cloud to run flows stored on my AWS instance. I am trying to follow this, but even something as simple as installing the package at step 1 isn't working for me

pip install prefect[aws]
zsh: no matches found: prefect[aws]

Hi all, I’m new to Prefect. Is there anything I should know about using

async def

 and

await

in defining and within tasks?

I haven’t found anything on the docs, besides using Dask for parallelism, but I would just want to not wait for I/O, it’s not about complex computing tasks.

hey guys, I am running prefect agent ecs start in terminal and getting this error. What is the syntax it wants me to use?

ValueError: Failed to infer default networkConfiguration, please explicitly configure using `--run-task-kwargs`