Hi! Decided to try to migrate to Prefect 2 but have some trouble getting a Docker agent going. I get the error:

Flow could not be retrieved from deployment.

On Prefect 1 I would package all my python dependencies in an Docker image, as well as the flow code (using storage=Module()). What would be the equivalent for Prefect 2? I saw the option of putting the flow definitions on AWS but I don't really see the point

Hey! Random question - with v1, is it still possible to use the Cloud UI, and connect it up to my apollo/graphql endpoint? With server, you can change the endpoint when clicking on this button

If I have a flow, with a task

task_name

, which returns "some_value", and I do:

state = flow.run()

How to I get the return of

task_name

? (ie "some_value")

I was mapping through 1000 tasks, Orion logger can get mad and throw an error, but I just realized that the flow will still continue. I was cancelling the flow and trying to debug what I did wrong but I just had to be a little more patient 🤦‍♂️

Hi, I'm quite new to Prefect, very much still learning. I'm using Prefect 1.0. I have a flow that launches another flow using create_flow_run. I'd like to be able to access a Parameter's value and use it to set the run_name of the subsequent flow. I read this doc and saw the use case of using the state_handler to rename the current flow. Is there a way to get the Parameter value in the flow and use it in my create_flow_run for run_name? Can state_handler be used for that? Here's an example of what I'm trying to achieve:

with Flow(name="my_parent_flow") as flow:
    name = Parameter('name')
    ...
    create_flow_run.map(
        flow_name=unmapped('child_flow')
        ...
        run_name=unmapped(f'<use Parameter 'name''s value> child run')
    )

I'm creating a deployment via prefect deployment build & prefect deployment apply. When I check prefect cloud, I can see the deployment but it says 'This deployment is deprecated.' Any tips? I've tried deleting via UI and trying again.

In 2.0, is there a way to see a list of running/not-running agents similar to that in Cloud 1.0?

we have installed required packages that need to connect to the redshift cluster but still when we try to register the flows we are seeing the following error

Failed to load and execute Flow's environment: FlowStorageError('An error occurred while unpickling the flow:\n  ModuleNotFoundError("No module named \'redshift_connector\'")\nThis may be due to a missing Python module in your current environment. Please ensure you have all required flow dependencies installed.')

Hello folks! I got a bit confused about hosting Prefect on a cloud VM explained here: https://discourse.prefect.io/t/hosting-a-remote-orion-instance-on-a-cloud-vm/967 Is my understanding true? We have our code locally in vscode, and we create a VM. Then we do all the settings mentioned in the link. Now, if we run the flow locally, it will be executed on the VM and not the local machine, right?

Hey everyone! I’m currently evaluating different orchestrators like Airflow, Prefect and Metaflow for an MLOps pipeline in a large enterprise. I’ve already done a little bit of research and came across even with combinations of Prefect as a general orchestrator and Metaflow for ML DAGs. I’m currently leaning more towards Prefect. Has anyone worked with any of the aforementioned tools to offer some insights? (edited)

Thanks for the migration guide from 1.0 to 2.0 Can we have a similar guide of the GraphQL APIs that change from 1.0 to 2.0 if any ?

Has anyone had an issue with env vars not getting passed from the agent to the job with a kubernetes run leveraging

PREFECT__CLOUD__AGENT__ENV_VARS

agent variable?

Hello, all! I am having a issue when using github actions to deploy a pipeline.

[2022-08-12 19:42:34+0000] INFO - prefect.Docker | Pushing image to the registry...

The error is:

InterruptedError: EOF

Complete traceback in thread. Anyone seen this before?

Hi, why is the switch for this deployment disabled?

hey everyone. Here with some maybe dummy question: I wanted to be sure about the concept of "Service Accounts" in the "Growth" Plan. Are those like shared users that we can share, for example across the company or certain areas? For example: • DEV user • QA user • PROD user ? https://www.prefect.io/pricing/

Anyone who created two tasks but only got one running in Prefect 1.0?

Hey all! I'm very impressed with prefect 2! It's been a learning curve, but it definitely feels more pythonic to create flows! Question regarding parameters: I'm passing in a parameter as a python dictionary. It works great with the default settings (although a little unclear on the docs how to define a dictionary parameter in the deploy yaml). However, I would like to have the ability to change the dictionary parameter through the UI on runs. I can't seem to get it to run as expected. Even though I have defined the parameter as a

dict

, it still reads it in as a string in the UI and can't seem to parse it out. I'm pretty much stuck with the default dictionary parameter or I can trigger it from the CLI. Do I essentially have to use

pydantic

and explicitly specify the model when working with dictionary parameters? Some other funny parameter behavior, the UI displays the default parameter as

[object Object]

when I'm creating a custom flow run. But on the flow run (with defaults), it looks like more like a dictionary.

hey team - I'm having some trouble with my agents picking up work from my work queue, what is the best way to debug?

Hi All, I am using Prefect Cloud. In one of the flows, its trying to upload a file to s3 which is about ~900MB. And the flow is stuck since hours trying to upload that file to s3. Any solutions/ suggestions would really be appreciated. Thanks

Hi. I’m trying Prefect Orion. I tried to run deployment. However, the flow status stays ‘pending’ and is not executed. Does anyone have any idea what the reason might be? I would be happy to know.

Hi team, Someone have experience with programatic scheduling next flow running? Example: Flow A > execute a some logic > take a computed next flow run datetime > schedule execution

noob question for prefect 2, • is it necessary to run the build command each time I change my code? • looks like the build command changes my deployment file with my old config so I have to re write the old config I had again each time

Hi folks, a very minor comment which might help others like myself trying to parse the good content on migrating to prefect 2.0 the youtube channel playlist “Prefect 2.0 Upgrade” does not present the individual videos in the correct order

I am attempting to create a custom storage block (Digital Ocean uses an

https://

prefix but

s3://

is hardcoded in the S3 filesystem object). I did this by copying the S3 storage object code and removing the hardcoded prefix but leaving everything else the same (except name and credential arguments). The block successfully registers to prefect cloud. However when I try to attach it as the storage block I get the error in the comments. From what I can tell this is happening during the validation step. At some point prefect is looking at the registry for the

Block

type via:

from prefect.utilities.dispatch import lookup_type, get_registry_for_type
from prefect.blocks.core import Block
registry = get_registry_for_type(Block)
print(registry)

which returns all the prefect defined blocks. If I try to build a deployment it will fail because the custom filesystem class I created does not show up in that registry. Currently the remote file system object stores all ‘settings’ as plain text which isn’t ideal because I’m storing access credentials. Thoughts on the best way to proceed?

Hi y’all, I’m having a bit of trouble wrapping my head around a couple prefect concepts. I’m trying to set up a simple system for me to run prefect flows. I have a development computer (my laptop) where I write all of my code. Simultaneously, I have a local workstation with a couple GPUs that I want everything to actually run on. What’s the correct way to set up a system with these two machines? Ideally, my workflow would look like this: 1. Make some code changes on my laptop 2. Fire off a workflow run from my laptop that runs on my workstation 3. Enjoy 😎 I’m getting a little confused as to what work queues, agents, deployments, and the dask runner all do. I think where I’m getting a little confused is to how the code from my laptop gets transmitted to my workstation. I use git already, so I would like somehow for me to fire off a workflow run and be able to track exactly which commit ran on my workstation.

Hey folks, a question about prefect 2.0 and pydantic. I certainly appreciate using pydantic at the flow level to allow for complex parameter types and to enable type validation/conversion out of the box. However it seems that pydantic supports starts to fail at the task level. More specifically it seems pickling pydantic models using cloudpickle is troublesome. See the thread for a small example. I am curious if this will remain a known issue with certain storage types going forward…

I seem to be unable to create cron-based schedules using the GUI. Anyone know if this is a known issue or if there is some sort of work-around? I just get the message "Failed to create schedule", regardless of what I input. Interval-based schedules appear to work. Edit: Nevermind, seems to be a known issue. https://github.com/PrefectHQ/prefect/issues/6374

I'm using DaskTaskRunner, karpenter, and the

dask_kubernetes.KubeCluster

class – trying to get a flow to run on a GPU-enabled node. What's happening: • The pod_template I'm using for the flow specifies

<http://nvidia.com/gpu|nvidia.com/gpu>: 1

, per the docs • karpenter starts a new node, which has a GPU (🙌) • However, the new node can't accommodate the dask client because it doesn't have the right resource annotation ("0/3 nodes are available: … , 3 Insufficient nvidia.com/gpu") I realise this might be a question better-suited to the dask community, but would appreciate any stories of people successfully running Prefect 2 workloads on GPU-accelerated nodes and/or help figuring out the above specific issue.

Why am I receiving this error please? 🙏