prefect-community #prefect-community

Channels

pacc-oct-11-12-2023

pacc-july-11-12-2023

pacc-sept-20-21-2023

pacc-clearcover-june-12-2023

prefect-getting-started

prefect-integrations

prefect-contributors

best-practices-coordination-plane

Matt Delacour

08/12/2022, 6:43 PM

Thanks for the migration guide from 1.0 to 2.0 Can we have a similar guide of the GraphQL APIs that change from 1.0 to 2.0 if any ?

✅ 1

Alex Shea

08/12/2022, 7:10 PM

Has anyone had an issue with env vars not getting passed from the agent to the job with a kubernetes run leveraging

PREFECT__CLOUD__AGENT__ENV_VARS

agent variable?

Chris Marchetti [Datateer]

08/12/2022, 7:46 PM

Hello, all! I am having a issue when using github actions to deploy a pipeline.

Copy code

[2022-08-12 19:42:34+0000] INFO - prefect.Docker | Pushing image to the registry...

The error is:

Copy code

InterruptedError: EOF

Complete traceback in thread. Anyone seen this before?

Tim Helfensdörfer

08/12/2022, 8:30 PM

Hi, why is the switch for this deployment disabled?

Emil Ordoñez

08/12/2022, 9:52 PM

hey everyone. Here with some maybe dummy question: I wanted to be sure about the concept of "Service Accounts" in the "Growth" Plan. Are those like shared users that we can share, for example across the company or certain areas? For example: • DEV user • QA user • PROD user ? https://www.prefect.io/pricing/

✅ 1

Edmondo Porcu

08/12/2022, 9:54 PM

Anyone who created two tasks but only got one running in Prefect 1.0?

✅ 1

Blake Hamm

08/12/2022, 10:24 PM

Hey all! I'm very impressed with prefect 2! It's been a learning curve, but it definitely feels more pythonic to create flows! Question regarding parameters: I'm passing in a parameter as a python dictionary. It works great with the default settings (although a little unclear on the docs how to define a dictionary parameter in the deploy yaml). However, I would like to have the ability to change the dictionary parameter through the UI on runs. I can't seem to get it to run as expected. Even though I have defined the parameter as a

dict

, it still reads it in as a string in the UI and can't seem to parse it out. I'm pretty much stuck with the default dictionary parameter or I can trigger it from the CLI. Do I essentially have to use

pydantic

and explicitly specify the model when working with dictionary parameters? Some other funny parameter behavior, the UI displays the default parameter as

[object Object]

when I'm creating a custom flow run. But on the flow run (with defaults), it looks like more like a dictionary.

🙌 2

Brad

08/12/2022, 10:59 PM

hey team - I'm having some trouble with my agents picking up work from my work queue, what is the best way to debug?

✅ 1

Rohan Chutke

08/13/2022, 12:25 AM

Hi All, I am using Prefect Cloud. In one of the flows, its trying to upload a file to s3 which is about ~900MB. And the flow is stuck since hours trying to upload that file to s3. Any solutions/ suggestions would really be appreciated. Thanks

MasatoShima

08/13/2022, 1:38 PM

Hi. I’m trying Prefect Orion. I tried to run deployment. However, the flow status stays ‘pending’ and is not executed. Does anyone have any idea what the reason might be? I would be happy to know.

Artur Spatari

08/13/2022, 2:44 PM

Hi team, Someone have experience with programatic scheduling next flow running? Example: Flow A > execute a some logic > take a computed next flow run datetime > schedule execution

Moises Vera

08/13/2022, 6:10 PM

noob question for prefect 2, • is it necessary to run the build command each time I change my code? • looks like the build command changes my deployment file with my old config so I have to re write the old config I had again each time

✅ 1

Marwan Sarieddine

08/13/2022, 6:40 PM

Hi folks, a very minor comment which might help others like myself trying to parse the good content on migrating to prefect 2.0 the youtube channel playlist “Prefect 2.0 Upgrade” does not present the individual videos in the correct order

✅ 1

Rio McMahon

08/13/2022, 7:11 PM

I am attempting to create a custom storage block (Digital Ocean uses an

https://

prefix but

s3://

is hardcoded in the S3 filesystem object). I did this by copying the S3 storage object code and removing the hardcoded prefix but leaving everything else the same (except name and credential arguments). The block successfully registers to prefect cloud. However when I try to attach it as the storage block I get the error in the comments. From what I can tell this is happening during the validation step. At some point prefect is looking at the registry for the

Block

type via:

Copy code

from prefect.utilities.dispatch import lookup_type, get_registry_for_type
from prefect.blocks.core import Block
registry = get_registry_for_type(Block)
print(registry)

which returns all the prefect defined blocks. If I try to build a deployment it will fail because the custom filesystem class I created does not show up in that registry. Currently the remote file system object stores all ‘settings’ as plain text which isn’t ideal because I’m storing access credentials. Thoughts on the best way to proceed?

✅ 1

Dev Dabke

08/13/2022, 7:43 PM

Hi y’all, I’m having a bit of trouble wrapping my head around a couple prefect concepts. I’m trying to set up a simple system for me to run prefect flows. I have a development computer (my laptop) where I write all of my code. Simultaneously, I have a local workstation with a couple GPUs that I want everything to actually run on. What’s the correct way to set up a system with these two machines? Ideally, my workflow would look like this: 1. Make some code changes on my laptop 2. Fire off a workflow run from my laptop that runs on my workstation 3. Enjoy 😎 I’m getting a little confused as to what work queues, agents, deployments, and the dask runner all do. I think where I’m getting a little confused is to how the code from my laptop gets transmitted to my workstation. I use git already, so I would like somehow for me to fire off a workflow run and be able to track exactly which commit ran on my workstation.

✅ 1

Marwan Sarieddine

08/13/2022, 8:32 PM

Hey folks, a question about prefect 2.0 and pydantic. I certainly appreciate using pydantic at the flow level to allow for complex parameter types and to enable type validation/conversion out of the box. However it seems that pydantic supports starts to fail at the task level. More specifically it seems pickling pydantic models using cloudpickle is troublesome. See the thread for a small example. I am curious if this will remain a known issue with certain storage types going forward…

Oscar Björhn

08/14/2022, 11:22 AM

I seem to be unable to create cron-based schedules using the GUI. Anyone know if this is a known issue or if there is some sort of work-around? I just get the message "Failed to create schedule", regardless of what I input. Interval-based schedules appear to work. Edit: Nevermind, seems to be a known issue. https://github.com/PrefectHQ/prefect/issues/6374

👍 1

James Brady

08/14/2022, 1:40 PM

I'm using DaskTaskRunner, karpenter, and the

dask_kubernetes.KubeCluster

class – trying to get a flow to run on a GPU-enabled node. What's happening: • The pod_template I'm using for the flow specifies

<http://nvidia.com/gpu|nvidia.com/gpu>: 1

, per the docs • karpenter starts a new node, which has a GPU (🙌) • However, the new node can't accommodate the dask client because it doesn't have the right resource annotation ("0/3 nodes are available: … , 3 Insufficient nvidia.com/gpu") I realise this might be a question better-suited to the dask community, but would appreciate any stories of people successfully running Prefect 2 workloads on GPU-accelerated nodes and/or help figuring out the above specific issue.

James Phoenix

08/14/2022, 9:02 PM

Why am I receiving this error please? 🙏

James Phoenix

08/14/2022, 9:02 PM

Copy code

File system created with scheme 'gcs' from base path '<gcs://prefect_source_data>' could not be created. You are likely missing a Python module required to use the given storage protocol.

James Phoenix

08/14/2022, 9:03 PM

James Phoenix

08/14/2022, 9:03 PM

Copy code

prefect deployment build base_flow.py:basic_flow --name dev --tag dev --storage-block gcs/dev

James Phoenix

08/14/2022, 9:04 PM

James Phoenix

08/14/2022, 9:04 PM

Shouldn’t it be

gs://

instead of

gcs://

James Phoenix

08/14/2022, 9:21 PM

Copy code

@property
    def basepath(self) -> str:
        return f"gcs://{self.bucket_path}"

    @property
    def filesystem(self) -> RemoteFileSystem:
        settings = {}
        if self.service_account_info:
            try:
                settings["token"] = json.loads(
                    self.service_account_info.get_secret_value()
                )
            except json.JSONDecodeError:
                raise ValueError(
                    "Unable to load provided service_account_info. Please make sure that the provided value is a valid JSON string."
                )
        remote_file_system = RemoteFileSystem(
            basepath=f"gcs://{self.bucket_path}", settings=settings
        )
        return remote_file_system

James Phoenix

08/14/2022, 9:21 PM

https://github.com/PrefectHQ/prefect/blob/main/src/prefect/filesystems.py

Luke Segars

08/15/2022, 2:45 AM

Hi all - I'm having trouble passing env variables into my kubernetes jobs in Prefect v1.2 (so that they're available while my code is running). I'm running jobs in multiple Kubernetes clusters and need to provide some cluster-specific variables to each flow run. Based on some other posts above, I've tried starting my agent in three different ways - it seems like passing as

--env

at agent startup is a great solution, but the env variable is null for all three of these approaches. 1. passing as arg in

prefect agent kubernetes start --env SERVICES_ENDPOINT=XYZ

2. passing directly as an env var to the agent (dont think this is expected to work) 3. passing as

PREFECT___CLOUD____AGENT__ENV_VARS_

any thoughts on what i could be doing wrong? i tried each of these individually

Iuliia Volkova

08/15/2022, 3:07 AM

@Anna Geller Prefect 2.0 hi can you help me with deployments? I'm not sure that I understand the idea. I have a Prefect cluster in K8s. I have some IP address of prefect server. I want to deploy flows from my local machine to Prefect cluster. 1) as in docs I set up PREFECT_URI to my Prefect server -ok 2) I do prefect deployment build - it builds bunch of file for deployment with paths on my local machine 3) I do prefect deployment apply & I got the deployment in Prefect server, but all paths reference to my local env & cluster of course don't have access to it. Question: is there any way how to deploy flows from local env to remote Prefect server? if yes, can you help me that I'm doing wrong? 4) If 'no' so that is expected flow? that command line is running on the remote cluster & I need to write script to copy-paste flows to remote server & after that apply all this 'prefect' commands?

👋 1

Beizhen

08/15/2022, 7:48 AM

Hi community, how do I fix this

ClientError

message? All upstream tasks succeeded. Setup:

prefect 1.2.2

, prefect cloud.

Copy code

Failed to set task state with error: ClientError([{'path': ['set_task_run_states'], 'message': 'State update failed for task run ID f0614b56-3c3b-41f6-9481-878c9f4bee78: provided a running state but associated flow run 8647f325-a45d-4124-9995-b68d43faaf15 is not in a running state.', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}])
Traceback (most recent call last):
  File "/root/miniconda3/lib/python3.8/site-packages/prefect/engine/cloud/task_runner.py", line 91, in call_runner_target_handlers
    state = self.client.set_task_run_state(
  File "/root/miniconda3/lib/python3.8/site-packages/prefect/client/client.py", line 1604, in set_task_run_state
    result = self.graphql(
  File "/root/miniconda3/lib/python3.8/site-packages/prefect/client/client.py", line 464, in graphql
    raise ClientError(result["errors"])
prefect.exceptions.ClientError: [{'path': ['set_task_run_states'], 'message': 'State update failed for task run ID f0614b56-3c3b-41f6-9481-878c9f4bee78: provided a running state but associated flow run 8647f325-a45d-4124-9995-b68d43faaf15 is not in a running state.', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}]

✅ 1

Sven Aoki

08/15/2022, 8:22 AM

Hello, has anyone run a separate docker image in a flow? My prefect deployment goes as:

prefect deployment build fx_run.py:fx_rates_flow -n fx_deploy --infra docker-container -sb remote-file-system/minio

and then I also created a custom docker image with s3fs installed which I pull during deployment. However I keep getting the error:

No such file or directory: 'docker': 'docker'

. Can anyone advise?