Hi - just wondering if anyone knows of a way to point studio.apollographql - at the cloud api? It has nice query building and introspection features I would like to use? Not sure how I would do the authentication?

Hello again, do agents work with Azure's Storage Blob Data Reader privilege to pull Flow from Azure Blob Storage?

Could someone help me understand what is happening with this flow_run?

063bd788-bc0c-46f5-85e4-1092c2b19297

Hi all, how can I skip all the tasks in the flow if there is holiday on that day or any particular date? Assuming I already have a list of holidays. What can be the best approach?

Hi all, is there a way I can specify a task to run only once within a flow? I have noticed some of my tasks run concurrently, this is an issue when I am writing to a table

Hi everyone, Whenever you post a question, please let us know whether your question is about Prefect 2.0 or Prefect 1.0. Otherwise, we all have to waste time figuring out which product you are asking about- that's negative engineering - let's eliminate it. Thanks a lot!

Hi all, I'm switching to DockerRun (image on Azure container registry) and GitStorage (github) on Prefect 2.0. I'm running into an ValueError error when attempting to run a flow. It doesn't throw an error on a specific task so I'm not sure where the problem lays. My runs agent on a VM that is authenticated with "docker login myregistry.azurecr.io". The agent shows that, for the run, the image was succesfully pulled. Any pointers where the issue could be? Thanks!

Hi. Unclear if this is the correct forum for this so please correct me if not. I'm evaluating prefect as a long-term solution for my company, and from a cursory glance prefect 1.0 looks like a perfect fit, with the one exception of the dependency on docker which we're not thrilled about. I tested a copy of 2.0 locally and whilst the solution works well the UI leaves a bit to be desired compared to 1.0. Is the plan to completely replace the 1.0 functionality with 2.0 in the future? I understand that DAGs are now out and so no more schematic diagrams and such in the future

By when can we expect to have databricks notebook triggering feature in prefect 2.0 ?

ModuleNotFoundError("No module named '/root/'") , is there anybody meet thish prob. when run. a flow on. k8s agent ?

Can I scale an (1.0) agent to 3x replicas with the same service account / api key? Or does each replica need its own service account and api key?

Apologies if this has already been answered--but in the 'old' Prefect we started up agents with the -p flag so that we can point them to local modules that our flows needed to import. This functionality seems to have gone away with Orion. Is there some analogous way to indicate to the agent the location of local files that need to be imported? For reference, the short stack trace I'm getting is

Flow could not be retrieved from deployment.

Traceback (most recent call last):

File "/tmp/flow-script-calculate-blob-size4cemrmn_.py", line 1, in <module>

ModuleNotFoundError: No module named 'local_module'

This message was deleted.

Hi there - I am running into an issue with the

DbtShellTask

; locally works all as expected. when i deploy to prefect cloud, I am getting a

dbt: command not found

.. requirements include

dbt-redshift

. My flow storage is Docker. when i try to build the Docker image locally, inside the container I also get

dbt: command not found

even though it is installed in my python environment packages. Has anyone run into this before?

Is there a way to make a state handler do something different if a specific task fails? For example, I have a chain of tasks that depend on each other:

a -> b ->c

I want it so that if

a

and

b

fails, it sends a Slack notifications saying “Flow failed”. But if

c

fails, I want it alter the Slack message by adding b’s output

Hi! Is there a difference between placing a Parameter() before and after the flow context?

Follow up to the above thread - we are running into an issue now with connecting dbt to our Redshift warehouse in Cloud... have verified that all the environment variables are working correctly, do we need to install anything explicitly in our Docker image?

01:13:51  Running with dbt=1.1.0
01:13:51  Partial parse save file not found. Starting full parse.
01:13:52  Found 9 models, 75 tests, 0 snapshots, 0 analyses, 196 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics
01:13:52
01:13:52  Encountered an error:
Database Error
  could not connect to server: No such file or directory
  	Is the server running locally and accepting
  	connections on Unix domain socket "/var/run/postgresql/.s.PGSQL.5439"?

Hi, I have a question about subclassing the

Result

object. I am doing operations on spark

DataFrames

in

Tasks

and would like to pass a

DataFrame

from

Task

to

Task

via the

Result

object. If the

DataFrame

is too large to fit in memory simply passing a custom serializer won’t work. So I am thinking I could create a subclass of

Result

called

SparkDataFrameResult

where the

read

and

write

methods are overridden to use the spark

load

and

save

methods. 1. Is there any reason this wouldn’t work or wouldn’t be recommended? 2. Are there any best practices for doing something like this?

Hi, How can I execute a map inside a task? Something like this (code in thread):

Hey Prefect team I am using edge function in my prefect work flow here is code

Hey, i was wondering if it is possible to use a map inside an apply map

hi, i start to use prefect 2.0 and am struggling to solve an ssl-error when logging to cloud, am trying to login within a docker container..

Hi all. I’m currently running a deployment with a flow like: .. (sorry, please follow the thread for the original message!)

Anyone got an idea whether it is possible to view the average lateness of a flow in the new 2.0 Cloud UI? It was possible with the old UI (top right corner if I remember correctly)

Hi, How can i run prefect tasks in order of downstream, for example if i have three tasks a, b , c and the stream looks like a > b > c, then if there is one worker. then i want to run a then b and then c, but its running likt a for first element in stream, then a again then b, then b again for next element and then c

Hi All! With prefect1.0 my parent flow stuck at status. I have given labels to it but still not working . Any suggestions on how to debug the flow? Status: It has been 15 seconds and your flow run has not been submitted by an agent. Agent 57f7d146-3361-4aef-b0e7-9961bb1fa183 (agent) has matching labels and last queried a few seconds ago. It should deploy your flow run.

When running a flow from prefect cloud using a Coiled Dask executor, I'm noticing long waits (on the order of minutes) before the first task starts running. Is that expected? Are there any best practices (or even not-so-best practices) that can be used to shorten that loop? I'm hoping to make it part of a dev iteration cycle, which would make those two minutes pretty common, and thus expensive I'm also asking the Coiled people if there are any options on their side

Hello! I have a flow in 2.0 with two tasks that I want to run sequentially. I am using a docker flow runner and my flow looks something like this:

@flow
def records_analysis_flow():
    ...
    future = ingest_csv(config)
    future.wait()
    future = analyze_records(ra_config)
    future.wait()

I noticed somewhat inconsistent performance results. If I run the code in docker without prefect it takes around 154 seconds but when I run it in prefect it takes almost 900 seconds. However, if I explicitly set the task runner to sequential, then it takes ~ 180 seconds. Is my flow doing something wrong? Why does the concurrent task runner take so long? Thanks!

Hi all, are there any utilities to determine how many tasks were charged for a given flow run? (Using Prefect Cloud)

Apologies if something like this has been asked before. I'm developing a flow in 1.x with Cloud that will need to adhere to API rate limiting (e.g. 1 request per second). Is there a first class executor agnostic way of doing this? I will be making the http requests in mapped tasks. The best I've come up with is to use https://pyratelimiter.readthedocs.io/en/latest/ to create a queue thats persisted to some sort of storage backend (like sqlite if only using a local dask executor). Each mapped task that needs to make an api request will wait to acquire a slot in the queue before proceeding