Ok, so I guess the UI changed in Prefect Cloud, and now deployments goes under flows? How do I remove all this crap here? There is no delete button for these flows

Hi there, We can't start one of our flows with a specific tag. The tasks just hang in the scheduling state. If we remove this tag, the tasks will work just fine. In Flow Concurency, we see that some process is running with this tag, but we can't find which one. Could you help us?

Hello, I’m using ECS Fargate as my agent. It keeps falling into an unhealthy state. Not sure what’s going on. Can anyone help me debug?

Hi, Good Morning. I have a question. I have a flow that runs several subflows in sequence, which I need to run in parallel. Is there any way I can do it? I was looking a

submit

interface at the SubFlows, but I couldn’t found it. What I could found is an existing issue about it, so I wanted to know if you already found a solution for this scenario. Is there a way to set upstream dependency as well?. thanks in advance

Hi team, why is the deployments tab gone from the UI? Is this a bug?

Someone else have the problem, that "copy to new run" does not actually copy the parameters to the new flow creation dialog anymore?

Hey all, I have problems running a deployed prefect flow so that it runs with local filesystem. Running the flow locally works fine (

python flow.py

). However, when deploying the code and triggering a run from the API, downloading flow code takes more than 10 minutes and eventually fails. I am pretty sure that the same or similar setup worked a couple of weeks ago 😮

Did a deployment link dissapear from prefect cloud?

Hi all - is there a list of public IP addresses for Prefect Cloud (i.e. for integrations with services so they can also have prefect access be restricted by inbound IP)?

hey, I attempted to add an on-fail slack alert with a decorator like so:

def Flow(*flow_args, **flow_kwargs):
    # basically the same as @prefect.flow but adds Slack webhook
    def decorator(func):
        @wraps(func)
        def wrapper(*args, **kwargs):
            try:
                return func(*args, **kwargs)
            except Exception as e:
                slack_webhook_block = SlackWebhook.load("alerts-prefect")

                msg = f"Your job {func.__name__} failed with exception {e}.\n"
                msg += f"See the flow run at: <https://prefect.myinstance.net/flow-runs/flow-run/{prt.flow_run.id}>\n"
                msg += f"Tags: {prt.flow_run.tags}\n"
                msg += f"Scheduled start time = {prt.flow_run.scheduled_start_time}"

                slack_webhook_block.notify(msg)
                raise e

        return flow(*flow_args, **flow_kwargs)(wrapper)
    return decorator

it works, but it pings for each retry of the flow. any tips to make my flow ping only once the whole thing fails, not just a retry?

Hi All, We are using a script to programmatically delete unused blocks from our dev environment via the API using

prefect block delete...

. However, when trying to delete these blocks, we keep getting 409 Conflict error codes on those blocks. Strange, because the same blocks can be deleted just fine through the UI. Any ideas on how we could resolve this? Feeling like some kind of issue with how the API is handling block deletion...

Hi, I need to copy data from DB query to CSV File, using Prefect V2. On prefect V1, I have used

psycopg2

library

copy_expert

method on cursor, I wanted to know if there is any behavior I can take advantage from on

SqlAlchemyConnector

class?

my prefect flows are retrying way too many times. I set

retries=2

but they consistently run

9x

before finally failing. this makes me think that there is some other process also retrying 3x? has anybody encountered this before?

Is there any way that I can adjust the time before a flow becomes marked as late? It's occasionally taking my VM worker a minute or so to start on a flow, which is not an issue, but I'd like to be alerted if a flow takes longer than 15 minutes to start.

Hi there, I would like to use

prefect deploy --all

to deploy multiple deployments stored in a

deployment.yaml

file. I have a build step stored in

prefect.yaml

to generate an image containing flow dependencies where

push: true

to ensure that the built image is pushed to Google Artifact Registry (from which Cloud Run infra will pull from). The call to

deploy

is being carried out in a GitHub action, before calling

prefect deploy --all

, I have run

gcloud auth configure-docker <http://us-docker.pkg.dev|us-docker.pkg.dev>

to configure

gcloud

as the credential helper for docker. However, this action is currently failing with the error

unauthorized: access token has insufficient scopes

because Prefect seems to be attempting to push to

<http://docker.io|docker.io>

still (

The push refers to repository [<http://docker.io/.../...|docker.io/.../...>]

). Any thoughts on what's causing this?

Hi there, I am a Data analyst and new to Prefect. I found Perfect super powerful. I am trying to apply the prefect cloud to deploy and schedule the flow to my daily work, but I encounter some problems. Could someone provide me the guidance? I can run my flow on my local machine using

Prefect Orion Start

and doesn't seem to affect the user-facing behavior of the application, but still show the message regarding

SSL 997 error

. When I try to connect to Prefect cloud under my company domain (VPN), it failed and I am not able to connect to Prefect Cloud. It showed that

"ERROR: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:997)"

. I understand I do not have the certificate on my laptop, so it might be the reason. I found those resources might be helpful, but still have no clue to solve my issue. Could someone guide me on the issue? https://github.com/PrefectHQ/prefect/issues/7596 https://github.com/PrefectHQ/prefect/issues/6038 My laptop is Windows and our company is using Zscaler so I am not sure if I still can set up a proxy server to solve it. Thanks,

Hi, I built a jenkins pipeline, to deploy flows automatically every time a PR is merged in my github repo. but for some reason is failing: I am using a

docker-git

recipe, and I am running these commands:

prefect cloud login -k {key} -w {workspace}
prefect project init --recipe docker-git -f image_name=some-docker-image -f tag=latest -f repository={repository} -f branch=master
prefect deploy {flow_path}.py:{access_method} -n {flow_name} -p pool

Output:

Warning: extra fields provided for 'docker-git' recipe: 'repository, branch'
12:52:38  ---------------
12:52:38  Created project in /home/ec2-user/workspace/_Team_automation-flows-v2_master 
12:52:38  with the following new files:
12:52:38  deployment.yaml
12:52:38  prefect.yaml
12:52:38  .prefect/
12:52:41  An exception occurred.
12:52:41  Traceback (most recent call last):
12:52:41    File "/usr/local/lib/python3.8/site-packages/urllib3/connectionpool.py", line 703, in urlopen
12:52:41      httplib_response = self._make_request(
12:52:41    File "/usr/local/lib/python3.8/site-packages/urllib3/connectionpool.py", line 398, in _make_request
12:52:41      conn.request(method, url, **httplib_request_kw)
12:52:41    File "/usr/local/lib/python3.8/site-packages/urllib3/connection.py", line 244, in request
12:52:41      super(HTTPConnection, self).request(method, url, body=body, headers=headers)
12:52:41    File "/usr/local/lib/python3.8/http/client.py", line 1252, in request
12:52:41      self._send_request(method, url, body, headers, encode_chunked)
12:52:41    File "/usr/local/lib/python3.8/http/client.py", line 1298, in _send_request
12:52:41      self.endheaders(body, encode_chunked=encode_chunked)
12:52:41    File "/usr/local/lib/python3.8/http/client.py", line 1247, in endheaders
12:52:41      self._send_output(message_body, encode_chunked=encode_chunked)
12:52:41    File "/usr/local/lib/python3.8/http/client.py", line 1007, in _send_output
12:52:41      self.send(msg)
12:52:41    File "/usr/local/lib/python3.8/http/client.py", line 947, in send
12:52:41      self.connect()
12:52:41    File "/usr/local/lib/python3.8/site-packages/docker/transport/unixconn.py", line 27, in connect
12:52:41      sock.connect(self.unix_socket)
12:52:41  FileNotFoundError: [Errno 2] No such file or directory

How do streaming flows count for the API Rate Limits in Prefect Cloud?

Someone from prefect cloud security team?

hi. where do cloud webhooks connections originate from? prefect cloud or agents?

Hi, I am SeungTae who is working in Qrafte Technologies, fintech startup, South Korea. I registered enterprise plan request on the prefect.io website 3 days ago but I cannot receive any response from prefect team. Who should I request enterprise plan price in this slack? Thank you 🙂

Hi I’ve been testing some shellOperation task

@flow
def demo_flow():
    with ShellOperation(commands=['sleep 1m', 'echo "hello world"']) as shell_task:
        process = shell_task.trigger()
        process.wait_for_completion()
        output = process.fetch_result()
        get_run_logger().info(f'Output: "{output}"')


if __name__ == '__main__':
    demo_flow()

But it is failing, with this error:

10:31:35.447 | ERROR   | asyncio - Exception in callback SubprocessStreamProtocol.pipe_data_received(1, b'hello world\n')
handle: <Handle SubprocessStreamProtocol.pipe_data_received(1, b'hello world\n')>
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/asyncio/events.py", line 81, in _run
    self._context.run(self._callback, *self._args)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/asyncio/subprocess.py", line 73, in pipe_data_received
    reader.feed_data(data)
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/asyncio/streams.py", line 472, in feed_data
    assert not self._eof, 'feed_data after feed_eof'
AssertionError: feed_data after feed_eof

prefect: 2.10.9 prefect-shell: 0.1.5 python: 3.8.10

Hi all, anyone know how I can run prefect in render? It works locally and env vars are set, but not seeing my job in prefect cloud on the render run

Hi, My use case is that there are certain flows which will be in

Paused

more than 30 days. So in prefect cloud, those flow will be deleted automatically?

Hey all, is there a way to automatically cancel or rerun tasks when a work queue gets unhealthy? For example, an EC2 instance is shut down periodically. It seems like tasks that are still running when the instance is shut down are lost in the limbo, instead of noticing the unhealthy work queue and cancelling / restarting when the worker is back online 🤔

Hello, I have a product work queue that has suddenly become unhealthy over the weekend. Nothing changed, except that the flow runs that are scheduled are not running. I run an agent for a single work pool, that has 2 different work queues. Anybody have this happen before? I have tried to copy them to new runs, as well as cancel and retry them, but neither of those options is getting picked up by my agent... this is v high priority for my team, so any help would be great

Heya! Question about Prefect Cloud plans We would like to expand our "Personal" plan a bit with adding

Enforced SSO

via Google. On Pricing page, I see it is available, but in the docs Single Sign-on (SSO), it states following

Prefect Cloud's Organization and Enterprise plans offer single sign-on (SSO) integration

Am I correct assuming the Google SSO is not available on Personal tier? edit: In other words, for us to be able to use SSO, we need to upgrade to "Organisation" plan?

hey Prefect team, What is the best practice for handling flow re runs if an agent running a local process restarts in the middle of a flow run?

Hey guys. Does Prefect Cloud have EU region? GCP?

Is there a recommended way to see which agents are running and their health from the Cloud UI?