How do I run Prefect behind nginx? I have: https://www.my-site.com/app https://www.my-site.com/prefect And I need Prefect to rewrite the URL such that all assets (e.g. css, javascript, etc.) are rewritten with the

/prefect

prefix. Otherwise users will get a blank page when visiting /prefect, because the assets won’t be pointing to the right location. Does anyone have any experience with that? Should I set

PREFECT_UI_SERVE_BASE

env var? How should the Dockerfile for the agent change?

Is it possible to pass a file to a prefect flow via a parameter? The file is small but would contain data that is required for the flow to execute some tasks. This would be run ad-hoc.

How to install prefect in mac m2? Following pip install -U prefect I was not able to install it

Is there a way to update all blocks in the UI to be the latest version of itself? E.g., I have different versions of an

S3 Bucket

block. One is older and has deprecated fields, another seems like the (current) newest version, etc.

What is the canonical way to get the value of a Secret block? Inspecting the code, I can do:

from prefect.blocks.system import Secret

secret_block = Secret.load("BLOCK_NAME")

# Access the stored secret
secret_block.get()
print(secret_block.value._secret_value)

Is this the "correct" approach?

Hi, what is the right way to respond to a cancellation in the UI? I have a task that kicks off an asynchronous run of a job in an external resource, and would like to send a cancel request to that job when the flow is cancelled in the UI. I have an understanding of how this would have been done in Prefect 1 (with state_handlers) but I'm not sure of the right way to do this in Prefect 2. I found this thread, are there any other options other than external automation?: https://prefect-community.slack.com/archives/CL09KU1K7/p1680768549224399

hi how can i modify the prefect user interface design , i have gitcloned the ui-library repository and try to connect it with the prefect dev server but i dont know how to but upon checking the node modules of the prefect dev server @prefecthq/ui-library the files are in vue.d.ts , is there any guide regarding on this?

‘prefect worker start -p my worker’ doesn’t terminate, I.e. keeps running. In gitlab ci it then times out. How best to have this command complete?

Hi, how do I keep my agents running even when I don't have my pc on? When I close the terminal, scheduled jobs don't complete until I run

prefect agent start

again.

Hello! We are running Prefect 2 with a Kubernetes agent on the Azure Kubernetes service having recently upgraded from v1. We are now finding that our agent seems to become marked as unhealthy in the cloud UI after some time and no longer picks up jobs. Despite this, the agent pod seems to still be running without any issues.

Hello, I have configured my prefect agent with a supervisor configuration to keep it running and this is connected to the ci/cd pipeline to restart the supervisor on code changes. However, I don't want to kill the flow the agent is currently executing, it can stop and restart after the current flow is done. How do I achieve this, some sort of a graceful restart?

HI everyone i'm trying to configure the pod of my agent to restart in case of failure using this in my YAML

livenessProbe:
          failureThreshold: 2
          httpGet:
            path: /healthz
            port: 8080
          initialDelaySeconds: 360
          periodSeconds: 300

but I am facing this error

Liveness probe failed: Get "<http://10.112.2.178:8080/healthz>": dial tcp 10.112.2.178:8080: connect: connection refused

. Any idea please ?

Hello, just wanted to confirm: did the block names in the latest version of prefect become unique ? I can't use the same block if the block slugs are different ? Previously on prefect ~2.10.0 I was able to create:

block_slug_1/block_name_1
block_slug_2/block_name_1

(I'm on latest prefect 2.10.6 right now)

Hi. I am not sure why, but we started seeing an error for s3 block storage:

Downloading flow code from storage at 'sample'

Flow could not be retrieved from deployment.
Traceback (most recent call last):
  File "<frozen importlib._bootstrap_external>", line 879, in exec_module
  File "<frozen importlib._bootstrap_external>", line 1016, in get_code
  File "<frozen importlib._bootstrap_external>", line 1073, in get_data
FileNotFoundError: [Errno 2] No such file or directory: '/my_org/flows/equities/sample/sample.py'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/prefect/engine.py", line 276, in retrieve_flow_then_begin_flow_run
    flow = await load_flow_from_flow_run(flow_run, client=client)
  File "/usr/local/lib/python3.10/dist-packages/prefect/client/utilities.py", line 40, in with_injected_client
    return await fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/prefect/deployments.py", line 217, in load_flow_from_flow_run
    flow = await run_sync_in_worker_thread(load_flow_from_entrypoint, str(import_path))
  File "/usr/local/lib/python3.10/dist-packages/prefect/utilities/asyncutils.py", line 91, in run_sync_in_worker_thread
    return await anyio.to_thread.run_sync(
  File "/usr/local/lib/python3.10/dist-packages/anyio/to_thread.py", line 31, in run_sync
    return await get_asynclib().run_sync_in_worker_thread(
  File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
    return await future
  File "/usr/local/lib/python3.10/dist-packages/anyio/_backends/_asyncio.py", line 867, in run
    result = context.run(func, *args)
  File "/usr/local/lib/python3.10/dist-packages/prefect/flows.py", line 809, in load_flow_from_entrypoint
    flow = import_object(entrypoint)
  File "/usr/local/lib/python3.10/dist-packages/prefect/utilities/importtools.py", line 201, in import_object
    module = load_script_as_module(script_path)
  File "/usr/local/lib/python3.10/dist-packages/prefect/utilities/importtools.py", line 164, in load_script_as_module
    raise ScriptError(user_exc=exc, path=path) from exc
prefect.exceptions.ScriptError: Script at 'flows/equities/sample/sample.py' encountered an exception: FileNotFoundError(2, 'No such file or directory')

Do you have any ideas what's changed recently?

Is there a way to mention/tag a user or group in Slack when sending a notification from Prefect Automation? I'm using

<@U03MK7Z2ULQ>

and

<!subteam^S037DR39NGP>

in the message body, but they just come as plain text. Looks like the message body is sanitized by Prefect. Does anyone have a similar issue or knows how to get it working? 🙏

Hi all. I'm trying to deploy my etl using github filesystem. I've pushed my python script containing the flow on github, created a github block on Prefect, and I've this deployment code:

from prefect.deployments import Deployment
from prefect.filesystems import GitHub
from etl_web_to_gcs import etl

github_block = GitHub.load("github-block")

# Deployment Object
github_dep = Deployment.build_from_flow(
    flow=etl,
    name="github-flow",
    infrastructure=github_block
)

if __name__ == "__main__":
    github_dep.apply()

When I run the code above, I get the following error:

...
cls_init(__pydantic_self__, **data)
 File "pydantic/main.py", line 341, in pydantic.main.BaseModel.__init__
pydantic.error_wrappers.ValidationError: 1 validation error for Deployment
infrastructure
 Infrastructure block must have 'run-infrastructure' capabilities. (type=value_error)

Any idea how to fix this?

Hello, it seems the button to “Cancel” a flowrun from the prefect UI is gone. If I refresh the page a bunch of times it will eventually show up. When I click it I see the error “Failed to cancel flow”. If I try to pause the flow I get “Failed to pause flow”. Any idea on whats wrong?

Does anyone know if PRs are visible in the PrefectHQ repo even if not all of the tasks are complete? I have a PR where I can't complete the

pre-commit run --all

step due to my machine, but the change is just to documentation, not the actual code.

Is there a limit to how many tasks I can create in Prefect? I am trying to submit a total of~4k tasks and it gets to about 3.3K of them before getting a

Crash detected! Execution was cancelled by the runtime environment

error log with no other context. What is everyone’s experience with submitting a large amount of tasks? I have a different flow that submits about 1000 concurrent tasks and I have not had any problems with that one

I followed this guide to deploy an agent to ECS. My agent starts, but keeps failing with this error. Does anyone know what may be causing this? Any help is appreciated.

Hello, when my code to deploy my flows, I'm seeing a warning (<string>3 DeprecationWarning: The 'prefect.orion' module has been deprecated. It will not be available after Aug 2023. Use 'prefect.server' instead.). However, I don't have any reference to prefect.orion in my code. Is this expected?

Hi, I'm seeing a strange issue when using Ray inside a flow that doesn't use

RayTaskRunner

. Ray is initialized from within a

task

and an

ActorPool

is used to run some logic, and then another

task

runs which may take a few minutes to run. After the task using Ray completes, after a minute or so the entire flow crashes with the following error:

gcs_rpc_client.h:533: Failed to connect to GCS within 60 seconds. GCS may have been killed. It's either GCS is terminated by `ray stop` or is killed unexpectedly. If it is killed unexpectedly, see the log file gcs_server.out. <https://docs.ray.io/en/master/ray-observability/ray-logging.html#logging-directory-structure>. The program will terminate.

I have a minimal example here: https://gist.github.com/concreted/6d9f4a1165fc79c510f9a63ac28363b4 Saving that to a file

ray_test.py

and running

python ray_test.py

should reproduce the issue. I see the issue on Ubuntu 18.04, but not on Mac.

Hello, it seems like there's conflicting version between Prefect 2.10.6 and s3fs when using S3 storage. Was anybody able to make that work without getting errors when running the flows?

Hi everyone, i want to start trying the cloud, i want to load some info to snowflake, but i need the outgoing IPs that prefect cloud use to whitelist them, is posible this? (edited)

Since updating to 2.10.6 I cannot get my scheduled deployments to run. I started fresh with a new database, created a work pool, deployed all of my jobs with build_from_flow like I did in the past, and put all deployments into that work pool. The work pool shows all of my work queues, all of them are healthy, and all have a schedule in the deployments tab, but nothing is running and no scheduled flows show up in the UI. I've gone through all of the steps multiple times and get the same result: a work pool with work queues and deployments, but no scheduled flows. At my wits end

Can anyone suggest the most stable version of Prefect 2? After forced migration from very stable Prefect 1 we keep encountering issue after issue with the service. I would prefect to pin a specific version and focus on the data output, not to battle the infrastructure.

Hello, I'm using Prefect 2.3.1. How do I effectively stop a flow run such that all child processes are killed immediately and the flow enters a failed state? Stopping the agent, the flow continues to be in a running state

Has anyone seen this error before? I'm running Prefect 2.10.4

Can anyone help me out on the below one in prefect 1.0 used this style used in the custom utilities

from prefect.utilities.tasks import defaults_from_attrs
@defaults_from_attrs("params", "upstream_result")
def run(self, params={}, poll_interval: str = None):
    -----

I got stuck with this in prefect 2.0 to use the alternate one to use in my custom library

I am trying to migrate my self-hosted prefect server and agents to a new prefect version. I managed to successfully migrate the server from version

2.7.4

to

2.10.6

, but when I try to do the same to the agents, all of them fail to start with the error:

RuntimeError: Unable to find any timezone configuration

. Any ideas?