Has anyone encountered the following error when using the ECS agent? Is there an easy way to increase the number of retries or backoff interval?

An error occurred (ThrottlingException) when calling the RegisterTaskDefinition operation (reached max retries: 2): Rate exceeded

I'm nearly there on getting my first successful flow run with an ECS work pool, but I keep getting a Crashed run with this error:

Flow run infrastructure exited with non-zero status code:
 Exited with non 0 code. (Error Code: 1)
This may be caused by attempting to run an image with a misspecified platform or architecture.

I've been following this guide (https://docs.prefect.io/3.0/deploy/infrastructure-examples/serverless) and the

prefect work-pool create

step went fine. What am I missing here?

@Marvin what problem is this prefect server

Server error ‘500 Internal Server Error’ for url ‘<http://prefect-server:4200/api/logs/>’
2024-09-04T06:00:16.464149854Z Response: {‘exception_message’: ‘Internal Server Error’}
2024-09-04T06:00:17.254531875Z For more information check: <https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/50006:00:17.252>

Hi , is there a way to deploy multiple data pipelines(one for daily and other pipeline for weekly etc) , would appreciate the help , thanks in advance

Hi, I'm new to Prefect. It's fantastic to deploy pipelines by using Python code. However, I had faced some issues when deploying a pipeline to Prefect. Here's my scenario. • I want to run Prefect Agent in the K8s cluster, and I successfully plug the agent into our cluster. • I built a docker image in Gitlab CI and pushed the docker image to ECR. Then, I wrote the Dockerfile and reference from here. • I write a flow script and register to the Prefect cloud by using my local computer. Unfortunately, after running the pipeline, I got some errors: the python model was not found. As a result, I can't successfully import the module that I wrote in the project. And here's my flow script.

Failed to load and execute flow run: ModuleNotFoundError("No module named '/Users/xxx/'")

Thanks for helping. 🙇

Hey all, i'm struggling to connect to our Azure Devops Repo using the GIT storage class. I keep getting an HTTP Unauthorized error. I've tried connecting with git credentials and with a PAT and neither work. Has anyone else managed to connect to AZ Devops?

Hi all, we are about to migrate to prefect 3, is there any breaking changes if we only update the server but keep the code and its

@flows

and all their attributes 🙂 ? Thanks !

@Marvin ValueError: Unable to find block document named “” for block type s3:

Hello! I am seeing this error indicating a 503 response from

get_scheduled_flow_runs

prefect.exceptions.PrefectHTTPStatusError: Server error '503 Service
Unavailable' for url
'<https://api.prefect.cloud/api/accounts/><account_id>/wor
kspaces/<workspace_id>/work_pools/<workpool>/get_scheduled_flow_
runs'
Response: {'exception_message': 'Service Unavailable'}

I don't see any indication of an outage on your status page: https://prefect.status.io/ Is this something y'all are aware of?

What's the correct way to spin up sub flows in parallel (like truly parallel, not concurrent with

asyncio

)? I'm doing the following for now, but it does not preserve flow-subflow relationships (and, it makes sense because the parent process isn't passing any prefect information to the child process in multiprocessing). The alternative here would be to use a Dask runner for all the subflows, in which case every task would be run truly in parallel, but all the subflows would be in the same process as the parent flow. However, it feels more natural to map flows with processes, rather than tasks with processes.

import multiprocessing
import sub_flow

def sub_flow_wrapper(foo):
  sub_main(foo)

@flow
def main():
  with multiprocessing.Pool() as pool:
    pool.starmap(sub_flow_wrapper, [foo1, foo2, foo3])