Hey folks! Does anyone have an example repo they could share that's handling the deployment of a Prefect Agent with AKS? Currently starting off with spinning up a cluster with Terraform, but my k8s skills are sub-par so some useful starters would be handy. For reference i've CDK'd up a Prefect Agent & respective cluster in ECS on AWS before, but that wasn't involving k8s.

Hello Prefect Community, I’m looking to automate a workflow with Prefect 2 that needs to start whenever a new file is uploaded to a Google Cloud Storage bucket. I’m not sure how to set up a trigger in Google Cloud that notifies my Prefect flow as soon as a new file is available. Ideally, this would involve some integration between Google Cloud Functions and Google Pub/Sub to detect new files and trigger the flow. Has anyone here set up something similar? Could you provide guidance or examples on how to configure the triggers and set up the flow to listen for these events? Any help or insights would be greatly appreciated! Thank you in advance!

I'm getting a QueuePool limit of size 5 overflow 10 reached when calling .map with around 700 tasks. How do I handle this and prevent the overflow/timeout from occuring?

# create an api request for each self link
api_results = api_get.map(map(lambda x: x["self"], employee_self_links))

@task(
    retries=3,
    retry_delay_seconds=exponential_backoff(backoff_factor=10),
)
def write(employee: Response):
    employee = employee.json()

    dest = f"raw/employees/details/{employee['id']}.json"
    write_to_file_system.fn(dest, employee)

# save the results to storage
storage_results = write.map(api_results)

Has anybody used Prefect to write data into Salesforce ?

I am running prefect 2.0 on aws lambda (runtime python3.9) but i get an error

"Orion requires sqlite >= 3.24.0 but we found version 3.7.17"

Does anyone know a workaround? i

is there anyway to set the

max_retries

on a task from the UI (or without having to upload new code)? I was hoping I could template the value and pass it to the @task decorator, but it doesn't look like you can use templates with the

max_retries

argument

Hello people, anybody know how to display progress bars from a running task on the prefect URL UI in logs

@Marvin How do you enable SSL on the prefect v3?

When attempting to use

DbtCoreOperation

we are receiving the following error... This suggests that our dbt cli profile block, which we have defined in dbt Cloud, does not have a name or target or target_configs, but it does..

pydantic.error_wrappers.ValidationError: 3 validation errors for DbtCoreOperation
dbt_cli_profile -> name
  field required (type=value_error.missing)
dbt_cli_profile -> target
  field required (type=value_error.missing)
dbt_cli_profile -> target_configs
  field required (type=value_error.missing)

I was able to use the

profile_dir

parameter to use my local credentials, but this only verifies there aren't obvious problems with the flow code.

prefect-dbt==0.3.1

prefect-snowflake==0.26.0

Any ideas?

Hello everyone!! I am having some issues getting the UI to run correctly on a Kubernetes cluster, deployed with the Prefect Helm chart I am using the L7 ingress for apollo and the UI and I keep getting this error: I am able to register projects and flows with the CLI, so I think everything is connecting except for the UI. Here's my Helm chart: Any ideas on where I might be going wrong?