Has anybody used Prefect to write data into Salesforce ?

I am running prefect 2.0 on aws lambda (runtime python3.9) but i get an error

"Orion requires sqlite >= 3.24.0 but we found version 3.7.17"

Does anyone know a workaround? i

hey everyone, is there a way to use variables that are global to every task like an increment counter ?

is there anyway to set the

max_retries

on a task from the UI (or without having to upload new code)? I was hoping I could template the value and pass it to the @task decorator, but it doesn't look like you can use templates with the

max_retries

argument

Hi, I am trying to run a prefect flow using a trigger from a Webhook. I am trying to figure out a way to send the data I received in the body of the webhook to the flow as a parameter, but I can’t figure out a way to do it. I followed the example given here but instead of passing

{{ event }}

(which is basically just the name of the event, I tried passing in

{{ resource.event_data }}

. Please note that

resource.event_data

is a property I defined this property in my webhook template, it gets populated from the body of the webhook I received originally. So, what’s happening is that the flow gets executed but instead of receiving the actual

resource.event_data

it just received the raw string “{{ resource.event_data }}“. Is it even possible to pass on dynamic data from the original event to the deployment as a parameter?

If I have a StartFlowRun task with wait=True in my flow, and the subflow fails, what is the expected behavior when I restart the parent flow? Should the StartFlowRun schedule a brand new subflow run? Should the subflow restart all failed tasks? Is this documented anywhere?

Good morning all! Has anybody had any experience with solving this very transient error with the S3Upload task?

Unexpected error: KeyError('endpoint_resolver')

We have a daily flow which includes around 25 mapped S3Upload tasks, and approximately once every five flow runs, one single mapped S3Upload task fails with this error. We're not doing anything particularly complicated or novel with the task, and the flow always succeeds when restarted, so I'm curious to know if anyone else has experienced this error and knows of a fix. More details in the thread, and thanks in advance for any help 🙂

Has anyone run into this issue when trying to run

flow.visualize()

? I installed the viz package with

pip install prefect[viz]

but am still getting this:

Traceback (most recent call last):
  File "insurance_export.py", line 184, in <module>
    flow.visualize()
  File "/home/ec2-user/anaconda3/envs/python38_prefect/lib/python3.8/site-packages/prefect/core/flow.py", line 1406, in visualize
    graph.render(tmp.name, view=True)
  File "/home/ec2-user/anaconda3/envs/python38_prefect/lib/python3.8/site-packages/graphviz/files.py", line 216, in render
    self._view(rendered, self._format, quiet_view)
  File "/home/ec2-user/anaconda3/envs/python38_prefect/lib/python3.8/site-packages/graphviz/files.py", line 262, in _view
    view_method(filepath, quiet)
  File "/home/ec2-user/anaconda3/envs/python38_prefect/lib/python3.8/site-packages/graphviz/backend.py", line 323, in view_unixoid
    popen_func(cmd)
  File "/home/ec2-user/anaconda3/envs/python38_prefect/lib/python3.8/subprocess.py", line 854, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/home/ec2-user/anaconda3/envs/python38_prefect/lib/python3.8/subprocess.py", line 1702, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'xdg-open'

@Marvin I want to self-host Prefect on Kubernetes (AWS EKS). I don’t have to have a Prefect Cloud account for running flows on Kubernetes, right? I didn’t understand how to create a work pool or configure the worker when I use OSS Prefect. The docs has an example with Prefect Cloud.

I must be missing something simple… I have two production servers … we will call them Primary and Prefect … as you can guess the Prefect server houses my agent and accepts 10% of the web traffic. The Primary server accepts 90% of the web traffic and has at least one

run_deployment

specified in one of it’s routes. When posting to that URL I get an error and it seems like it is looking for the deployment on a local copy of Prefect Server (previously Orion) instead of Prefect Cloud which is what I’m using… Here’s the error without the stack trace…

prefect.exceptions.PrefectHTTPStatusError: Client error '404 Not Found' for url '<http://ephemeral-prefect/api/deployments/name/alert-early-intervention/alert_early_intervention>'

… I have confirmed that the deployment exists in my Prefect Cloud under the name

alert-early-intervention/alert_early_intervention

.