https://prefect.io
Join Slack
Is there a way for self-hosted (not cloud) to use webhooks? I got that working in the cloud version,...
m

Miguel Madero

over 1 year ago
Is there a way for self-hosted (not cloud) to use webhooks? I got that working in the cloud version, but our plan was to self host, but I don't see the option there. @Marvin please halp!
m
m
  • 2
  • 3
  • 205
<@ULVA73B9P> I want to use an ECS Push Workpool with 3.0. Help me understand the key differences bet...
d

Dylan D

about 2 years ago
@Marvin I want to use an ECS Push Workpool with 3.0. Help me understand the key differences between 2.0 and 3.0 with regards to how things will be structured in ECS
d
m
  • 2
  • 19
  • 205
Hello here, I am new to Prefect and run my first flow in my local K8S cluster and use `KubernetesRun...
b

Baris Cekic

over 4 years ago
Hello here, I am new to Prefect and run my first flow in my local K8S cluster and use
KubernetesRun
. The flow is trying to download the
py
file from a local git repo in the same local K8S cluster. But I got an
SSL_VERIFICATION
error even though the
url/host
for
git storage
is
HTTP
. Is there anyone having similar issue?
b
a
k
  • 3
  • 75
  • 205
Hey folks, I quite like the Prometheus Exporter, but I want to be able to emit fine-grained details ...
j

Joe

almost 2 years ago
Hey folks, I quite like the Prometheus Exporter, but I want to be able to emit fine-grained details from some flow & task internals (at customer request). Does anyone have any ideas on what a "good place" to put a prometheus-client would be in an agent so flows could increment counters, etc.? Or is writing that out to a db & querying similar to how the Exporter functions likely to be the cleanest solution?
j
c
n
  • 3
  • 12
  • 204
Hello. I'm trying to pass an aiohttp client session to a flow/task. Following an error in the functi...
c

Charles Marks

over 2 years ago
Hello. I'm trying to pass an aiohttp client session to a flow/task. Following an error in the functional block of a task it will ping/wait for an internet connection and then raise the error for the flow or task decorator to handle. I noticed that the session can't be reused seemingly because the event loop changes for each flow or task run? Hard for me to copy paste the stack from my jupyter notebook because of how it prints, it's Runtimeerror: Event loop is closed. The first time _client is assigned in Session() it works because the context is probably in the current event loop.
def Session():
    global _client
    if _client is None:
        _client=aiohttp.ClientSession(connector=aiohttp.TCPConnector(limit=100,limit_per_host=10,force_close=True,enable_cleanup_closed=True),timeout=aiohttp.ClientTimeout(total=30))
    return _client
c
n
  • 2
  • 6
  • 204
<@ULVA73B9P> why am I getting TypeError: ‘NoneType’ object is not iterable when using the command `p...
a

Alex Ilyin

about 2 years ago
@Marvin why am I getting TypeError: ‘NoneType’ object is not iterable when using the command
prefect deployment run
a
m
n
  • 3
  • 3
  • 203
<@ULVA73B9P> how do i debug the prefect and python code locally?
r

riccardo bernardi

over 2 years ago
@Marvin how do i debug the prefect and python code locally?
r
m
n
  • 3
  • 5
  • 203
<@ULVA73B9P> is it possible to access the results of a flow run from its state via a state transitio...
c

Conor

about 3 years ago
@Marvin is it possible to access the results of a flow run from its state via a state transition hook without persisting the result? Something like this? @flow(validate_parameters=False, name=“MyFlow”, on_failure=[store_results], # this is a hook async def store_results(flow:Flow, flow_run: FlowRun, state: State[Any]) -> None: result = state.result() print(state.result()) The flow run is not persisted in this case, and the result can be quite a large object, so it would be nice to have access to the result from the hook
c
m
n
  • 3
  • 31
  • 203
Hi, I'm new to Prefect. It's fantastic to deploy pipelines by using Python code. However, I had face...
h

Hash Lin

over 4 years ago
Hi, I'm new to Prefect. It's fantastic to deploy pipelines by using Python code. However, I had faced some issues when deploying a pipeline to Prefect. Here's my scenario. • I want to run Prefect Agent in the K8s cluster, and I successfully plug the agent into our cluster. • I built a docker image in Gitlab CI and pushed the docker image to ECR. Then, I wrote the Dockerfile and reference from here. • I write a flow script and register to the Prefect cloud by using my local computer. Unfortunately, after running the pipeline, I got some errors: the python model was not found. As a result, I can't successfully import the module that I wrote in the project. And here's my flow script.
Failed to load and execute flow run: ModuleNotFoundError("No module named '/Users/xxx/'")
Thanks for helping. 🙇
h
k
+2
  • 4
  • 29
  • 203
<@ULVA73B9P> How can I use the prefect-sqlalchemy package to fetch data from sql server?
b

Bryan

over 2 years ago
@Marvin How can I use the prefect-sqlalchemy package to fetch data from sql server?
b
m
  • 2
  • 3
  • 202
Previous363738Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by