https://prefect.io
Join Slack
Hi guys, I am wondering something about prefect 3.0 and I am curious about how community is developi...
j

jcozar

9 months ago
Hi guys, I am wondering something about prefect 3.0 and I am curious about how community is developing flows right now. As it is said in the official doc "Prefect future objects must be resolved explicitly before returning from a flow". That means that every task must be resolved during the flow execution. In prefect 2.0, all tasks were automatically waited. In fact, the flow returned a list of tasks states. Right now, how are you developing your flows? 1. Do not use
.submit
for the terminal futures? 2. Use
.wait()
for terminal futures, and return a list of tasks states manually? 3. Use the
wait
utilities to resolve terminal futures?
j
f
+2
  • 4
  • 7
  • 57
<@ULVA73B9P> How can I configure a work pool in prefect v3 to deploy flows using PUSH work pool type...
s

Sachin Mandhotra

9 months ago
@Marvin How can I configure a work pool in prefect v3 to deploy flows using PUSH work pool type on AWS ECS
s
m
  • 2
  • 19
  • 57
<@ULVA73B9P> Is there a way for a Prefect flow to listen in on an event such as arrival of a new fil...
m

Moe

10 months ago
@Marvin Is there a way for a Prefect flow to listen in on an event such as arrival of a new file in S3 bucket?
m
m
k
  • 3
  • 10
  • 57
Hello folks! I've been testing Prefect Deployments, and I can across this. I am using `prefect deplo...
n

Nick Kagkalos

12 months ago
Hello folks! I've been testing Prefect Deployments, and I can across this. I am using
prefect deploy
to create one, and a Git repo as the code source. So far it seems that the Python script needs to live in the parent directory of the repo and not in a subdirectory. Otherwise, the Work Pool throws an error:
FileNotFoundError: [Errno 2] No such file or directory:...
...
prefect.exceptions.ScriptError: Script at 'test_flow_deployment.py' encountered an exception: FileNotFoundError(2, 'No such file or directory')
Prefect's Interactive tool, aside from the Git repo link and branch, doesn't ask for a directory name. If this is truly the only way to do it, it's definitely not the neatest implementation. But I'd guess there must be a way to direct Prefect to the subdirectories somehow, which I haven't figured out yet. If anyone knows how to do so, please share your knowledge. TIA!
n
j
  • 2
  • 3
  • 57
<@ULVA73B9P> I am running Prefect in Kubernetes with a Work Pool. How do I get the worker to downloa...
d

Dominik

about 1 year ago
@Marvin I am running Prefect in Kubernetes with a Work Pool. How do I get the worker to download an Image from a private docker registry?
d
m
  • 2
  • 4
  • 57
<@ULVA73B9P> Can create a Secret storage block in JSON format? I want to have a single storage block...
k

Kaleb King

over 1 year ago
@Marvin Can create a Secret storage block in JSON format? I want to have a single storage block that I can call specific components.
k
m
  • 2
  • 9
  • 57
<@ULVA73B9P> are prefect workers and the jobs they submit on kubernetes pods related for compute pur...
k

KG

over 1 year ago
@Marvin are prefect workers and the jobs they submit on kubernetes pods related for compute purposes? If a worker has X CPU allocated, will each flow scheduled as a k8s job use a portion of that X CPU, or are they distinct
k
m
k
  • 3
  • 13
  • 57
Does anyone have a deployment GitHub actions workflow that works with GCP Artifact Registry?
m

Matthew Bell

over 1 year ago
Does anyone have a deployment GitHub actions workflow that works with GCP Artifact Registry?
m
j
  • 2
  • 1
  • 57
<@ULVA73B9P> i want to make a Dropdown List of values in a deployment in the UI of Prefect with valu...
h

Hector GODZIEN

over 1 year ago
@Marvin i want to make a Dropdown List of values in a deployment in the UI of Prefect with values that comes from a function return (API calls are made inside...)
h
m
  • 2
  • 1
  • 57
<@ULVA73B9P> Im not getting all Kubernetes pod logs when doing `logs_dict = await run_namespaced_job...
p

Pooyan

over 1 year ago
@Marvin Im not getting all Kubernetes pod logs when doing
logs_dict = await run_namespaced_job(job)
. Wondering how I can get all pod logs in prefect UI
p
m
  • 2
  • 2
  • 57
Previous114115116Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by