https://prefect.io
Join Slack
<@ULVA73B9P> I have a flow run failing due to: ```raise InfrastructureError( prefect.exceptions.Infr...
m

Miguel Moncada

over 1 year ago
@Marvin I have a flow run failing due to:
raise InfrastructureError(
prefect.exceptions.InfrastructureError: Unable to create Kubernetes job: Forbidden: jobs.batch is forbidden: User "system:serviceaccount:prefect:prefect-worker" cannot create resource "jobs" in API group "batch" in the namespace "default"
How can I configure jobs to run in the namespace "prefect" instead? I have my worker deployed via helm (using ArgoCD)
✅ 1
m
m
  • 2
  • 14
  • 192
<@ULVA73B9P>, how do I cancel a running flow run by the Prefect 2 API?
j

Jack P

almost 2 years ago
@Marvin, how do I cancel a running flow run by the Prefect 2 API?
j
m
  • 2
  • 11
  • 192
in the prefect.yaml file I specify the pull step to be a git clone, if I try deploying more than onc...
r

Ronald Sam

over 2 years ago
in the prefect.yaml file I specify the pull step to be a git clone, if I try deploying more than once, on the second time I get an error because the repo already exists in the working directory. Is there a way to specify to not clone but do a git pull from remote branch if the repo already exists?
r
c
t
  • 3
  • 99
  • 192
<@ULVA73B9P> How can I use the prefect-sqlalchemy package to fetch data from sql server?
b

Bryan

almost 2 years ago
@Marvin How can I use the prefect-sqlalchemy package to fetch data from sql server?
b
m
  • 2
  • 3
  • 191
I’m running a prefect flow that moves a large amount of files from s3 to google cloud storage. When ...
j

Josh

almost 5 years ago
I’m running a prefect flow that moves a large amount of files from s3 to google cloud storage. When there are a relatively small amount of files to transfer, it’s quick. But as the files to transfer grow and especially if file size is large, the prefect process takes up increasingly large amounts of memory. I am using the
S3Download
and
GCSUpload
tasks. My suspicion is that the flow is not releasing the memory of the files being transferred. Is there any way to ensure the file contents are being released from memory?
j
n
s
  • 3
  • 4
  • 191
<@ULVA73B9P>, my flows are getting stuck at pending state, can I somehow manually create the state f...
s

Sri Sudarsan

7 months ago
@Marvin, my flows are getting stuck at pending state, can I somehow manually create the state from db so that it can be picked up by workers ?
s
m
l
  • 3
  • 4
  • 191
Hello! Can anyone recommend how to provision a Prefect Block which supports connecting to AWS Redsh...
c

Cormac

about 1 year ago
Hello! Can anyone recommend how to provision a Prefect Block which supports connecting to AWS Redshift? using standard postgres
POSTGRESQL_PSYCOPG2
results in a driver which throws the following error on connection:
sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedObject) unrecognized configuration parameter "standard_conforming_strings"
This is, apparantly, a known issue: https://github.com/sqlalchemy/sqlalchemy/issues/9442 More worryingly, I cannot see any support in Prefect connectors for Redshift. Can anyone advise?
c
  • 1
  • 1
  • 190
<@ULVA73B9P> How to set environment variables during a flow run?
j

Joshua Caskie

about 1 year ago
@Marvin How to set environment variables during a flow run?
j
m
k
  • 3
  • 33
  • 190
<@ULVA73B9P> Hello, I am currently trying to use prefect (using helm and values.yaml to setup work-p...
k

Karim Dahmeni

over 2 years ago
@Marvin Hello, I am currently trying to use prefect (using helm and values.yaml to setup work-pool and workers). The issue is each flow I try to run crashes due to validation error for KubernetesWorkerJobConfiguration env (value is not a valid dict)
k
m
c
  • 3
  • 10
  • 190
<@ULVA73B9P> in prefect 3, how can I set up to run the UI from docker ?
i

Ivan

over 1 year ago
@Marvin in prefect 3, how can I set up to run the UI from docker ?
i
m
  • 2
  • 16
  • 189
Previous272829Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by