https://prefect.io
Join Slack
<@ULVA73B9P> I have a flow run failing due to: ```raise InfrastructureError( prefect.exceptions.Infr...
m

Miguel Moncada

about 1 year ago
@Marvin I have a flow run failing due to:
raise InfrastructureError(
prefect.exceptions.InfrastructureError: Unable to create Kubernetes job: Forbidden: jobs.batch is forbidden: User "system:serviceaccount:prefect:prefect-worker" cannot create resource "jobs" in API group "batch" in the namespace "default"
How can I configure jobs to run in the namespace "prefect" instead? I have my worker deployed via helm (using ArgoCD)
✅ 1
m
m
  • 2
  • 14
  • 141
<@ULVA73B9P> How can you have to define the `timezone` inside of the `schedules` parameter of `.se...
c

Christian

7 months ago
@Marvin How can you have to define the
timezone
inside of the
schedules
parameter of
.serve()
c
m
  • 2
  • 17
  • 140
in the prefect.yaml file I specify the pull step to be a git clone, if I try deploying more than onc...
r

Ronald Sam

almost 2 years ago
in the prefect.yaml file I specify the pull step to be a git clone, if I try deploying more than once, on the second time I get an error because the repo already exists in the working directory. Is there a way to specify to not clone but do a git pull from remote branch if the repo already exists?
r
c
t
  • 3
  • 99
  • 140
Something I am struggling to get my head around is security in regards to `FargateCluster`. It seems...
e

Eddie Atkinson

about 3 years ago
Something I am struggling to get my head around is security in regards to
FargateCluster
. It seems like the cluster is being assigned a public IP address. Ideally I wouldn’t want that to be the case as I don’t want people snooping on my cluster / submitting jobs. However, when I pass
"fargate_private_ip": True
to
cluster_kwargs
my cluster fails to start with the error:
Cluster failed to start: Timed out trying to connect to <tcp://10.0.1.111:8786> after 30 s
That makes sense. Someone somewhere failed to connect to a local IP address, presumably from outside the subnet. What I don’t understand is how I can prevent people from arbitrarily accessing my cluster from the internet whilst allowing all the ‘right’ traffic through
e
k
a
  • 3
  • 15
  • 140
Hello everyone! I use aws for my work. On my MacOS laptop .aws contains configuration files that are...
в

Владислав Богучаров

over 3 years ago
Hello everyone! I use aws for my work. On my MacOS laptop .aws contains configuration files that are responsible for accessing my work cloud. I want to test prefect with another aws account but I'm afraid something might go wrong. As far as I understand, Prefect uses boto3, and boto3 will take configs from the default path. How to distinguish between a working aws profile and a home one, and what is the most important thing how to say about this to Prefect?
в
a
+3
  • 5
  • 38
  • 140
<@ULVA73B9P> failed to authorize: failed to fetch anonymous token:
p

Parash

about 1 year ago
@Marvin failed to authorize: failed to fetch anonymous token:
p
m
  • 2
  • 1
  • 139
Hi there! I’m trying to forward logs form an external library, more specifically `scrapy` . I have c...
r

Rasmus Lindqvist

almost 3 years ago
Hi there! I’m trying to forward logs form an external library, more specifically
scrapy
. I have configured scrapy to log to stdout, and configured my Prefect task to
log_stdout=True
. Should not Prefect then pick up the logs from scrapy or am I missing something?
✅ 1
r
r
+2
  • 4
  • 11
  • 139
Hi All, General Question - Can we deploy prefect on open shift ? Is there a doc for this ? Appreciat...
g

Gowtham Manne

about 3 years ago
Hi All, General Question - Can we deploy prefect on open shift ? Is there a doc for this ? Appreciate your help!
discourse 1
g
k
+2
  • 4
  • 16
  • 139
Hey folks! Does anyone have an example repo they could share that's handling the deployment of a Pre...
c

ciaran

about 4 years ago
Hey folks! Does anyone have an example repo they could share that's handling the deployment of a Prefect Agent with AKS? Currently starting off with spinning up a cluster with Terraform, but my k8s skills are sub-par so some useful starters would be handy. For reference i've CDK'd up a Prefect Agent & respective cluster in ECS on AWS before, but that wasn't involving k8s.
c
t
k
  • 3
  • 248
  • 139
premise <@ULVA73B9P> my prefect server has a ssl certificate now and when i try to deploy from anoth...
k

Kevin Mach

11 months ago
premise @Marvin my prefect server has a ssl certificate now and when i try to deploy from another machine i get this raise PrefectHTTPStatusError.from_httpx_error(exc) from exc.cause prefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url
k
m
  • 2
  • 12
  • 138
Previous323334Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by