https://prefect.io
Join Slack
<@ULVA73B9P> I have a flow run failing due to: ```raise InfrastructureError( prefect.exceptions.Infr...
m

Miguel Moncada

over 1 year ago
@Marvin I have a flow run failing due to:
raise InfrastructureError(
prefect.exceptions.InfrastructureError: Unable to create Kubernetes job: Forbidden: jobs.batch is forbidden: User "system:serviceaccount:prefect:prefect-worker" cannot create resource "jobs" in API group "batch" in the namespace "default"
How can I configure jobs to run in the namespace "prefect" instead? I have my worker deployed via helm (using ArgoCD)
✅ 1
m
m
  • 2
  • 14
  • 179
<@ULVA73B9P> how can i use prefect with django?
m

massumo

over 1 year ago
@Marvin how can i use prefect with django?
m
m
  • 2
  • 2
  • 179
<@ULVA73B9P> how to write tqdm output to prefect logs
a

Alex Litvinov

over 1 year ago
@Marvin how to write tqdm output to prefect logs
a
m
  • 2
  • 5
  • 180
Prefect 2.0. Is there a way to upload a file in the Cloud UI as a task argument? We have been using ...
t

Trevor Kramer

over 2 years ago
Prefect 2.0. Is there a way to upload a file in the Cloud UI as a task argument? We have been using URLs for this but as we start to expand Prefect's use in our organization it is getting challenging to make sure the prefect agent has permissions to all the S3 buckets folks might upload a file to.
t
k
  • 2
  • 3
  • 179
Hi all - I have a really annoying problem that is starting to bite me hard. I have a `flow` that se...
t

Tim Galvin

almost 2 years ago
Hi all - I have a really annoying problem that is starting to bite me hard. I have a
flow
that seems to be running fine, except tasks that read a
Complete()
state are, for whatever reason, being restarted. Sometimes hours after they were successfully completed. As far as I can tell, there are no errors in my files. I am seeing the correct set of end data products from tasks that are completed after the task that is restarted needlessly. Is there something I should be looking into for this? I am a little unsure where to even begin.
t
t
  • 2
  • 16
  • 178
Hey Guys, I’m just getting started with prefect and I have a flow that uses custom modules. These mo...
i

Izu

over 3 years ago
Hey Guys, I’m just getting started with prefect and I have a flow that uses custom modules. These modules are in the same directory as my flow script, and I do several
from my_module import my_function
within the flow script. Now here’s the thing; I have registered the flow and started my local agent. When I try to trigger the job to run from the prefect UI, I get the message:
Failed to load and execute flow run: FlowStorageError('An error occurred while unpickling the flow:\n ModuleNotFoundError("No module named \'extract_strings\'")\nThis may be due to a missing Python module in your current environment. Please ensure you have all required flow dependencies installed.')
The `extract_strings`function is defined in another module in the same director. Can anyone help?
i
a
  • 2
  • 1
  • 178
<@ULVA73B9P>, how do I cancel a running flow run by the Prefect 2 API?
j

Jack P

almost 2 years ago
@Marvin, how do I cancel a running flow run by the Prefect 2 API?
j
m
  • 2
  • 11
  • 177
Hi guys ! I’m trying to setup a `Prefect Agent` and a `prefect server` on my local computer, everyt...
a

André Dias

over 3 years ago
Hi guys ! I’m trying to setup a
Prefect Agent
and a
prefect server
on my local computer, everything residing inside of
containers
. My
Prefect Server
`container(s)`is based on the
docker-compose
file retrieved from
prefect server config > server-docker-compose.yaml
. When spinning up a container for an Agent and running
prefect agent local start --api <http://host.docker.internal:4200>
, it says that I must be authenticated to communicate with the containerized server living in my local machine. My first question is: Is
authentication
mandatory in this kind of situation , for local run ? When I authenticate by creating a new tenant using
prefect server create-tenant -n default
outside the Agent container, I’m able to spin up the
Agent Container
and run everything. The problem is that I wanted to run the
create-tenant
inside the container too, but it’s not possible as I’m getting connection refused between containers.
a
k
  • 2
  • 12
  • 177
Hi there. I recently started getting some errors on VS Code using pylance. For example, the followi...
p

Pedro Machado

about 4 years ago
Hi there. I recently started getting some errors on VS Code using pylance. For example, the following line
from prefect import Flow, Parameter, task, unmapped
produces
"Flow" is not exported from module "prefect"
Import from "prefect.core" instead Pylance(reportPrivateImportUsage)

"Parameter" is not exported from module "prefect"
Import from "prefect.core" instead Pylance(reportPrivateImportUsage)

"task" is not exported from module "prefect"
Import from "prefect.utilities.tasks" instead Pylance(reportPrivateImportUsage)

is not exported from module "prefect"
Import from "prefect.utilities.edges" instead Pylance(reportPrivateImportUsage)
Also, I am getting pylance errors when passing Parameters to tasks that expect
str
arguments. I don't believe this was happening before. Do you know if something changed recently in pylance or in how we are supposed to import modules? I am using prefect 0.15.4 Thanks!
p
k
  • 2
  • 5
  • 177
Hi <@ULVA73B9P>. I'm trying to deploy a simple flow that has access to the local file system that th...
n

Nick

8 months ago
Hi @Marvin. I'm trying to deploy a simple flow that has access to the local file system that the worker pool is running on. using flow.deploy() it builds an image and runs nicely but I can't figure out how to mount local volumes to the container. how can I do this?
n
m
  • 2
  • 34
  • 175
Previous272829Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by