https://prefect.io
Join Slack
<@ULVA73B9P> I'm suddenly getting 401 unauthorized errors without making any changes to my prefect s...
c

chanes

9 months ago
@Marvin I'm suddenly getting 401 unauthorized errors without making any changes to my prefect setup. I've tried creating a new api key, verified my environment variables, etc. and still have no luck. can you help me debug this? is it possible I hit some free tier limit?
c
m
  • 2
  • 7
  • 92
I'm getting a weird error even though my flow exists ```prefect.exceptions.MissingFlowError: Flow 't...
a

Aaron Goebel

almost 3 years ago
I'm getting a weird error even though my flow exists
prefect.exceptions.MissingFlowError: Flow 'tool' not found in script 'flows/tool.py'. Found the following flows: 'monolithic-tool-flow'. Check to make sure that your flow function is decorated with `@flow`.
I have the flow defined as
flows/tool.py
-------
@flow(name="monolithic-tool-flow")
def process_tool()...
and deploy like
prefect deployment build flows/tool.py:process_tool -n process_tool  -q test -ib docker-container/local --override image=sha256:4e3346168cs3a3c6c0fb256d6e705c6629a41f0f6f23405c33a0bbc3deb964690   --apply
✅ 1
a
m
+3
  • 5
  • 14
  • 92
We are running into an issue with an ECS agent where the logs from individual flow tasks aren't appe...
s

Seth Just

over 3 years ago
We are running into an issue with an ECS agent where the logs from individual flow tasks aren't appearing in Prefect Cloud. Any advice for how to troubleshoot this issue? We're at a total loss.
s
k
a
  • 3
  • 39
  • 92
While `prefect_test_harness` provides an environment for flows to be tested, how might I go about te...
g

Geoffrey Keating

over 3 years ago
While
prefect_test_harness
provides an environment for flows to be tested, how might I go about testing a task in Prefect 2.0? It seems like calling
.run()
on tasks has not made it over from 1.0 yet.
g
a
n
  • 3
  • 6
  • 92
How do I debug why my flow runs are sitting in submitted stage.
n

Naimesh Chaudhari

over 3 years ago
How do I debug why my flow runs are sitting in submitted stage.
n
a
k
  • 3
  • 16
  • 92
Hello again! I want to create a very rough price estimate based on the Prefect Setup described here ...
a

André Petersen

almost 4 years ago
Hello again! I want to create a very rough price estimate based on the Prefect Setup described here (https://towardsdatascience.com/how-to-cut-your-aws-ecs-costs-with-fargate-spot-and-prefect-1a1ba5d2e2df) by @Anna Geller. I have not much experience with AWS, yet, which makes it difficult to estimate the price using the price estimator. We will only have a couple of batch jobs running a couple of times a day and the processing will take place exclusively on snowflake, so the prefect flows will only deligate work. Also we would probably use prefect cloud. I would guess that in the price calculator here https://calculator.aws/#/createCalculator/Fargate we could go with Linux OS, 2 tasks/pods running 2 hours on average with 2 vCPU allocated and 4GB memory (minimum) and 20GB of storage (minimum). 1. Do you agree? If not, why? I can not really believe that this would only cost $14 per month. 2. Do I need to calculate additional costs for the ECS tasks? If I understand correctly, these are included in the Fargate price estimation. I know that we could save money by using spot instances. My target is to make a pessimistic/conservative price estimation. Thanks in advance! Really appreciate the help in this channel!
a
a
  • 2
  • 10
  • 92
Hello! I'm need to implement a workflow where each task must execute one after the other and use the...
j

JulienKWM

almost 4 years ago
Hello! I'm need to implement a workflow where each task must execute one after the other and use the result of the previous task The only way to do I have found so far is to it loop in the flow code, but this solution don't work with flow parameters
@task()
def sample_task(some):
    return some


@task()
def process(current, previous):
    pass


with Flow("test") as flow:
    previous = None
    for n in range(180):
        item = sample_task(n)
        process(item, previous)
        previous = item
Is there an other way to do this (inside a task maybe to handle flow parameters)? Thank you for your help !
j
a
  • 2
  • 12
  • 92
I have a docker compose file initiating my database and self hosted prefect server. I want to have a...
o

Omar Faruk

6 months ago
I have a docker compose file initiating my database and self hosted prefect server. I want to have a healthcheck for my prefect server. The server uses prefecthq/prefect:3.2.14-python3.10. @Marvin How can I setup a healtcheck for the container
o
m
  • 2
  • 1
  • 91
<@ULVA73B9P> my prefect kubernetes worker crashed (OOM) and restarted, but now i have flows stuck in...
l

Lev Zemlyanov

6 months ago
@Marvin my prefect kubernetes worker crashed (OOM) and restarted, but now i have flows stuck in the pending state. what do i do?
l
m
  • 2
  • 15
  • 91
<@ULVA73B9P> how can I setup opentelemetry with prefect
s

Saad Bin Akhlaq

8 months ago
@Marvin how can I setup opentelemetry with prefect
🙏 1
s
m
  • 2
  • 1
  • 91
Previous676869Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by