Hey all, When I try running

prefect server start

I get an error

│ No such command 'server'.│

Has anyone else encountered this? I used

--help

to see the list of available commands and can't find a

server

command

image.png

have you tried prefect orion start?

Hi everyone, i have setup prefect from docker, but i am getting getting this issue where block are not there to choose, Can anyone please help me on this why this is happening

Hi prefecters! Is this an intended appearance with the raw code of diagram of deployments HLA? Which tool I can use to visualize it? https://docs.prefect.io/concepts/deployments/#deployments-overview upd: found the answer, shared in the comments 😇

hi team! I’m trying to run dbt CLI + Snowflake. However when I’m try to run it, I’m getting an error:

Database Error in model dbt_metrics_custom_calendar (models/dbt_metrics_custom_calendar.sql)
No active warehouse selected in the current session.  Select an active warehouse with the 'use warehouse' command.

What I’m doing wrong? It seems that the warehouse is already stated in SnowflakeTarget Block (and it shows when I’m running

dbt debug

), but when I’m trying to run some models, it gives me this kind of error.

>>> prefect.__version__
'2.8.3'
>>> prefect_dbt.__version__
'0.3.1'
>>> prefect_snowflake.__version__
'0.26.1'

I've just begun exploring prefect. I'm a bit unsure of something with kubernetes though. I can get my flow to run on our kubernetes cluster, but I'd like to restrict the node that a pod runs in. I've had a look at, for example, how to customise the kubernetes job template (like here: https://discourse.prefect.io/t/creating-and-deploying-a-custom-kubernetes-infrastructure-block/1531) But from what I can gather, you set the node selection in a pod specification file, like described here: https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/ Is it possible to customose the pod configuration so that I can select a node based on a label, for example?

oh, maybe I need to have the agent in the appropriate place.

Hello, iam very new to prefect planning to deploy it in kubernetes cluster can someone help me with the documentation if possible, Thanks

Is there a way to prevent late scheduled flows to run? I know that ideally it has to run in reliable deployment, but when I developing flows in local computer and everytime I restarted prefect agent after hours it's paused, the late flows running all at the same time. or alternatively, I'm asking how to limit flow schedule queue to only one after current flow execution?

What are the lines that I need for a flow deployment to cloud api server? My first guess is below, but not sure where to put the api key/url. For whatever it's worth, the script will be running in a lambda container.

deployment = Deployment.build_from_flow(
flow=artist_ranker_etl,
name="artist-ranker-deployment",
entrypoint="artist_ranker.main.handler",
)
deployment.apply()

Hi! I’m trying to build a deployment with a Github as a storage (just doing some POC).

prefect deployment build -ib process/default  -sb GitHub/github-credentials -q default flows/flow_dbt_cli_2.py:trigger_dbt_flow -t dbt_cli -n local-flows -a

I’ve also created a block using

GitHubCredentials

from

prefect_github.

What I’m doing wrong when creating a deployment?

Does only the prefect logger instance work for logging flow tasks, versus other logging libraries(aws_lambda_powertools, logging)?

What would cause this error,? "/var/task/prefect/context.py501 UserWarning: Failed to create the Prefect home directory at /home/sbx_user1051/.prefect /var/task/prefect/context.py501 UserWarning: Failed to create the Prefect home directory at /home/sbx_user1051/.prefect"

Should I be seeing a flow produced in the cloud ui for each run? using this block of code:

deployment = Deployment.build_from_flow(
flow=artist_ranker_etl,
name="artist-ranker-deployment",
entrypoint="artist_ranker.main.handler",
)
deployment.apply()

I'm only seeing it once in the ui for the initial run.

Sorry put this in the wrong channel: Hi all, I think I'm doing something simple and mistaken. I'm using Python 3.9.6 on Windows 10, and Prefect version 2.8.4, I have the simplest code in a file called dev.py from the 1st tutorial example from the site. I'm using a Python venv too

from prefect import flow

@flow
def my_favorite_function():
    print("What is your favorite number?")
    return 42

print(my_favorite_function())

And when I run

python dev.py

it gives me an error

RuntimeError: Cannot create flow run. Failed to reach API at <http://127.0.0.1:4200/api/>

I tried changing the code to:

from prefect import flow

@flow
def my_favorite_function():
    print("What is your favorite number?")
    return 42

if __name__ == "__main__":
    print(my_favorite_function())

And it still gives me the same error. Am I missing something? I'm sure I've run this code before when trying to learn (edited)

Hi, I'm new to Prefect, is there any difference in behaviour between scheduling with a YAML file vs with a Python file?

Hi all, I'm trying out the prefect API on a self-hosted server. I'm trying with both postman and within the OpenAPI documentation at

/api/docs

. I'm testing the

/flows/filter

endpoint and I'm finding the

eq_

operator works only when using the "query style" as follows:

{
  "query": {
    "deployments": {
      "work_queue_name": {
        "eq_": "integration"
      }
    }
  }
}

If I put the filter directly, I get the following pydantic error:

{
  "exception_message": "Invalid request received.",
  "exception_detail": [
    {
      "loc": [
        "body",
        "deployments",
        "work_queue_name",
        "eq_"
      ],
      "msg": "extra fields not permitted",
      "type": "value_error.extra"
    }
  ],
  "request_body": {
    "deployments": {
      "work_queue_name": {
        "eq_": "integration"
      }
    }
  }
}

But if I use

any_

with the same value in an array it works. The same error happens using

all_

with an array. Should I file a bug report?

X-posting here for the getting started crew!

Hello! I'm new here, just starting to experiment with prefect with a few toy test cases. I started a server following the tutorial with "prefect server start" but there doesn't seem to be an analogous "prefect server stop" -- is the right way to stop your server just to kill it?

Hello! I try to use prefect on a local kubernetes cluster with a Kubernetes Job infrastructure. My flow code is located on a S3 bucket. Flow deployment correctly push flow code on the s3 bucket. But the flow run can’t download correctly in local (in pod i mean) the flow code. How come? I thank you for your help!

This message was deleted.

Hi guys, using

prefect-gcp

here, and the CloudRunJob module for my infrastructure.. All works great! thanks for the module! Just wondering though, when I look at my Google Cloud dashboard, under CloudRun jobs, I don't see any trace of my CloudRunJobs running? Not sure I understand how it all works, any tips on how to debug CloudRunJobs (was thinking I'll get some sort of logs in Google dashboard UI) TIA! here's the sample project I'm working on, and the spot I use CloudRun in

Can Anyone Please help me with running spark jobs on data proc using prefect . i could. not find anything in the documentation regarding that

I am attempting to use a flow to launch a number of parallel flows (up to 45) using RunDeployment against ECS Fargate (recursive flattening of json from a NOSQL db and expansion into child tables) . I note two big issues and wonder if anyone else has seen this. 1) ECS execution time is very slow, like clock speed is turned way down or something like that 2) Startup of new ECS containers takes ~2 minutes but you need to wait 30 seconds or so between container startup or you get throttled. We've tested giving additional CPU resources/RAM to the containers with no measurable impact. Each of the flows runs for between 5 minutes and 30 minutes depending on data change rates. I expect that there's something fundamentally wrong about the way we're deploying to Fargate using Prefect given this but can't see what it might be. Suggestions?

Hi, if I'm running a deployment locally and I want to change the working directory for where it runs how do I do that? I don't see that in the examples and the API reference in any obvious way at least. It looks like when I run without a storage block and I do things like create folders, download data, it seems to be landing here:

...AppData\Local\Temp\tmput9_b5yuprefect

Would anyone know how to explain to me why the name of the flow when scheduled is randomly defined and the name that was configured is only changed at the end of the execution?

image.png

Hi team! Recently my agent stopped working in ubuntu aws instance. What’s the potential reason could be here? Also do you mind sharing any best practices on deploying prefect agents on servers?

hi team Just wondering, is it easy to query the flow runs, to get some summary information. so, for example, you might want to know the duration of all your flows with a given name/deployment to make a summary. Presumably this information is held in the data base, but would be nice to see an example of how people query this.