Hi is it possible to clear all data from Prefect (2.0b12) on the hosted version? Similar to locally doing

prefect orion database reset -y

?

also, i am no longer able to see

Deployments

in Orion UI locally. If i inspect the network, I see it will successfully return my deployments, but they are never rendered in the UI.

Hi, I’m curious about how robust is Prefect operation w/

Kubernetes Agent

,

KubernetesRun

and

DaskExecutor

in the face of various components outages. E.g. what will Prefect be able to recover on its own, and which case would require a manual intervention, if during a flow execution one of the following dies: prefect server (I suppose it’s ok as it’s stateless), kubernetes agent,

KubernetesRun

job executing a flow, dask scheduler, dask workers.

Hi y'all I am developing a flow and have come across an error that neither me or my team understands. When trying to register the flow, we get:

ValueError: Flow could not be deserialized successfully. Error was: ValueError('A task with the slug "Parameter" already exists in this flow.')

This shows up after the step:

[2022-07-25 17:27:11-0700] INFO - prefect.Docker | Pushing image to the registry..

Parameters are currently in their own params.py file, and are referenced in the main flow file with:

import <main_directory>.tasks.params as params

is it possible to add back the UUID on the

prefect deployment create

command? we use it to compare created deployments with existing deployments to clean out unused deployments.

Hey y'all--happy Monday! I'm looking for guidance on writing credentials from Prefect Secrets to files, or alternatively for best practices using DBT profiles in Prefect flows in this Discourse topic, would love to hear from other Prefect community users: https://discourse.prefect.io/t/creating-volume-mounts-or-files-from-prefect-secrets/1243

Hello, After running the

prefect orion start.

It stops running quickly as below: Please let me know how do I troubleshoot this. Is it because of the windows machine that I am using?

Quick question: For prefect 1.0, should the env vars set in the agent's deployment manifests be present in executed flow's job environment? ?

Hello 🙋 Today i introduced our data-scientists to Prefect, and their main question was - what would be the easiest way for them to run their custom code (with all its various dependencies) from the flows they create Is containerizing their code in a docker image and pushing it to a remote repository (like ECR) the only reasonable way to achieve that? or could we conceivably just fetch the code from Github, and install the necessary dependencies as actual tasks in the flow, before executing it? (obviously it adds complexity and run-time to the flow, but are there any other reasons this might not work or be a bad idea?) (the main reason dockerizing and pushing to ECR is inconvenient for them is because they can't do it themselves, and we don't have a lot of DevOps resources that can easily provide them with a complete CI/CD pipeline for every new project they wanna test out)

can we use localdaskexecutor for parallel flows managed by k8s agent when moving to production?

I am having trouble with an error message I am receiving. I believe it has to do with the engine analyzing domain model classes i provide as input to a

@flow

. I will attach a micro example of what i am trying to accomplish... would someone mind helping me understanding the error message:

FAILED my-prefect-project/tests/flows.py::test_pipeline - TypeError: __init__() missing 2 required positional arguments: 'host' and 'port'

After installed Prefect on Windows10, I got a error message when run 'prefect version'

Version:             2.0b12
API version:         0.7.0
Python version:      3.9.1
Git commit:          18d44c8c
Built:               Fri, Jul 22, 2022 4:23 PM
OS/Arch:             win32/AMD64
Profile:             default
Server type:         <client error>

Hey community! Thank you for your software 🙂 I have an issue with setting up my orion workflow on kubernetes. I am following this doc, but stuck at Configure storage part for my GCP bucket. The doc suggests to call

prefect storage create

in cli, but my 2.0b13 doesn’t have no such command returning the error Error: No such command ‘storage’. Should I create the storage using this doc ? There is no example for GCP, i found this one in the community. But there is no

from prefect.blocks.storage import GoogleCloudStorageBlock

import in my venv 😞

can one agent run multiple work-queues in prefect 2.0

I have a task which will return a list, is it possible to use case based on the length of the returned list? e.g.

data = returns_list()
with case(data, len(data) > 1):
    do_stuff_with_data(data)

with case(data, len(data) == 0):
    do_stuff_with_no_data()

Hi 🙂 Does prefect 2.0 export some metrics through an open-telemetry exporter for example ? 🙂 And more globally what is the best way to be alerted when a job fails ? (I have already an alert in my kubernetes cluster if a pod fails but maybe it’s possible to have something more prefect related/high level)

Hi Community, I am facing issue while scheduling prefect flows (v 1.2.2). issue screenshot attached. looking for help. Thanks !

Prefect 2.0 | Accessing current flow state Hi! 👋 Possibly simple question which I can’t seem to find an answer for: Can I access the state of the current flow from within that flow? In particular I’d like to check if the flow is retrying, and if so pass an extra argument to my task(s) i.e.

@flow
def my_flow():
  if <somehow_get_state_of_this_flow?> == "Retrying":
    do_something()

Hello, I have a question regarding Prefect2.0. My team was using Prefect1.0 earlier and had been using the Graph QL functionality. Do we have this functionality in Prefect 2.0 as well?

Hi I’m working with prefect 2.0, trying to replace the storage capability with the new filesystem feature. I managed to publish the deployment but when the agent is launching a Job I got an issue with the lack of

gcsfs

dependency (using GCS as a

RemoteFileSystem

) I guess this dependency should be added to the docker image or maybe it’s possible to specify additional libs ?

how to run multiple workqueues using helm on kubernetes in prefect orion

Hi All, How to pass extra parameter (slack channel name) for the state_handler

Currently I have this:

def escalate(obj, old_state, new_state):
    if new_state.is_failed() and new_state.message not in IGNORE_MESSAGES:
        msg = f"{obj} {new_state.message}"
        slack_post(msg, channel="#errors", username="Prefect")
    return new_state

and i would like to

def escalate(obj, old_state, new_state, error_channel="#errors"):

because i need have different channel for some flows

Hello, I have the 0.15.4 version of prefect. is ther a guide on how to run a pipeline in Azure Data Factory ADF from within a Prefect Flow?

Hey, quick question, are there any breaking changes planned for prefect 2.0 until the GA release? (And does the GA release contain breaking changes?). A quick yes/no answer is sufficient - we'll figure the details out 😄

are there docs or examples that demonstrate how to use

orion

for non-terminating long running workflows?

This message was deleted.

https://twitter.com/PrefectIO/status/1551970847266684931?s=20&t=syAHCrWY9bu5wa78ZKrMqA We'll be giving away keyboards in the community, too! Stay tuned on Thursday of this week for a way to win a custom Prefect keyboard. These are WASD v3 107 key mechanical keyboards with Cherry MX Brown switches.

Hi, community, how to understand the trigger, if upstream flow are using mapping to create parallel flows, will this arg implies my current flow will wait until every parallel upstream flow becomes successful? Since my current flow is still mapping parameters as parallel run, what I want is when each parallel upstream flow finishes, no matter its peer flow finishes or not, it will continue to downstream flow. How could I set trigger args, if I want this to be achieved, this will help our company greatly enhance performance, thanks!! (we use Prefect 1.0)

create_flow_run(trigger = all_successful)