Is anyone else seeing jobs fail to start this morning using the hybrid hosting model? Our jobs are not getting picked up this morning but we have not seen any errors in the logs on our Agents running in our k8s cluster and did not make any changes for our k8s environment or our Agents

Is there a way to rename pipelines? Or "retire" them? We have the old

data_pipeline_prod

that we want to somehow label that it is deprecated? And then change the one with test in its name to the new

data_pipeline_prod

? Or any suggested ways to do this?

I want to speed up CI/CD by self-hosting prefect server and having the CI tests register flows against a our self-hosted server. How can I direct the flow.register to point to our custom URL?

How does one add a new Parameter to an existing Flow? I inherited a Flow from a colleague that has since left and I wish to add a new Parameter

with Flow("HathiTrust Deposit (MARCXML)") as flow:    
     deposit = Parameter("deposit", default=False)

This is the existing parameter. I want to add a second so naturally I tried adding another underneath the first like this:

with Flow("HathiTrust Deposit (MARCXML)") as flow:  
    deposit = Parameter("deposit", default=False)
    local_test = Parameter("local_test", default=False)

This results in an error:

UserWarning: Tasks were created but not added to the flow: {<Parameter: local_test>}. This can occur when `Task` classes, including `Parameters`, are instantiated inside a `with flow

How does one add a parameter to an existing flow?

Is github storage no longer an option for prefect 2.0?

Hi there, I have a question about iterated task mapping...

can we do resource managment in prefect ? giving different flows differnt cpu power

is it worth renaming this channel 1.0 and having a dedicated 2 channel, sure gets confusing

Hi, question regarding flow registration - During follow registration, it requires packages used in the flow to be already installed on the machine. One walkaround is to import packages inside each tasks, however, is there a way to not duplicate code and import at top level? Thank you!

Hi! Small question about Prefect 2.0. Is there any concept similar to Secrets in Prefect 1.0? I used to store all my secrets in

config.toml

and access them via Secrets API or

prefect.context.secrets.get()

. But I can't find anything similar in 2.0

When a Flow loses the heartbeat and then is restarted (No heartbeat detected from the remote task; retrying the run.This will be retry 2 of 3.) is there a flow State provided when the process starts again? Like a Retrying state or a Running state?

Hi, having a complete brainfart moment. I am trying to return the string “full”, to the next task, but I am getting None:

@task(nout=1)
def determine_run(clock):
    if clock == "full_run":
        <http://logger.info|logger.info>("full_run clock")
        run_type = "full"
        <http://logger.info|logger.info>(f"{run_type}")
    return run_type

Hello All, I am running prefect orion in docker with sqlite3 DB. For persisting data used bind mount. The location on host cannot be local folder as after weekly boot New host will be assigned and docker will run on that. Hence I used AFS like my other bind mounts, however having such setup and on prefect orion start its stuck at message "server starting". If I set db directory just inside docker then server gets started but the data cannot persist now. Is there any issue keeping db file on AFS? What can be done in this case?

I'm on v2.0b7 and am trying to get a minimal code example to work with a Dask cluster. I can use DaskTaskRunner locally, but as soon as I add the TCP address to my test cluster, the system fails. I see a very lengthy error on the Dask worker that includes: "prefect.exceptions.PrefectHTTPStatusError: Client error '404 Not Found' for url" I am able to submit jobs successfully using Dask directly, just not through Prefect. Here is the code:

from prefect import flow, task
from prefect_dask.task_runners import DaskTaskRunner

@task
def say_hello(name):
    print(f"hello {name}")

@flow(task_runner=DaskTaskRunner(address='tcp://[redacted]:8786'))
def greetings():
    say_hello('test')

if __name__ == "__main__":
    greetings()

Any ideas?

In Prefect 2.0 (Orion), can we start the agent with a custom job template like how we could do in Prefect 1.0? https://docs.prefect.io/orchestration/agents/kubernetes.html#custom-job-template

Hi~ Can i use the company account for register to Prefect Cloud? I sign up the Prefect Cloud by using Google groups mail but can't find the activation mail from okta. Also Instruction mail about reset password can't recive to mail. 😓

Hi, I'm quite looking forward to all the features coming up in prefect. I was wondering however if there is some roadmap somewhere about next steps/features that I should expect.

Hi All, When we are trying to register the prefect flow , we are facing the below error. We are using prefect 1.2.2 and python 3.8. The prefect server is installed on Google kubernetes engine. pls check and suggest.

In cloud 2.0 whats the best strategy to install a k8s flowrunner dependency - do I patch a command in to pip install?

can parent and child flow have different resource computation in prefect 2.0

Hello, community! I faced with so stupid problem and really have no idea what is going wrong… So when i try to register flow (using common_tasks from another module) there is an error

module not found

. Could you please help with it? ---> thread

Cross-posting here for visibility

Hello, when registering flow with for github storage, as in the steps here: https://docs.prefect.io/core/idioms/script-based.html I get "building local storage" in the terminal instead of "building github storage". Any idea why this could be happening?

I thought I would have a play with 2.0 today - tried running the code here -> https://orion-docs.prefect.io/tutorials/first-steps/ - get following error?

ValueError: the greenlet library is required to use this function. No module named 'greenlet'

Any ideas?

Hello, been seeing some intermittent issues with logs — haven’t found repro steps yet, but the symptoms include: (a) only seeing error/warning despite root/prefect loggers are set to debug, and (b) some missing logs once in a while. Curious if anyone has seen this?

Hi guys is there any way i can produce the following using prefect

for col in date_columns:
        if col in df_columns:
            df[col] = df[col].str.replace('/', '-')
            with mp.Pool(mp.cpu_count()) as pool:
                df[col] = pool.map(get_parsed_date, df[col])

I'm getting false notifications from Prefect Cloud, from the PagerDuty Automation I have enabled. The notification says "Prefect Action Failed Notification", but the details show that HTTP response code was 202 (Accepted). So these probably should not be causing a failure notification. The

PagerDutyNotificationAction

(

24dfaasdfe-93dd-4b11-8dddc-4xxxxxx3d23

) has failed with 'HTTPError: 202 Accepted 'PagerDuty did not provide error details.' while contacting service API. Check your action configuration. See the Pagerduty docs for more details on error handling.' during execution triggered by

FlowSLAFailedEvent

event from hook

b625xx8-d3x-4xxe-bxx6-1xxxxxx67f2

.

Hello everyone, We have been using prefect 1.0 for quite some time in lower and higher environments. Recently, there was some activity ran by the security team and the server where prefect db is hosted was moved to private subnet. Right after that, several issues start popping up. • Unable to run the jobs from UI • Flows can't be scheduled because scheduler option is not working • Agent is not picking up the scheduled jobs Whole stack is deployed on AWS ECS Fargate. Issues still persist even after bringing back the subnets to public.

Hi all, I am trying to pass parameters from the output of a Parent Task to a child flow. These parameters are dataframes that a few other child processes will use as well however I receive the below TypeError: My question is what is the best way to pass data from Parent to Child flows? I am trying to avoid querying multiple times since the query is intensive

TypeError: Object of type DataFrame is not JSON serializable

Hi all, getting this error when trying to run a flow with the

FlowRenameTask

File "/Users/madisonschott/dbt_snowflake/data_pipeline_test_new_account.py", line 5, in <module>
    from prefect.tasks.prefect.flow_rename import FlowRenameTask
ModuleNotFoundError: No module named 'prefect.tasks.prefect.flow_rename'