Following up from the Prefect Demo that ended just now, could you make the demo flows available on github? Or point me at them if they already exist somewhere?

Hi! Currently I am using AWS Fargate for the ECSRun, one of my tasks needs to insert data on a RDS Instance, the ECSAgent has the correct security group to be able to access the database. But when I check the tasks when are running in the cluster, they create a ENI in the default vpc which is different from the one I am using, does anyone knows how to solve this issue ?

Hi prefect community, any prefect users in or Belgium, that would be interested in setting up a local meetup to exchange experiences and best practices face to face? At www.garvis.ai , prefect is a key piece in our data pipelines. We hire globally and are remote first, but our HQ in Belgium and wondering if anyone else here is too and wants to share experiences with prefect and data engineering. ;-)

Absolute Prefect Newb here! I'm going thru the Getting Started Doc, in the Run a flow section, it states "I will see the following logs after running

flow.run()

" Yeah. Exactly. ...and where would I find these logs???

Is it just me that I cannot login using GitHub to Prefect cloud 🤔

i’m on GCP and want to get up and running on Prefect Cloud with agents on GKE and CI/CD through github. is there a guide somewhere that explains how to set any of this up?

Prefect 2.0b8, dockerflowrunner with dask. I am getting the following error, anyone know the soloution?

Hi there. How do you include extra files when packaging a flow as a Docker image on Prefect 2.0? (the equivalent of the

files

argument in 1.0 Docker storage). Thanks

Hi there, I'm looking at adding runconfig (i.e. environment variables) using the graphql api, any ideas how to do this using Prefect 1. Thank you 🙂

hi there. I’m running Prefect 2.0 on beta cloud. Since this morning I receive this error when submitting jobs to K8s:

Response: {'detail': 'The request specified API version 0.7.0 but this serverrequires version 0.8.0 or higher.'}

btw I’m using default image for KubernetesJob and my code is up to date with version

2.0b15

Hi guys, I'm trying to run sample code using DaskTaskRunner but got this error

ImportError: cannot import name 'DaskTaskRunner' from partially initialized module 'prefect_dask' (most likely due to a circular import)

I used

2.0b15

latest

prefect-dask

on Python

3.8.13

3.9

3.8.4

3.7.13

(freshly installed Conda envs), I'm wondering if you have come across this issue before? Many thanks

@Anna Geller The problem is whenever I start local agent of prefect and write the commands of registration of flow and running it, it just stuck there and don't proceed

Anyone have seen an error lile :

FileNotFoundError: [Errno 2] No such file or directory: 'python'

when running a flow on an agent from prefect cloud 2 ?

Is it possible to run previous versions of a Flow from the UI? I keep seeing

This flow is archived and cannot be run

, when I flip back to an old version. Wanted to make sure that’s always expected and I’m not just doing something wrong when registering new versions of the flow.

Hi i was looking for some help with a deployment recipe in github actions My

prefect register flows

workflow does not appear to return an error code when the there’s a issue with deploying a flow.. Only thing I can see I’m doing differently is that i’m using a matrix to • for each prefect project • deploy changed flows in each project has anyone had this problem before?

Hi team, I don’t really know GraphQL too well, could someone give me an example of the GraphQL to write to trigger a specific flow?

For Orion, is there a way to have subflows return futures as they did in earlier beta versions? So something like a my_flow.submit() method for parallelism...?

Hi, I'm trying to debug a flow locally and there seems to be a crazy slowdown effect in running code via Prefect versus just a regular CLI. I am on Prefect Orion 2.0b8. Rough flow looks like

@task
def update_task(file_type: str):
    update_files(file_type=file_type)

@flow
def update_flow(file_type: str):
    update_task(file_type=file_type)

if __name__ == '__main__':
    update_flow(file_type="incremental")

I am running it as

python -m tasks.prefect_flows.update_flow

. This takes 10+ minutes to run. By comparison, just running the same code with a click CLI takes 10s. Any idea what's going on?

do Prefect 1.0 tasks like the Fivetran tasks work with 2.0?

Hello, I am having the following error with DbtShellTask(): "prefect.DbtShellTask | Command failed with exit code 127" I am following the flow example in here: https://docs.prefect.io/api/latest/tasks/dbt.html#dbtshelltask (with providing my own arguments). I can't tell what is source of the issue

Hi, we've been having some issues with Prefect. A couple of hour flows have been running about 14x the time they usually take and I can't seem to cancel and restart them. Logs in thread...

Hello. None of the links to Prefect docs (from google results) work anymore (404 - Not found) For example: https://docs.prefect.io/api/latest/tasks/prefect https://docs.prefect.io/core/idioms/flow-to-flow

Hi, what is the suggested way to set a flow configuration value, like a sandbox API URL, across a flow-of-flows? We are currently using Parameters, but it appears I can only set paramters for the parent flow in the UI. I can’t directly set the child flow parameters, too.

Prefect 2.0 is live! 🎉

Hey, congrats to your release!!! I'm struggling to update my KubernetesJob deployments. (Prefect 2.0 Cloud user, updated my agents, CLI and KubernetesJob images to 2.0.0-python3.9) I ran the following command

prefect deployment build ../flows/r_script_automation.py:r_script_automation --name retention_cohort_analysis_deployment -t k8s -sb gcs/gcs-prefect-stprage -i kubernetes-job

If I then run "prefect apply..." and "prefect run..:", the job gets created, however it fails with:

Flow could not be retrieved from deployment.
FileNotFoundError: [Errno 2] No such file or directory: '/home/andreas/github/r_automation/flows/r_script_automation.py'

Note, that the directory /home/andreas.... is my local flow location, where I created the deployment from. It seems that somehow the job is not downloading the flow from GCS? My GCS storage block configuration is correct (I guess), because all my subprocess-flows work - only the KubernetesJobs have this problem. Any tips for me? 🙂

Anyone have any examples of running a DockerContainer deployment in Prefect 2.0 GA? Non of the documentation is correct that is referenced in the migration guide and even the tutorial I found with the correct code had the wrong CLI commands, and the new commands that would appear to be equivalent ignores the Deployment() function in the script.

Still a Prefect NooB! I am failing to find a simple example of what I am trying to do with Prefect. It seems like it would be not very much code! Firstly I want to run a query in a file against a Snowflake database. Secondly, I'd like to take the data returned by the snowflake query and insert it into a postgres table. Seems simple, right?

This message was deleted.

Hi and congrats on the 2.0 GA release! I can see that the pypi package for Prefect has been updated to 2.0 - can I ask will the conda package be updated to 2.0 as well? https://anaconda.org/conda-forge/prefect Thanks!

Hi Community, Could you please help me to understand how can I access KV Store values? I am getting this error

KV Store operations are only supported while using Prefect Cloud as a backend

and here is my setup: 1. My flow and run config using KubernetesRun:

with Flow(
    name="Import Benchmark Index Data",
    storage=Local(
        path="/app/workflows/benchmarks/flow_import_index_data.py",
        stored_as_script=True,
    ),
    run_config=KubernetesRun(
        image="prefect-workflows:latest",
        image_pull_policy="Always",
    ),
) as flow:

    benchmarks_states = task_fetch_benchmarks_state()

2. Docker file for prefect-workflows image

FROM prefecthq/prefect:1.2.4-python3.9

WORKDIR /app

ADD . .

RUN pip install --upgrade pip
RUN pip install -r requirements.txt
RUN pip install -e .

RUN prefect backend cloud

3. Agent configuration: