set the channel description: Channel for welcoming new members of the community

Hi The tutorials, both the "Running a Flow" and the "Universal Deploy" tutorials, fail. Both on the

prefect auth login

step. Prefect tries to connect locally rather than to your cloud:

requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: /graphql (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f5aa8c9f630>: Failed to establish a new connection: [Errno 111] Connection refused',))

How do I tell Prefect that it should connect to the cloud?

Hi all 👋 , I run a small data analytics and engineering consultancy Data Mill (datamill.co / https://www.linkedin.com/company/data-mill/). We started using Prefect for some projects after testing it on some toy pipelines. Really liking it so far compared to Airflow and Luigi.

Hello World, I'm Edison Abahurire, realtime data processing engineer form Kampala, Uganda. I'm using prefect for FTP data ETLs in staging, and its very promising. I tried Airflow and it was quite a job; it wanted me to re-write my whole project 😒.

Hi everyone. We are considering trying out Prefect, and had some questions. We are a healthcare company, and deal with hipaa. 1. Does Prefect Cloud have security processes in place to deal with the complexities of hipaa? 2. Is there a write up on how Prefect Cloud ensure data security for its customers? Also, what is the best way to get a quote for a Enterprise-level Cloud account?

Hello everybody! I'm Robert Bastian, VP of Research and Innovation for Enverus. We're looking at Prefect as a replacement for Airflow (who isn't?). We love the UI and the documentation is excellent. I love being able to look in the github repo at the code to understand how things work. That said, I have some basic questions on how to do things the "Prefect way" that I'll be asking. Is there a channel for "new to Prefect" folks? Thanks!

Hey folks, I've been lurking around here and have started to post a few replies so I thought it best to do an Intro. I'm Matt Drago and I work for a company with their HQ in Melbourne, Australia called PaperCut. I'm running with a team that is setting up Prefect to help out with our Data Democratisation journey. I'm looking forward to also contributing back to the Prefect code base where I can.

how to install prefect on local system using docker

and how to run my first code snippet ., somebody please help me

Hey all! I am Karolina, I am Data Engineer at cividi and right now I am responsible to do research for suitable solution for our workflow. You got my attention, so far Perfect looks like a hot candidate! Looking forward to get more info from the community, I'll check other channels 🙂 And hey, merry christmas/ happy holiday to all! 🎄🎉

Hello to everyone. I am Giovanni, I am a technical product manager and in these days I'm looking for a solution to create a data engineering pipeline for geospatial data elaboration. I am experimenting with Prefect core and it looks great. Actually, it's like a battle between Prefect and Dagster. Thank you to all, this is a great community!

Hey all, I'm Gareth - Founder of Ritza.co, a technical publishing company. We produce books, blog posts, technical documentation etc with a focus on machine learning, devops and software engineering. I'm writing some articles that discuss Prefect so would love to discuss some things here as I don't have a ton of first hand experience with it. Specifically regarding the "why not airflow" article and whether Airflow 2.0 adequately addresses any of the concerns about Airflow raised there. https://docs.prefect.io/core/getting_started/why-not-airflow.html Specifically I'd like to add prefect to our article here https://www.datarevenue.com/en-blog/airflow-vs-luigi-vs-argo-vs-mlflow-vs-kubeflow

Hello, Michal, university sysadmin looking to get some automation UIs built

Hello, I'm a software engineer looking to migrate away from Google Cloud Composer.

Hi all, software architect here exploring whether Prefect might be a good option for running some rather complex flows in a production SaaS product which involve a mix of... 1. Multiple users with different roles, all submitting their own inputs and reacting to the progress of the flow in different ways. 2. Calls to various services (some long-running). 3. Quite a bit of branching logic based on the inputs provided by users and other services, and potentially even the need to repeat, loop, and/or add/remove steps midway through the flow as needed. 4. Potentially multiple different terminal states for the flow (e.g., we can terminate if we have data X and Y, or else if we have data Z, X, and A). 5. The ability to run and A/B test different versions of flows for different users simultaneously. Not sure if something that hairy is abusing Prefect's focus on data engineering, or is even possible in Prefect...but I look forward to finding out and getting to know you all. :)

Hello, I’m software engineer looking into replacing our Airflow deployments and pipelines with Prefect 🙂 Mainly because we can’t move some of our pipelines to Airflow as it is missing good support for dynamic dags. We need a high degree of dynamism in some of our pipelines.

Hello All. I am a contractor working for a company that I can't really disclose, not a government entity, due to compliance issues. However, I am trying to set up Prefect in a GCP cloud. I am using the great Medium article as my roadmap - https://medium.com/the-prefect-blog/prefect-server-101-deploying-to-google-cloud-platform-47354b16afe2. I am running into some issues on start up so I am here to see if I can glean some insights into resolving those issues.

Hi everyone! I'm a software developer looking for a great tool to professionalize our data pipelines. Right now we're working with lambda's and S3 triggers, but it's getting too big for that. I started out with Airflow, but it doesn't seem to have support for dynamic dags and that is a main feature we need.

Good morning! I am evaluating prefect for orchestrating our workflows. I'm starting with the community edition..

Hi everyone! I'm a data coach and I work with data teams, guiding them and helping them build a mature data practice. I have a strong motivation to not use Airflow (due to its cluttered UI, eccentric scheduler, …) and tried Prefect some time ago. I think its version was 0.6 back them and it didn't feel very ready but I made it work and deployed pipelines, each in a container running on Docker Swarm. I'm really excited to see how Prefect matured and recently reworked the pipelines and set up Prefect Cloud and an agent. I need to distill this setup to a blueprint so I can reproduce that but Prefect already has earned a spot in my Data Engineering Toolkit. Thank you for your work!

Hello there, I'm Loïc, data engineer from 🇫🇷 As I made a recent transition from a more data scientist/ML Ops position, I am looking to expand my toolkit 🙂 I already had some experience with Airflow, which I found quite cumberstone: that's why I am impatient to try Prefect in my personal and freelance projects !

Hi everyone! I’m coming from a software dev background and am dipping my toes into data. Good to meet you all

Hi 👋 Data Engineer from the gaming industry here 🙂 Currently investigating prefect to stay up to date with the tech ^^

Hi BK from Boston here. Currently investigating Prefect to use in quantum computing workflow

Hi, I am BI engineer from Colorado. I am a 6 month newbie user,

Hello 👋 I’m a data scientist in Portland, OR. Checking out Prefect as a potential replacement for our existing data pipeline orchestration system.

Hello 👋 Another DS here, trying to see if Prefect fits our needs.

Hey folks 👋 Just playing around with Prefect as we look to use it Cloud Engineer @ Development Seed but remote in the UK

Hi all. I’m a Principal Software Engineer at Kairos Aerospace, where we do greenhouse gas emissions monitoring. We are long-time airflow users, but I am starting to use Prefect to implement some of our new ML workflows.

👋 Hi all, I'm a BI Engineer at GoCardless in early stages of discovery to understand how Prefect could help improve our development workflow. Looking forward to learning more.