Hello everyone, does Prefect Cloud has any global status page that is available for public to monitor of it services uptime ? Something like status.databricks.com, status.aws.amazon.com ?

Hello, I am a software developer from Israel. Been reading and playing some with prefect and it looks like a really great product! I am working with an algorithmic research team and we are looking for a platform to run our experiments. We are currently using an in-house system but we experience a lot of friction using it and looking for an alternative. (more inside this thread)

Hi, I’m an engineer doing a POC for Prefect. I want to get a good local setup running in docker. I tried out the docker-compose on github and am under the impression that’s used more for doing development on Prefect itself. It didn’t work and after reading back through the readme’s I tried to install the conda prefect package and run it on a simple python docker image. Now that I’ve got everything installed I’m trying to get the various components running in a single container runtime that I’ll then split out later (server, agent, ui) The idea is that this local stack be used for trying out local workflows as part of the development process, and then the docker-compose of those three ‘roles’ can be ported to helm charts and run on K8s. I’m running into a couple issues, and after sleuthing around on the GH issues I figured I’d just ask here. docker-compose

version: '3'
services:
  python-repl:
    image: prefect
    entrypoint: "/bin/bash"
    volumes:
      - "workspace:/home/workspace/"
    ports:
      - "4200:4200"
  prefect-backend-only:
    image: prefect
    command: prefect backend server && prefect agent local start && prefect server start
    volumes:
      - "workspace:/home/workspace/prefect-server"
  prefect-full-stack:
    image: prefect
    command: prefect server start
    volumes:
      - "workspace:/home/workspace/prefect-server"
volumes:
  workspace:

the dockerfile I used to build the

prefect

image above is just a python image I’ve installed conda and prefect on. I can run the

prefect backend server

command just fine but it blows up on

prefect agent local start

with

requests.exceptions.ConnectionError: HTTPConnectionPool(host='apollo', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x4004761130>: Failed to establish a new connection: [Errno -2] Name or service not known'))

I could just be missing some docker-compose pieces, and ideally I could re-use the docker-compose pieces your development team uses for the local dev stack.

Would the prefect conda pacakge start up out of the box with none of the external dependencies defined or would I need to essentially do what’s been done here? https://github.com/PrefectHQ/prefect/blob/master/src/prefect/cli/docker-compose.yml

I’m really excited to try this platform out btw. The work everyone’s done so far is impressive!

And I guess to add to my confusion, from within the container runtime (interactive shell) if I skip the local agent start and just try to do

prefect server start

I get an error

So maybe I’m not supposed to issue that command from inside a container?

I will start to reread the docs as well 😄

Looking to get started with Prefect in a Conda env on Windows 10. I encountered errors attempting to Orion so I decided to go forward with Prefect.

👋 Hello, team! I am a data evangelist from toloka.ai - a crowdsourcing data labeling platform, I am located in Munich:)

Hi, where can I ask questions about billing?

Hello fellow dek stackers..... I am The chosen one and it is my pleasure to joining your fine accompaniment this evening... 🙂 ❤️

Hello team! I work for a Japanese company and I am in the process of implementing prefect in my project. I am still new to the subject, so I would appreciate your help.

Hey all, I already asked some questions, but did not introduce myself. I'm currently working as a consultant for a major airline doing a project in the field of discrete optimization. I think that field would benefit from having structured pipelines so checking out Prefect for that 🙂

Hi All, Lalit here. We are currently building Obsei : An open-source low-code automation tool. Kind of ETL tool for unstructured (current focus on text later on audio and image) data. We are experimenting with few open-source orchestrator tools like Perfect, Airflow, Ray and Dagster, to add capability to run data extraction job. Along with using cloud version for commercial offering.

Hey Prefect Community! 👋 I work for a medium sized pest control company as a data engineer. I'm currently spearheading our data team's effort to shift from a no-code workflow orchestration/ETL tool to Prefect! We're excited about what we'll be able to do once we can break free from the chains of our current tool and Prefect seems like the perfect way to do it.

Hello Prefect team. My org is exploring ETL infrastructure providers and I was hopping I could get a product demo/walkthrough. Would it be possible to setup a call with a SME sometime this week or next to answer some product questions? Thanks !!

Hello fellow Prefecters. I just wanted to introduce myself - I am responsible for standing up using Prefect in my company to eventually take over running our ETL & periodic reporting jobs. I've seen how great the Prefect community is, and I'm excited to be joining!

Hi there. New to prefect.

Hi all! I first used Prefect in Jan 2020 at my old job but haven’t checked it out in almost 2 years. Looks like a lot has changed. Fun fact: I still remember the Prefect tutorial advertising that “Flows could be used to make a cup of coffee” ☕

Hello everyone! I'm a consultant data architect, based in Barcelona at the minute. Nice to meet everyone, looking forward to connecting with you all ☕

Hi all. I’m a data scientist based in London. I’ve recently been tasked with getting a data orchestration framework up and running for my org. I’m new to Prefect (and data orchestration in general) so very happy there seems to be a lively community here!

Hi all! I’m Python Engineer from Ukraine. I’ve been working with Airflow for 2 years and now we are planing migrating to Prefect. Nice to meet everyone here!🎉

👋 hi all ！I’m Python Engineer from china

Hello everybody I’m a software engineer currently based in Spain. I spent most of my life writing software but I never wrote a modern data pipeline. My stack up until now has been c#, node, and a tiny bit of Python. I love that there’s a Slack channel to help each other out!

Hello everyone, I'm a data engineer junior seeking for knowledge about modern data tools. I stumbled upon you guys when searching for a workflow orchestrator as we are currently building our data stack. The 2.0 version looks very interesting and i'm really looking forward to use it and asks questions ! Thank you 🙂

Hello Everyone,

I am new to prefect cloud and trying to do a PoC on prefect with S3, It would be great if anyone can guide me with this PoC