• Hui Huang

    Hui Huang

    7 months ago
    Hi Prefect Builders & Community!~~ Hui here. I am a virtual CTO & founder of TheSparkOne Network. Prefect system and tools are designed & implemented in a modern way. I love it. ❤️👏 Played with it in the morning… got several hello-flow examples successfully. Love to co-learn and co-build data economy together. 😃
    Hui Huang
    Anna Geller
    +4
    6 replies
    Copy to Clipboard
  • Matthias

    Matthias

    7 months ago
    Re-introducing myself as I switched company (and no longer have access to my previous company email). Been working in the field of ML for 5 years now and following this community for the past year. Where I currently work, we are heavily invested in k8s. So for us, it made sense to chose Argo as our orchestration framework. I must admit that I like it for several reasons: • it is k8s native, so you can treat flows like any other deployment every task runs in a separate container so you can easily isolate tasks that require strict security requirements However, there are several drawbacks too. Most notably: • because every task run in a separate container, your tasks are less atomic not to waste too much time on pod creation etc. • Since it is k8s, it is really hard for devs to use it. Hence the responsibility falls into the hands of the data platform team (who manages the k8s cluster), which is the wrong thing to do imo. For these reasons, I would like to introduce Prefect as an alternative to Argo. Therefore, I really look forward to a production-ready release of Orion! 💪
    Matthias
    Joshua Greenhalgh
    +7
    32 replies
    Copy to Clipboard
  • Raimundo Pereira De Souza Neto

    Raimundo Pereira De Souza Neto

    7 months ago
    Hello, I'm software developer from Brazil (Manaus, the heart of the Amazon forest), and I loved Prefect 😛refect: .
    Raimundo Pereira De Souza Neto
    Dylan
    +6
    8 replies
    Copy to Clipboard
  • Joseph Lim

    Joseph Lim

    7 months ago
    Hello everyone, does Prefect Cloud has any global status page that is available for public to monitor of it services uptime ? Something like status.databricks.com, status.aws.amazon.com ?
    Joseph Lim
    Anna Geller
    3 replies
    Copy to Clipboard
  • t

    Tomer Cagan

    6 months ago
    Hello, I am a software developer from Israel. Been reading and playing some with prefect and it looks like a really great product! I am working with an algorithmic research team and we are looking for a platform to run our experiments. We are currently using an in-house system but we experience a lot of friction using it and looking for an alternative. (more inside this thread)
    t
    Anna Geller
    +1
    13 replies
    Copy to Clipboard
  • d

    Dylan

    6 months ago
    Hi, I’m an engineer doing a POC for Prefect. I want to get a good local setup running in docker. I tried out the docker-compose on github and am under the impression that’s used more for doing development on Prefect itself. It didn’t work and after reading back through the readme’s I tried to install the conda prefect package and run it on a simple python docker image. Now that I’ve got everything installed I’m trying to get the various components running in a single container runtime that I’ll then split out later (server, agent, ui) The idea is that this local stack be used for trying out local workflows as part of the development process, and then the docker-compose of those three ‘roles’ can be ported to helm charts and run on K8s. I’m running into a couple issues, and after sleuthing around on the GH issues I figured I’d just ask here. docker-compose
    version: '3'
    services:
      python-repl:
        image: prefect
        entrypoint: "/bin/bash"
        volumes:
          - "workspace:/home/workspace/"
        ports:
          - "4200:4200"
      prefect-backend-only:
        image: prefect
        command: prefect backend server && prefect agent local start && prefect server start
        volumes:
          - "workspace:/home/workspace/prefect-server"
      prefect-full-stack:
        image: prefect
        command: prefect server start
        volumes:
          - "workspace:/home/workspace/prefect-server"
    volumes:
      workspace:
    the dockerfile I used to build the
    prefect
    image above is just a python image I’ve installed conda and prefect on. I can run the
    prefect backend server
    command just fine but it blows up on
    prefect agent local start
    with
    requests.exceptions.ConnectionError: HTTPConnectionPool(host='apollo', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x4004761130>: Failed to establish a new connection: [Errno -2] Name or service not known'))
    I could just be missing some docker-compose pieces, and ideally I could re-use the docker-compose pieces your development team uses for the local dev stack.
    d
    Kevin Kho
    38 replies
    Copy to Clipboard
  • d

    Dylan

    6 months ago
    Would the prefect conda pacakge start up out of the box with none of the external dependencies defined or would I need to essentially do what’s been done here? https://github.com/PrefectHQ/prefect/blob/master/src/prefect/cli/docker-compose.yml
    d
    1 replies
    Copy to Clipboard
  • d

    Dylan

    6 months ago
    I’m really excited to try this platform out btw. The work everyone’s done so far is impressive!
    d
    1 replies
    Copy to Clipboard
  • d

    Dylan

    6 months ago
    And I guess to add to my confusion, from within the container runtime (interactive shell) if I skip the local agent start and just try to do
    prefect server start
  • d

    Dylan

    6 months ago
    I get an error