• Anish Chhaparwal

    Anish Chhaparwal

    1 year ago
    hey, I want to deploy my flow using docker. I'm using the code from prefect docs : Flow with docker (first image attached). I do not push it to any registry as i want to run the docker image on my local machine. After starting the docker agent using
    prefect agent start docker
    i am able to register the flow to the UI but it always remains in pending state and never gets executed(refer images attached). Can someone explain where i am going wrong?
    Anish Chhaparwal
    Kyle Moon-Wright
    10 replies
    Copy to Clipboard
  • Darren Forsdike

    Darren Forsdike

    1 year ago
    Hi, has anyone example code of a flow to run a docker image on a schedule ?
    Darren Forsdike
    1 replies
    Copy to Clipboard
  • Newskooler

    Newskooler

    1 year ago
    Hi 👋 If anyone has experience starting
    prefect server start
    via a running docker image, can you please help me fix an error I keep getting : / I summarized it here: https://github.com/PrefectHQ/prefect/discussions/3449
    Newskooler
    c
    3 replies
    Copy to Clipboard
  • t

    tom

    1 year ago
    Hi! I have Prefect server & UI running locally (
    prefect server start
    ) and my flows are executing via the agent (
    prefect agent start
    ). I was wondering how I could get them to run on Dask? I have
    dask-scheduler
    and a few
    dask-worker
    processes running. When I run my flow using
    flow.run(executor=DaskExecutor(address="<tcp://xxx:8786>"))
    everything works well, but when I run the flow via prefect server’s UI it doesn’t run on Dask. What am I missing? I tried running the server and agent with
    export PREFECT__ENGINE__EXECUTOR__DEFAULT_CLASS="prefect.engine.executors.DaskExecutor"
    and
    export PREFECT__ENGINE__EXECUTOR__DASK__ADDRESS="<tcp://xxx:8786>"
    set but this didn’t help.
    t
    Chris White
    3 replies
    Copy to Clipboard
  • DJ Erraballi

    DJ Erraballi

    1 year ago
    Other than running scheudling for the flows and acting as the api backbone for the prefect UI; the major roles that prefect server performs is to:1. checkpoint tasks?
  • DJ Erraballi

    DJ Erraballi

    1 year ago
    attempting to understand the scalability differences for single node prefect server vs prefect cloud
  • DJ Erraballi

    DJ Erraballi

    1 year ago
    is the major scaling problem for concurrent flows, that the prefect server needs to be available to recieve checkpointing data and store it?
    DJ Erraballi
    Chris White
    13 replies
    Copy to Clipboard
  • j

    J.R. Carneiro

    1 year ago
    Hi, I am having a dependency issue and I am unsure whether anyone has encountered this before
    j
    nicholas
    6 replies
    Copy to Clipboard
  • h

    Hagai Arad

    1 year ago
    Hi, I have a flow that uses several
    FlowRunTask
    and run them concurrently using local dask executor. (The flow code is in the first comment). My question is, is there another way to make the
    FlowRunTask
    ’s run concurrently without using dask? Thanks!
    h
    nicholas
    +1
    4 replies
    Copy to Clipboard
  • e

    Elliot Oram

    1 year ago
    Hi all upgrading from 0.10.6 to 0.13.10 and looking for some advice/clarification. We used create the flow with a context manager to setup task orders and register e.g.
    with Flow("Flow name") as flow:
       flow.add_task(abc)
       flow.register(project_name="Test")
    In the latest version I find that this isn't possible anymore as I get a
    TypeError: can't pickle generator objects
    My solution has been to replace this by defining the the flow object directly and ditching the context manager e.g.
    flow = Flow("Flow name")
    flow.add_task(abc)
    flow.register(project_name="Test")
    This works absolutely fine and I'm happy to continue with it. I just wanted to check if:1. This is the expected / best way to resolve this problem 2. [Some of the documentation](https://docs.prefect.io/core/concepts/tasks.html#overview) still refers to the use of the context manager style. Is this okay to do simply because tese example do not register a flow? Any advice is welcome 🙂 Thanks!
    e
    Chris White
    +2
    7 replies
    Copy to Clipboard