• e

    Elliot Oram

    8 months ago
    Hi all, When I try an do
    prefect agent local start --api <http://prefect-server-url-goes-here:4200>
    (replacing the
    perfect-server-url-goes-here
    with the actual server address) I get a connection refused. There is a prefect server running on that machine and I have whitelisted my local IP for port 4200 on that machine. Not too sure how to go about debugging this one so any pointers would be greatly appreciated.
    [2022-01-04 16:27:48,100] INFO - agent | Registering agent...
    Traceback (most recent call last):
      File "/Users/elliotoram/dev/pipeline/venv/lib/python3.9/site-packages/urllib3/connection.py", line 169, in _new_conn
        conn = connection.create_connection(
      File "/Users/elliotoram/dev/pipeline/venv/lib/python3.9/site-packages/urllib3/util/connection.py", line 96, in create_connection
        raise err
      File "/Users/elliotoram/dev/pipeline/venv/lib/python3.9/site-packages/urllib3/util/connection.py", line 86, in create_connection
        sock.connect(sa)
    ConnectionRefusedError: [Errno 61] Connection refused
    e
    Kevin Kho
    3 replies
    Copy to Clipboard
  • s

    Sam Werbalowsky

    8 months ago
    My understanding of the KubernetesRun is that the env passed only applies to the prefect job pod that spins up - is there a straightforward way to pass env vars to the dask worker pods (using desk gateway)? I am thinking of using parameters based off the environment during registration, but not sure if that is the best approach.
    s
    Kevin Kho
    13 replies
    Copy to Clipboard
  • p

    Prasanth Kothuri

    8 months ago
    I am getting
    [3 January 2022 8:26pm]: [Errno 24] Too many open files
    error , what is the recommended value for open files ?
    p
    Anna Geller
    2 replies
    Copy to Clipboard
  • v

    Vaibhav Ariyur

    8 months ago
    Hi all, in Prefect is the following kind of dynamic task generation possible: user passes in the following parameter: [0,1,[2,3],0,[1,2,3]] and in doing so dynamically creates the following flow: task0 --> task1 --> parallel(task2,task3) --> task0 --> parallel(task1,task2,task3) I know dynamic mapping can take the user input and dynamically create tasks that are in parallel, but is this possible too?
    v
    1 replies
    Copy to Clipboard
  • Margaret Walter

    Margaret Walter

    8 months ago
    Hey guys! Is there a way to register a flow via a call to the server/graphql endpoint without installing prefect on the local machine? I'm trying to register flows during the build step of a code deployment pipeline (we have one pipeline for the server on EKS and one for flow/model deployment, so the server should already be set up by the time pipeline #2 is registering the flow), and I'd like to minimize the packages that need to be installed during build 😅.
    Margaret Walter
    Kevin Kho
    5 replies
    Copy to Clipboard
  • Corris Randall

    Corris Randall

    8 months ago
    So, I have prefect server running on some dev instances, and a uat/qa instance, and then I have production using prefect cloud. I want ALL logging to go to a graylog server via graypy. I've found that when I run the flow via the command line in the docker container, it sends all the logging to my graylog server. however, when I run the flow from the UI ( server or cloud ), it doesn't set my handler. Where's the appropriate place to put this:
    Corris Randall
    Kevin Kho
    7 replies
    Copy to Clipboard
  • e

    Elliot Oram

    8 months ago
    Hi all, I am trying to setup a system where I can have prefect agents on different machines from the prefect server. Right now I have a prefect server on machine A and prefect agent on machine B. I can register the agent and it shows up in the UI no problem. When it comes to running flows however, there is no issue. Before any of the tasks start to execute I get the error in the screenshot:
    Failed to load and execute Flow's environment: ModuleNotFoundError("No module named '/home/ubuntu/'")
    The agent is running in a python virtual environment (I have also tried this without the venv and the result is the same) the agent is started with the following command:
    prefect agent local start --api <http://my-server.com:4200>
    Any ideas on what might be the cause, or how to start debugging this?
    e
    Anna Geller
    3 replies
    Copy to Clipboard
  • Pedro Martins

    Pedro Martins

    8 months ago
    Hey there! What is the difference between using the
    client.create_flow_run(flow_id, parameters)
    and
    flow.run(parameters)
    . Are they equivalent? Would the
    flow.run
    connect to the client and run the latest version of the flow?
    Pedro Martins
    Anna Geller
    2 replies
    Copy to Clipboard
  • Carrie Bohinc

    Carrie Bohinc

    8 months ago
    Hi all. I am trying to install the prefect server helm chart and am running into an issue. I am following along with the tutorial here:

    https://www.youtube.com/watch?v=EwsMecjSYEU&amp;t=485s

    and have made it to the point of installing the chart (which completes without error), however my graphql pod cannot start because it can't connect to the postgres db. I am not trying to connect to an external db (just testing atm). When I look at my pods I do not see that a postgres pod was started, but I can see the
    prefect-server-postgres
    and the
    prefect-server-postgres-headless
    services running. I was under the impression that the helm chart would automatically start a postgres instance to use if you weren't connecting to an outside db. Did I miss a step somewhere? Any guidance is appreciated.
    Carrie Bohinc
    Michael Adkins
    2 replies
    Copy to Clipboard
  • Cristian Toma

    Cristian Toma

    8 months ago
    Hi all, I'm running a flow in a k8s environment and created custom
    state_handler
    for a flow. When running locally in the
    new_state
    object the
    result
    property has values in it, but when I run it on the cluster, the
    result
    property is empty. Does someone know why is that empty, and how can I get the errors of a flow run in the state handler on a cluster env? Thanks.
    Cristian Toma
    Anna Geller
    2 replies
    Copy to Clipboard