• Joshua Greenhalgh

    Joshua Greenhalgh

    5 months ago
    Hi all - wonder if anyone has any experience running prefect flows on GKE spot instances? Is there any way of dealing gracefully with possible SIGTERM signals?
    Joshua Greenhalgh
    Anna Geller
    +1
    17 replies
    Copy to Clipboard
  • Dekel R

    Dekel R

    5 months ago
    Hey all, I get this weird behavior once in a while - there are no logs in 1 of the flows I’m running. Most times it works fine and I get all the expected logs but sometimes only this - see the attached file. Am I missing something? Anyone have the same issue? This specific run had a bug (a python bug in the app itself that I couldn’t see..) Thanks
    Dekel R
    Kevin Kho
    5 replies
    Copy to Clipboard
  • Pedro Machado

    Pedro Machado

    5 months ago
    Hi everyone. We are using
    wait_for_flow_run
    to wait for a subflow run. The subflow is a long-running job that can take more than 12 hours and sometimes it times out. I noticed that
    wait_for_flow_run
    uses
    watch_flow_run
    which raises an exception if the flow has been running for more than 12 hours. The 12 hours timeout is hardcoded. See https://github.com/PrefectHQ/prefect/blob/afda99411f91582ad187bf33671268d8d3c3c2c0/src/prefect/backend/flow_run.py#L95 We plan to upgrade to 2.0 shortly after it's released. Is this timeout limitation for subflows also implemented in Orion?
    Pedro Machado
    1 replies
    Copy to Clipboard
  • h

    Hugo Shi

    5 months ago
    I have a flow that I broke recently (bug in code). Now when I try to execute it in prefect cloud, There are 5 flows submitted, but nothing is happening to them. The agent we have is successfully picking up and running other flows. Do I need to clear the submitted flows? and how would I do so?
    h
    Kevin Kho
    15 replies
    Copy to Clipboard
  • Shuchita Tripathi

    Shuchita Tripathi

    5 months ago
    My prefect flow has few tasks which are running terraform. Is there any way I can see the detailed log of the task getting executed. for eg, when terraform runs, it displays the logs on console. is there any way i can see those logs? in the prefect console, i see a very basic log which doesn't tell me what is going on inside the task
    Shuchita Tripathi
    Kevin Kho
    4 replies
    Copy to Clipboard
  • wiretrack

    wiretrack

    5 months ago
    Hi guys, is there any way to have multiple "instances" of a flow? We have a single flow, but use it for N users, we wanted it to be 1 flow per user for monitoring purposes, but we can't seem to find a way to create a new flow from an existing storage, only changing a parameter. Any ideas?
    wiretrack
    Kevin Kho
    2 replies
    Copy to Clipboard
  • p

    Prasanth Kothuri

    5 months ago
    I have a strange error on a task, any one seen these before?
    Task 'copy_from_s3_to_sftp': Exception encountered during task execution!
    Traceback (most recent call last):
      File "/usr/local/lib/python3.9/dist-packages/prefect/engine/task_runner.py", line 876, in get_task_run_state
        value = prefect.utilities.executors.run_task_with_timeout(
      File "/usr/local/lib/python3.9/dist-packages/prefect/utilities/executors.py", line 454, in run_task_with_timeout
        return task.run(*args, **kwargs)  # type: ignore
      File "flows/k8s/my_flow_name.py", line 46, in copy_from_s3_to_sftp
    SystemError: unknown opcode
    p
    Kevin Kho
    16 replies
    Copy to Clipboard
  • a

    Adi Gandra

    5 months ago
    Hey I am trying to upgrade my prefect agent that I have running on EKS, I upgraded my prefect package locally it is now version 1.2. When I try to apply the changes
    prefect agent kubernetes install  -k {key} --mem-request 4G --mem-limit 6G --cpu-request 2 --rbac | kubectl apply -f -
    Nothing seems to happen I just get the message:
    deployment.apps/prefect-agent configured
    <http://role.rbac.authorization.k8s.io/prefect-agent-rbac|role.rbac.authorization.k8s.io/prefect-agent-rbac> unchanged
    <http://rolebinding.rbac.authorization.k8s.io/prefect-agent-rbac|rolebinding.rbac.authorization.k8s.io/prefect-agent-rbac> unchanged
    Any idea’s on how to successfully upgrade my prefect agent?
    a
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Chris Reuter

    Chris Reuter

    5 months ago
    Hot fresh dbt content from Prefectionist and all-around cool guy @James Sopkin for those of you looking to automate :dbt: exposures: https://prefect-community.slack.com/archives/CL09KTZPX/p1650385229289719
  • p

    Philip MacMenamin

    5 months ago
    Strange behaviour with multiple
    upstream_tasks
    on a ShellTask This works:
    brt_commands = create_brt_command.map(adoc_fp=updated_adocs)
            brt_commands_logged = log(item=brt_commands, desc="BRT commands")
            brts = shell_task.map(
                command=brt_commands, upstream_tasks=[tomogram_fps]
            )
    This fails:
    brt_commands = create_brt_command.map(adoc_fp=updated_adocs)
            brt_commands_logged = log(item=brt_commands, desc="BRT commands")
            brts = shell_task.map(
                command=brt_commands, upstream_tasks=[tomogram_fps, brt_commands_logged]
            )
    p
    Kyle McChesney
    +2
    15 replies
    Copy to Clipboard