• Didier Marin

    Didier Marin

    1 year ago
    Hey everyone, We are trying to add some fine grained authorization to our Prefect server (such as which user can perform which action and which flow). I understand the Cloud version as roles and custom roles but I don't think this would be detailed enough for our needs (for example the read permission on flows can be granted, but I don't think it can be limited to a particular flow group id for example). It seems like the easiest way to tackle this is at the GraphQL level, using resolvers to customize exactly what request can be performed by who. By any chance, does anyone has some experience doing this ?
    Didier Marin
    Kevin Kho
    4 replies
    Copy to Clipboard
  • Mark McDonald

    Mark McDonald

    1 year ago
    Hi - we have a system in place wherein we collect all state change events via webhook triggered by automations. We're collecting this data to identify and alert us if a flow run's duration is anomalous. It would be really helpful if we had the flow's parameters in the webhook payload, because these are the best indicator of how long a flow should run. It's not currently part of the default payload. Should I open an issue in the github repo?
    Mark McDonald
    Michael Adkins
    5 replies
    Copy to Clipboard
  • Mark McDonald

    Mark McDonald

    1 year ago
    Hi again - we're having trouble logging into Prefect Cloud. We've been seeing this screen for a while. I've confirmed the issue with multiple people at my company.
    Mark McDonald
    nicholas
    4 replies
    Copy to Clipboard
  • Tony Yun

    Tony Yun

    1 year ago
    hi, I’m having some trouble setting up the Docker container correctly for Flow to register. Could someone take a look? The Dockerfile setup correctly and working on local testing (with flow.run()); • I’m using Docker Storage like this, which the dockerfile is working correctly to call my modules:
    storage = Docker(
        dockerfile="./Dockerfile"
    )
    But the register always report the module not exists.
    ModuleNotFoundError: No module named 'criteo'
    Tony Yun
    Kevin Kho
    58 replies
    Copy to Clipboard
  • Wilson Bilkovich

    Wilson Bilkovich

    1 year ago
    I'm struggling to get local+docker 'as script' flows to work, and I can't find a working value for 'script path'
    Wilson Bilkovich
    Kevin Kho
    49 replies
    Copy to Clipboard
  • Wilson Bilkovich

    Wilson Bilkovich

    1 year ago
    Can anyone explain the correspondence of KubernetesRun and pods that get spun up. Is KubeRun what the Agent runs to create a scheduler pod? Does it have anything to do with the worker environment?
    Wilson Bilkovich
    1 replies
    Copy to Clipboard
  • h

    Hamza Ahmed

    1 year ago
    Running into issues after upgrading Prefect (flows+kubernetes deployment) from 0.14.6 to 0.15.4 and I am running into an issue where a flow gets scheduled but errors out after a couple hours with an error
    A Lazarus process attempted to reschedule this run 3 times without success. Marking as failed.
    The only other errors are in the prefect towel logs [see comments] Any clue as to what could be wrong?
    h
    Kevin Kho
    +1
    32 replies
    Copy to Clipboard
  • Aric Huang

    Aric Huang

    1 year ago
    Hi, I'm trying to run some flows that use
    ProcessPoolExecutor
    and am having trouble getting print statements and stack traces from subprocesses to show up in the Prefect Cloud UI. When running the flow locally the logs show up in stdout/stderr, and having the task defined with
    @task(log_stdout)
    makes print statements in subprocesses show up with a
    └── <time> | INFO
    prefix (which I thought means it's getting picked up by the Prefect logger). However the subprocess print statements don't show up at all in the Prefect Cloud UI logs. Stack traces from subprocesses that crash also print locally but don't show up in the UI, which only shows a stack trace for the main process with
    concurrent.futures.process.BrokenProcessPool
    . Is there a way to have a flow capture all subprocess output so it's visible in the UI?
    Aric Huang
    Kevin Kho
    +1
    21 replies
    Copy to Clipboard
  • Jason Kim

    Jason Kim

    1 year ago
    Is it possible to have a local agent have multiple conda environments? Should I use 'prefect agent local start' for each of my conda envs and then add a label for each agent?
    Jason Kim
    Kevin Kho
    4 replies
    Copy to Clipboard
  • CA Lee

    CA Lee

    1 year ago
    Hello, has anyone run into the below errors while using DbtShellTask?
    CA Lee
    Kevin Kho
    7 replies
    Copy to Clipboard