• t

    Talha

    1 year ago
    Hi I am trying to connect to the prefect server on localhost:8080. But i am working in a firm where we use HTTP and HTTPS proxies. The prefect server doesnot connect if i don't bipass the proxy. And when I bypass the proxy the flow does not run, as one of the task is api data fetching which needs Proxies. What is the way around it? You can see in picture I am trying to set the Http and https env in the run config as well. If i don't put the os.environ to empty. Then I get the following error: "error 503: cannot connect to localhost:4200" which is my apollo docker port.
    t
    nicholas
    +1
    17 replies
    Copy to Clipboard
  • j

    jaehoon

    1 year ago
    Hi Prefect family! i want see DEBUG logs in UI I tried
    prefect.config.logging.level='DEBUG'
    prefect.config.debug=True
    and
    os.environ["PREFECT__LOGGING__LEVEL"]='DEBUG'
    However, it doesn't work How can i set DEBUG log level?
    j
    Chris White
    5 replies
    Copy to Clipboard
  • m

    Martin

    1 year ago
    Hi, I am new to Prefect for task orchestration. And have couple questions here:1. Understand that we have Prefect Cloud which is a managed service. But could we deploy prefect server as cluster? 2. Is it possible to setup a dependency between "flows" instead of "tasks"?
    m
    Fabrice Toussaint
    +3
    7 replies
    Copy to Clipboard
  • Diego Alonso Roque Montoya

    Diego Alonso Roque Montoya

    1 year ago
    Is there a way to send a SUCCESS signal but continue the process running? For context i have a setup heavy process that ideally has a cleanup but as soon as the data is done, I want to continue processing. However, I don’t want to finish the task and move to another process for cleanup because that’s fairly expensive
    Diego Alonso Roque Montoya
    1 replies
    Copy to Clipboard
  • Amanda Wee

    Amanda Wee

    1 year ago
    My team is running Prefect Server on ECS (apollo, hasura, graphql, and towel as separate containers in a single ECS task; postgres as an aurora cluster; Prefect UI as another ECS task), with a single local Prefect agent also on ECS. From time to time we encounter HTTP 502 errors and/or read timeout errors, and also a flow where we had a large task for which we would get heartbeat timeouts, but after breaking it up, Prefect UI would then report that at one of the broken up tasks, the flow runs "forever". The errors seem pretty inconsistent though, but started to occur a bit more frequency recently. Prefect Server itself has remained up, so I originally thought that there was something finicky about the internal load balancer, yet it does work. Would anyone have any ideas what might be going wrong?
    Amanda Wee
    Kevin Kho
    +1
    7 replies
    Copy to Clipboard
  • m

    Mariusz Olszewski

    1 year ago
    Hi, I implement slack notifications about errors from prefect. how to customize the content of the message here? feg. Include direct link to flow or task which fail?
    m
    1 replies
    Copy to Clipboard
  • j

    Joey Kellison-Linn

    1 year ago
    I'm having trouble running the prefect server on an AWS ubuntu instance, with docker and docker compose installed, big error stack: • PermissionError: [Errno 13] Permission denied • urllib3.exceptions.ProtocolError: ('Connection aborted.', PermissionError(13, 'Permission denied')) • requests.exceptions.ConnectionError: ('Connection aborted.', PermissionError(13, 'Permission denied')) • docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', PermissionError(13, 'Permission denied')) • subprocess.CalledProcessError: Command '['docker-compose', 'pull']' returned non-zero exit status 1. • subprocess.CalledProcessError: Command '['docker-compose', 'down']' returned non-zero exit status 1. docker --version: Docker version 20.10.6, build 370c289 docker-compose --version: docker-compose version 1.29.2, build unknown EDIT: Found the solution: https://stackoverflow.com/questions/61698133/docker-py-permissionerror13
    j
    1 replies
    Copy to Clipboard
  • Carlo

    Carlo

    1 year ago
    Hi I'm on prefect 0.13.15, Trying to migrate to
    EcsAgent
    from
    FargateAgent
    I'm specifying the
    task_definition_path
    as an
    <s3://url>
    . It's returning a 404 error. Using the same credentials, I'm able to write my own boto3 code to access the file successfully. Any ideas?
    Carlo
    Kevin Kho
    19 replies
    Copy to Clipboard
  • Ian Harvey

    Ian Harvey

    1 year ago
    Hi, a question about databases. We have a prefect server install in kube using helm. If I'm storing data from my Flows, is it expected that I would stand up a fresh database, or is it ok to use the database that prefect is using itself? This question is more about "best practices" than if it is literally possible.
    Ian Harvey
    Kevin Kho
    2 replies
    Copy to Clipboard
  • l

    Lionel

    1 year ago
    Hi, how do we add ENV variables when installing with Helm ? Specifically to add
    GITHUB_ACCESS_TOKEN
    to use GitHub as the script storage backend.
    l
    Zach Schumacher
    6 replies
    Copy to Clipboard