• emre

    emre

    1 year ago
    Hey everyone! I'm trying to have a task that utilizes the
    slack_notifier
    . I want some custom text in this this task to show up nicely formatted in slack. So far, I tried to return my custom text, and
    raise SUCCESS(message='my_text')
    . Both aren't what I hoped for. Any ideas?
    emre
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Lauri Makinen

    Lauri Makinen

    1 year ago
    Hi, I am using GitHub storage for my flow. In my flow, I want to load a data file (a json file located in the same GH repo as the flow file) and use it in my flow code. I can't figure out how to do this. Could someone please help me with this? Thanks!
    Lauri Makinen
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Estelle Yao

    Estelle Yao

    1 year ago
    Hi, I am trying to do task level parallelism by mapping. I was wondering how to set it up so each task is independent say that one of task’s failure would not affect other tasks being paralleled. Thanks in advance!
    Estelle Yao
    k
    +1
    7 replies
    Copy to Clipboard
  • Matthias Roels

    Matthias Roels

    1 year ago
    Maybe a small question, but I cannot find the answer in the docs. Is it possible to use Prefect to process minibatches in which a flow is scheduled to run at, let's say, every 5 mins but can only run in case the previous run is completed (can be successful or failed)? Thanks in advance for the info!
    Matthias Roels
    Zach Schumacher
    +1
    6 replies
    Copy to Clipboard
  • j

    Josh Rosenstein

    1 year ago
    Hey all, wanted to post here before creating an issue on github. But currently having an issue getting my ci/cd registration job working when trying to update
    for flow in ${flows[@]}; do prefect register flow --file flows/$flow --project my_project --skip-if-flow-metadata-unchanged; done
    (which currently works) to
    prefect register --path flows/ --project my_project
    where my flows are utilizing azure storage and are located within flows folder. Using the new register command does create a new blob, but then errors out
    Error building storage: azure.core.exceptions.ResourceExistsError: Operation returned an invalid status 'The specified blob already exists.'
    for each flow ultimately exiting out the job. For now I will just continue to use prefect register flow, but wanted to see if anyone was having similar issues.
    j
    Michael Adkins
    +1
    27 replies
    Copy to Clipboard
  • Yueh Han Huang

    Yueh Han Huang

    1 year ago
    Hi! Just discovered that Prefect.io/slack link is on longer active, so new friends will not be able to join this workspace. Is this something that can be fixed soon?
    Yueh Han Huang
    1 replies
    Copy to Clipboard
  • Bruno Murino

    Bruno Murino

    1 year ago
    Hey everyone — I’m trying to use a shellTask and it is working but I’m getting duplicated logs, with slightly different formatting but identical content. I can’t seem to find a way to disable/hide the duplicated logs. Here’s an example of duplication:
    [2021-06-22 13:25:46+0100] INFO - prefect.ShellTask | 13:25:46 | Concurrency: 12 threads (target='dev')
    INFO:prefect.ShellTask:13:25:46 | Concurrency: 12 threads (target='dev')
    Bruno Murino
    Kevin Kho
    36 replies
    Copy to Clipboard
  • Bruno Murino

    Bruno Murino

    1 year ago
    and I have
    stream_output=True
    on the shelltask
  • h

    Hugo Kitano

    1 year ago
    Hi, I’m trying to get on a secret on my cloud account, and having trouble with that I can successfully set a secret using
    from prefect import Client
    
    client = Client()
    client.set_secret(name="MYSECRET", value="MY SECRET VALUE")
    I can see ‘MYSECRET’ on my cloud UI, so I’m sure I’m authorized etc. But I am unable to get a secret with:
    from prefect.client import Secret
    
    # Load the value of `MYSECRET`
    my_secret_value = Secret("MYSECRET").get()
    Where I get a
    *** ValueError: Local Secret "MYSECRET" was not found.
    error. Reading the docs, I see that it should be looking for a local secret first, and if not found, will look for a cloud secret. I think it is not looking for a cloud secret
    h
    Kevin Kho
    2 replies
    Copy to Clipboard
  • c

    Charles Liu

    1 year ago
    Does anyone know if I just run
    prefect agent kubernetes start --job-template
    again to amend my existing agent? I'm trying to edit the safe-to-evict setting.
    c
    Kevin Kho
    3 replies
    Copy to Clipboard