• p

    Preston Marshall

    2 years ago
    Is there some way to pass a
    Secret
    to the slack notifier or look it up by name? Looking at the code it seems to read from the context, but it's not clear if I can actually set secrets in the context other than via the config file
    p
    1 replies
    Copy to Clipboard
  • p

    Preston Marshall

    2 years ago
    Ah, I see there are Secrets and Secret tasks
  • p

    Preston Marshall

    2 years ago
    seems like the notifier uses the former, so this probably won't work
  • c

    Chris O'Brien

    2 years ago
    Has anyone come across issues with Scheduled Flows not releasing the memory? We have an ETL setup to run every day that will just consume additional memory on each run. Are there any easy gotchas that can cause this behaviour before I begin digging into this?
    c
    Chris White
    3 replies
    Copy to Clipboard
  • Thomas La Piana

    Thomas La Piana

    2 years ago
    hi all, I'm looking in to adopting prefect for DS workflows instead of trying to shoehorn them into airflow. does anyone have some experience with this? Has anyone found it slowing down workflows as opposed to something like kubeflow? Does prefect core have a web ui or only supports the dask ui?
    Thomas La Piana
    j
    +3
    25 replies
    Copy to Clipboard
  • m

    Mark Williams

    2 years ago
    Is there an example of how to setup a custom configuration file for Windows? It points to ~/Users/<username>. This is not a valid path for Windows users. I have tried setting the environment variables on load with no luck. I also set them in the windows environment variables and still no luck.
    m
    Chris White
    11 replies
    Copy to Clipboard
  • dhume

    dhume

    2 years ago
    Hello. I’m playing around with the slack notification and trying to locally set the secret but keep getting the error that
    ValueError: Local Secret "SLACK_WEBHOOK_URL" was not found.
    I tried the suggestions mentioned here https://github.com/PrefectHQ/prefect/blob/b4c08b15b386107e2c1afb7fed35dca15b683cdd/src/prefect/client/secrets.py but wasn’t getting anything to work locally. Threading what I currently have
    dhume
    j
    +1
    6 replies
    Copy to Clipboard
  • j

    John Ramirez

    2 years ago
    hey - is there a way to have a prefect task populate a global python
  • n

    Nate Atkins

    2 years ago
    While we are queuing up questions this morning, is there a way to direct which Dask resource a task needs? The obvious example is GPU or CPU. In my case, I have one task that needs a lot of memory and I don't want to set the memory limit on all the workers to that level. I'd just like to have one worker with a high memory limit and send that task to that worker. https://distributed.dask.org/en/latest/resources.html#worker-resources
    n
    j
    3 replies
    Copy to Clipboard
  • t

    trapped

    2 years ago
    seems like formatting on the docs page on Constant tasks got borked https://docs.prefect.io/api/latest/tasks/constants.html
    t
    j
    2 replies
    Copy to Clipboard