• Stephen Herron

    Stephen Herron

    5 months ago
    Hi - we’re experiencing a read_timeout issue with the
    invokeLambda
    task. I think we need to pass it some extra config through boto_kwargs. Has anyone came across needing to do this before?
    Stephen Herron
    Anna Geller
    4 replies
    Copy to Clipboard
  • Tom Klein

    Tom Klein

    5 months ago
    Hello, what’s the best idiom for marking a task of executing some k8s job via
    RunNamespacedJob
    as a failure (within the job itself) ? or is it impossible because the command is async?
    Tom Klein
    Anna Geller
    4 replies
    Copy to Clipboard
  • Matthew Seligson

    Matthew Seligson

    5 months ago
    What’s the best way (in Prefect 1.0) to schedule a flow to run at 8am US/Eastern on the second weekday of the month? It seems that CronClocks will handle DST well but can’t handle weekday of the month. And RRule clocks can handle this well but it’s not obvious to me how good their DST handling is. Would appreciate any advice on this!
    Matthew Seligson
    Kevin Kho
    6 replies
    Copy to Clipboard
  • Tom Klein

    Tom Klein

    5 months ago
    Hello again 😄 regarding the
    RunNamespacedJob
    example (from https://github.com/anna-geller/packaging-prefect-flows/blob/master/flows_task_library/s3_kubernetes_run_RunNamespacedJob_and_get_logs.py ) --- we implemented it and got it to work, but it seems that it’s now failing on :
    VALIDATIONFAIL signal raised: VALIDATIONFAIL('More than one dummy pod')
    because there seems to be many pod “resiudes” of previous runs:
    ['prefect-agent-7745fb9694-6fwk4', 'prefect-job-47d072a8-4pbsf', 'seg-pred-test-cm54l', 'seg-pred-test-doron', 'seg-pred-test-l2j5l', 'seg-pred-test-zvwld']
    so wouldn’t k8s keep the pods around given that we gave a “delete_job_after_completion” = False ? and even if the job is deleted successfully, wouldn’t it keep the pods around? or are the pods supposed to be deleted automatically if the job is deleted…?
    Tom Klein
    Kevin Kho
    +2
    33 replies
    Copy to Clipboard
  • David Yang

    David Yang

    5 months ago
    I have a master flow that executes other flows. It runs well so far using git storage. but it failed with this error message: "No heartbeat detected from the remote task; marking the run as failed" tired to first sub flow called in the master flow. Only one line code changed in the master flow. Any suggestions?
    David Yang
    Kevin Kho
    +1
    31 replies
    Copy to Clipboard
  • Chris Reuter

    Chris Reuter

    5 months ago
    @Laura Lorenz's livestream starts in 30 minutes! She'll cover an end-to-end 😛refect2: Prefect 2.0 and :cloud2: Prefect Cloud 2.0 experience. You can sign up to watch here.
  • Kevin Mullins

    Kevin Mullins

    5 months ago
    I’m starting to use
    AzureResult
    to store task results for my flows. I’ve already got separate storage accounts per environment (dev, qa, prod). I’m curious if it would be recommended to use separate containers for different Prefect projects and/or flows or if it is ok to just store all the results in the same blob container for the environment. My hesitation for further separation is it appears that the AzureResult requires the container to already exist, so I would need to orchestrate something creating containers for each Prefect project. Not a big deal but just trying to get a feel for good practices. Any thoughts appreciated.
    Kevin Mullins
    Kevin Kho
    8 replies
    Copy to Clipboard
  • m

    Matt Alhonte

    5 months ago
    How do I delete a bunch of Submitted runs at once? Deleting the Flow didn't seem to do it.
    m
    Anna Geller
    17 replies
    Copy to Clipboard
  • Chris Reuter

    Chris Reuter

    5 months ago
    Starting in 15 minutes: our 2nd in a 🔥 day of livestreams. @Ben Welsh is the guest on PrefectLive, showing how he uses Prefect and GCP together.
  • Zach Munro

    Zach Munro

    5 months ago
    What are the alternative ways to schedule prefect flows besides running them within kubernetes?
    Zach Munro
    Kevin Kho
    2 replies
    Copy to Clipboard