• Kostas Chalikias

    Kostas Chalikias

    1 year ago
    Hello there, I've noticed lately the prefect cloud UI refuses to load completely, here is what I see on my network tab today (yesterday the screen was completely blank but similar network activity). Also back when it used to work, if left alone in a tab for a few mins it would crash and I had to reload - I have reported this months ago as well
    Kostas Chalikias
    Michael Adkins
    +3
    20 replies
    Copy to Clipboard
  • s

    Sebastian

    1 year ago
    Hey, is it possible to have extra_loggers on a diffrent log_level than PREFECT__LOGGING__LEVEL? I´d like to have my custom logger on info level, and CloudTaskRunner and CloudFlowRunner logger on warning
    s
    Kevin Kho
    6 replies
    Copy to Clipboard
  • v

    Vincent Chéry

    1 year ago
    Hi there ! I'd like to use
    prefect.utilities.notifications.slack_notifier
    behind a proxy. A search in the docs and in the slack community give nothing so before submitting a new issue I wanted to check if I was not missing something ! 🙂 Thanks
    v
    Kostas Chalikias
    +1
    8 replies
    Copy to Clipboard
  • William MacMillan

    William MacMillan

    1 year ago
    hey folks, high level question here. I'm building a system that will hit an SQS queue for a pub/sub thing capturing point in time updates to a dataset. The flow from the queue is not terribly big, but will have a few million or more dispatches during normal working hours. I'll want to hit the queue, parse the message (the payloads are complete messages with no external info necessary, and all strings/bytes), do minor transforms, and then send an update query to a relational DB with a soft real-time limit of around one second. Is there any resources as to the utility of prefect in this kind of use case? I'm interested in using a data pipeline (vs. a boutique app) in this context because there's a lot more pipelines I need to build, and would rather circle them all up in one spot. What say ye, people of #prefect-community?
    William MacMillan
    Kevin Kho
    3 replies
    Copy to Clipboard
  • james.lamb

    james.lamb

    1 year ago
    What is the meaning of a ⚠️ on the Prefect Cloud status page at https://prefect.status.io/? (details in thread)
    james.lamb
    4 replies
    Copy to Clipboard
  • Kevin Kho

    Kevin Kho

    1 year ago
    Hey everyone, just wanted to remind you guys what we’ll be having a livestream at 4 pm ET (2.5 hours from now) about orchestrating data science workflows on Prefect.

    Link

  • Kevin Kho

    Kevin Kho

    1 year ago

    Laura is going live soon!

    Join our Meetup event.
    Kevin Kho
    Richard Cox
    +3
    5 replies
    Copy to Clipboard
  • e

    Enda Peng

    1 year ago
    Is there a way to pin a project to specific agent only? E.g I have a group of downloading flows in project A, I wish all flows in project A only run on agent B where the cert/credentials are available
    e
    1 replies
    Copy to Clipboard
  • e

    Enda Peng

    1 year ago
    Is there a way to erase the by default host name label? I call the code below, however, my flow ends up with 2 label. I see an option in command line tool for agent labeling
    --no-hostname-label
    flow.register(project_name="tester", labels=["foo"])
    e
    1 replies
    Copy to Clipboard
  • r

    Robert Bastian

    1 year ago
    When registering a flow that uses prefect.config references I’ve noticed that if the prefect.config is not present the registration throws a Box Error execution.
    File "/usr/local/lib/python3.9/site-packages/prefect/utilities/storage.py", line 86, in extract_flow_from_file
        exec(contents, exec_vals)
      File "<string>", line 10, in <module>
      File "/usr/local/lib/python3.9/site-packages/box/box.py", line 501, in __getattr__
        raise BoxKeyError(str(err)) from _exception_cause(err)
    box.exceptions.BoxKeyError: "'Config' object has no attribute 'direct'"
    I’ve further noticed that if references to config are embedded in tasks that it works. Only when referencing config from a Flow context does this error occur. Is there a workaround for this? It seems strange that I have to install all my environment variables to register a flow when its the Agent that is pushing the envvars into the run-time configuration.
    r
    Kevin Kho
    2 replies
    Copy to Clipboard