Hello there, I've noticed lately the prefect cloud UI refuses to load completely, here is what I see on my network tab today (yesterday the screen was completely blank but similar network activity). Also back when it used to work, if left alone in a tab for a few mins it would crash and I had to reload - I have reported this months ago as well
1 year ago
Hey, is it possible to have extra_loggers on a diffrent log_level than PREFECT__LOGGING__LEVEL? I´d like to have my custom logger on info level, and CloudTaskRunner and CloudFlowRunner logger on warning
1 year ago
Hi there ! I'd like to use
behind a proxy. A search in the docs and in the slack community give nothing so before submitting a new issue I wanted to check if I was not missing something ! 🙂 Thanks
1 year ago
hey folks, high level question here. I'm building a system that will hit an SQS queue for a pub/sub thing capturing point in time updates to a dataset. The flow from the queue is not terribly big, but will have a few million or more dispatches during normal working hours. I'll want to hit the queue, parse the message (the payloads are complete messages with no external info necessary, and all strings/bytes), do minor transforms, and then send an update query to a relational DB with a soft real-time limit of around one second. Is there any resources as to the utility of prefect in this kind of use case?I'm interested in using a data pipeline (vs. a boutique app) in this context because there's a lot more pipelines I need to build, and would rather circle them all up in one spot. What say ye, people of #prefect-community?
When registering a flow that uses prefect.config references I’ve noticed that if the prefect.config is not present the registration throws a Box Error execution.
File"/usr/local/lib/python3.9/site-packages/prefect/utilities/storage.py", line 86, in extract_flow_from_file
File"<string>", line 10, in <module>
File"/usr/local/lib/python3.9/site-packages/box/box.py", line 501, in __getattr__
raise BoxKeyError(str(err)) from _exception_cause(err)
box.exceptions.BoxKeyError: "'Config' object has no attribute 'direct'"
I’ve further noticed that if references to config are embedded in tasks that it works. Only when referencing config from a Flow context does this error occur. Is there a workaround for this? It seems strange that I have to install all my environment variables to register a flow when its the Agent that is pushing the envvars into the run-time configuration.