Nora Myer
10/26/2022, 4:20 PMmicroft
10/26/2022, 4:31 PMBrian Osserman
10/26/2022, 4:39 PMJoshua Greenhalgh
10/26/2022, 4:46 PMAttributeError: 'Context' object has no attribute 'scheduled_start_time'
Paco Ibañez
10/26/2022, 4:48 PMTim Enders
10/26/2022, 6:02 PM13:00:10.647 | ERROR | Task run 'Get-Items-d8ed86f1-212' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.650 | ERROR | Task run 'Get-Items-d8ed86f1-15' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.652 | ERROR | Task run 'Get-Items-d8ed86f1-857' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.653 | ERROR | Task run 'Get-Items-d8ed86f1-774' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.654 | ERROR | Task run 'Get-Items-d8ed86f1-609' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.655 | ERROR | Task run 'Get-Items-d8ed86f1-444' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.657 | ERROR | Task run 'Get-Items-d8ed86f1-399' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.659 | ERROR | Task run 'Get-Items-d8ed86f1-700' - Crash detected! Execution was cancelled by the runtime environment.
13:00:10.660 | ERROR | Task run 'Get-Items-d8ed86f1-460' - Crash detected! Execution was cancelled by the runtime environment.
Michał Augoff
10/26/2022, 6:47 PMMary Clair Thompson
10/26/2022, 7:34 PMBradley Hurley
10/26/2022, 9:53 PMAdam
10/26/2022, 9:55 PMiñigo
10/26/2022, 10:39 PMEnda Peng
10/26/2022, 10:58 PMAdam
10/26/2022, 11:36 PMThomas Pedersen
10/27/2022, 9:54 AMagent start --match
).
All I need to tell each agent is "Don't start more than N docker containers at the same time" (or you will run out of disk or memory)... E.g. the limit is really on the agent resources. In the full cloud I don't care how many things run simultaneously - the more the merrier :DAndrei Tulbure
10/27/2022, 10:30 AMwith Flow(...)
block. If you're trying to run this task outside of a Flow context, you need to call `GetItem(...).run(...)`` . All in all error was because of missing params from function call. Could you make the error a little bit more helpful ? Or specific ? ...... Or am I missing something ?Nic
10/27/2022, 10:50 AMAdam
10/27/2022, 11:08 AMenvFrom
section to a KubernetesJob
block. We want to include this using the Python API:
envFrom:
- secretRef:
name: job-secrets
Jons Cyriac
10/27/2022, 11:33 AMChristian Vogel
10/27/2022, 12:50 PMMichael Urrutia
10/27/2022, 12:51 PMSuresh R
10/27/2022, 1:16 PMDavid Elliott
10/27/2022, 1:22 PMallow_failure()
wrapper for the KubernetesJob
infra - it seems to have no effect when running with SequentialTaskRunner
or ConcurrentTaskRunner
. When I run the same flow locally it works as expected (downstream tasks are ran), but when it’s ran on k8s (with KubernetesJob
infrastructure) it ignores the wrapper and the downstream tasks just go to NotReady
as if the allow_failure()
wrapper weren’t used at all. MRE in 🧵Q
10/27/2022, 1:40 PMPREFECT_API_URL
is not set (PREFECT_ORION_UI_API_URL
is).
printenv | grep -E "PREFECT.*API"
# PREFECT_ORION_UI_API_URL=<https://domain.tld/api>
FlowRunNotifications use PREFECT_API_URL
as base api url and since PREFECT_API_URL
is not set api_url
defaults to a rather useless <http://ephemeral-orion/api>
.
I'm wondering if it would make sense to change this line to use PREFECT_ORION_UI_API_URL
if PREFECT_API_URL
is not set.
I see that PREFECT_ORION_UI_API_URL
defaults to PREFECT_API_URL
, but I think if I set PREFECT_API_URL
to a seemingly external url api calls from ui will stop being routed through loopback and that would be a whole thing.Adam
10/27/2022, 1:49 PMcreate_deployment.py
utility that my CI/CD uses that will create and apply deployments when flows change. Instead of complicated bash, it’s easier to do it in Python. However, I’m unclear how I can get the flow
object from a filepath in this case:
deployment = Deployment.build_from_flow(
flow=my_flow, # how do i get from a filepath to the flow
name="s3-example"
)
In Prefect v1, there was a useful utility called from prefect.utilities.storage import extract_flow_from_file
— my question is does such a utility exist in v2? Or alternatively, is there a better way of doing this?Paco Ibañez
10/27/2022, 1:50 PMJai P
10/27/2022, 2:00 PMDockerContainer
. I'm wondering, does that same logic apply to a KubernetesJob
(since we also have to provide an image for that infra block)?Sean Davis
10/27/2022, 2:15 PMDaniel
10/27/2022, 2:39 PMrun_deployment
. When running the script, I get JSONDecodeError: Expecting value: line 1 column 1 (char 0)
that comes from run_deployment
and is thrown at prefect/client/orion.py", line 1329, in read_deployment_by_name: return schemas.core.Deployment.parse_obj(response.json())
. I edited orion.py
to add print(response.json())
at line 1329 and then that line threw the error, but the json response still prints and it looks like a valid json response object. I'm using prefect 2.6.4. I would appreciate any help in getting the deployment working, thanks!Viet Nguyen
10/27/2022, 2:50 PMTim-Oliver
10/27/2022, 2:59 PM