Marcus Hughes07/16/2022, 4:19 AM
task. How do we do the same thing in Prefect 2.0? I don't see a similar task but maybe I just missed it. Thanks for the help!
Anders Segerberg07/18/2022, 4:46 PM
. I cancelled a running flow through the UI; it was deep in the middle of running a series of mapped tasks. Turns out it continued to run for 6 days before ending with
What is the expected behavior when "cancelling" a flow engaged in executing mapped tasks? (We are also on the dask-executor, with thread-based parallelism.)
[11 July 2022 2:49pm]: No heartbeat detected from the flow run; marking the run as failed.
Lucien Fregosi07/19/2022, 9:29 AM
. When I exec the ui pod I can succesfully reach
However within the Prefect UI I can’t connect to the URL. Any idea why ?
kevin07/19/2022, 2:24 PM
statement for True/False logic allow me to do something analogos to this python logic:
a = get_val_or_none() if not a: a = 'some new val' do_something_with_a(a)
Alexander van Eck07/19/2022, 3:38 PM
And I wanted to give the user the ability to say in which order these should be executed, or who should consume which one. i.e. I want to user to describe a graph of these callables and then for the flow to execute them. How would I do this?
@task def task_1(): print('1') @task def task_2(): print('2') @task def task_3(): print('3')
Sandeep Dass07/19/2022, 5:51 PM
Sam Pibworth07/20/2022, 2:17 PM
. Any help would be much apperciated!
apollo_url = "http:/<ip of azure vm>:4200/graphql"
Abin Antony07/20/2022, 6:52 PM
Jacob Longhurst07/21/2022, 7:33 PM
Failed to load and execute flow run: FlowStorageError('An error occurred while unpickling the flow:\n AttributeError("Can\'t get attribute \'_make_function\' on <module \'cloudpickle.cloudpickle\' from \'/usr/local/lib/python3.8/site-packages/cloudpickle/cloudpickle.py\'>")\nThis may be due to one of the following version mismatches between the flow build and execution environments:\n - cloudpickle: (flow built with \'2.1.0\', currently running with \'2.0.0\')')
Kelvin07/25/2022, 11:28 AM
Karanveer Mohan07/26/2022, 9:04 PM
now asks for
prefect cloud login -k KEY -w WORKSPACE
This breaks my deployment flow since I need it to be programmatic. I also tried running
"Creating a profile for this Prefect Cloud login. Please specify a profile name:"
before but that doesn't seem to help. I also can't give the name of an existing profile. Could someone help explain what I'm doing wrong? I tried searching in the docs but maybe I'm missing something 2/ I was able to just hit enter locally and got the following message "Logged in to Prefect Cloud using profile ''." However, if I try to do
prefect profile create
prefect cloud login
after this, it throws the following error. I had to fix this by manually deleting
prefect profile inspect
. Code in thread
Jacob Longhurst07/27/2022, 3:02 AM
. If we use the
with a custom class and kwargs, we get an error message saying we need to install kubectl. If we choose to use a
it works just fine. It seems it’s failing some where around attempting to talk between the dask scheduler and workers. We’ve created the roles and role bindings dask requires in order to function properly and we’re not sure if we need to pass in a dask scheduler spec and / or service spec to the dask KubeCluster object? Hoping someone has been able to solve running a temporary, on demand distributed dask cluster in K8S with the KubernetesRun prefect run config