Marcus Hughes
07/16/2022, 4:19 AMRenameFlowRun
task. How do we do the same thing in Prefect 2.0? I don't see a similar task but maybe I just missed it. Thanks for the help!Anders Segerberg
07/18/2022, 4:46 PM1.1.0
. I cancelled a running flow through the UI; it was deep in the middle of running a series of mapped tasks. Turns out it continued to run for 6 days before ending with [11 July 2022 2:49pm]: No heartbeat detected from the flow run; marking the run as failed.
What is the expected behavior when "cancelling" a flow engaged in executing mapped tasks? (We are also on the dask-executor, with thread-based parallelism.)Lucien Fregosi
07/19/2022, 9:29 AM10.1.70.59
. When I exec the ui pod I can succesfully reach curl 10.1.70.59:4200/graphql
However within the Prefect UI I can’t connect to the URL. Any idea why ?kevin
07/19/2022, 2:24 PMcase
statement for True/False logic allow me to do something analogos to this python logic:
a = get_val_or_none()
if not a:
a = 'some new val'
do_something_with_a(a)
Alexander van Eck
07/19/2022, 3:38 PM@task
def task_1():
print('1')
@task
def task_2():
print('2')
@task
def task_3():
print('3')
And I wanted to give the user the ability to say in which order these should be executed, or who should consume which one.
i.e. I want to user to describe a graph of these callables and then for the flow to execute them.
How would I do this?Sandeep Dass
07/19/2022, 5:51 PMSam Pibworth
07/20/2022, 2:17 PMapollo_url = "http:/<ip of azure vm>:4200/graphql"
. Any help would be much apperciated!Abin Antony
07/20/2022, 6:52 PMJacob Longhurst
07/21/2022, 7:33 PMFailed to load and execute flow run: FlowStorageError('An error occurred while unpickling the flow:\n AttributeError("Can\'t get attribute \'_make_function\' on <module \'cloudpickle.cloudpickle\' from \'/usr/local/lib/python3.8/site-packages/cloudpickle/cloudpickle.py\'>")\nThis may be due to one of the following version mismatches between the flow build and execution environments:\n - cloudpickle: (flow built with \'2.1.0\', currently running with \'2.0.0\')')
Kelvin
07/25/2022, 11:28 AMKaranveer Mohan
07/26/2022, 9:04 PMprefect cloud login -k KEY -w WORKSPACE
now asks for "Creating a profile for this Prefect Cloud login. Please specify a profile name:"
This breaks my deployment flow since I need it to be programmatic. I also tried running prefect profile create
before but that doesn't seem to help. I also can't give the name of an existing profile. Could someone help explain what I'm doing wrong? I tried searching in the docs but maybe I'm missing something
2/ I was able to just hit enter locally and got the following message "Logged in to Prefect Cloud using profile ''." However, if I try to do prefect cloud login
or prefect profile inspect
after this, it throws the following error. I had to fix this by manually deleting profiles.toml
. Code in threadJacob Longhurst
07/27/2022, 3:02 AMprefecthq/prefect:1.1.0-python3.8
.
If we use the DaskExecutor
with a custom class and kwargs, we get an error message saying we need to install kubectl. If we choose to use a LocalDaskExecutor
it works just fine. It seems it’s failing some where around attempting to talk between the dask scheduler and workers. We’ve created the roles and role bindings dask requires in order to function properly and we’re not sure if we need to pass in a dask scheduler spec and / or service spec to the dask KubeCluster object?
Hoping someone has been able to solve running a temporary, on demand distributed dask cluster in K8S with the KubernetesRun prefect run config