Mikkel Duif
07/25/2022, 4:48 PMprefect orion database reset -y
?Mikkel Duif
07/25/2022, 4:48 PMDeployments
in Orion UI locally. If i inspect the network, I see it will successfully return my deployments, but they are never rendered in the UI.Jenia Varavva
07/25/2022, 5:16 PMKubernetes Agent
, KubernetesRun
and DaskExecutor
in the face of various components outages. E.g. what will Prefect be able to recover on its own, and which case would require a manual intervention, if during a flow execution one of the following dies: prefect server (I suppose itās ok as itās stateless), kubernetes agent, KubernetesRun
job executing a flow, dask scheduler, dask workers.Gunther Wallach
07/25/2022, 5:47 PMValueError: Flow could not be deserialized successfully. Error was: ValueError('A task with the slug "Parameter" already exists in this flow.')
This shows up after the step:
[2022-07-25 17:27:11-0700] INFO - prefect.Docker | Pushing image to the registry..
Parameters are currently in their own params.py file, and are referenced in the main flow file with:
import <main_directory>.tasks.params as params
Mikkel Duif
07/25/2022, 6:01 PMprefect deployment create
command? we use it to compare created deployments with existing deployments to clean out unused deployments.Tyler Wanner
07/25/2022, 6:07 PMDivya
07/25/2022, 6:11 PMprefect orion start.
It stops running quickly as below:
Please let me know how do I troubleshoot this. Is it because of the windows machine that I am using?alex
07/25/2022, 7:32 PMTom Klein
07/25/2022, 8:51 PMChu
07/25/2022, 9:08 PMMichael Reynolds
07/25/2022, 9:40 PM@flow
. I will attach a micro example of what i am trying to accomplish... would someone mind helping me understanding the error message:
FAILED my-prefect-project/tests/flows.py::test_pipeline - TypeError: __init__() missing 2 required positional arguments: 'host' and 'port'
li liang
07/26/2022, 6:38 AMVersion: 2.0b12
API version: 0.7.0
Python version: 3.9.1
Git commit: 18d44c8c
Built: Fri, Jul 22, 2022 4:23 PM
OS/Arch: win32/AMD64
Profile: default
Server type: <client error>
Mike Kovetsky
07/26/2022, 8:43 AMprefect storage create
in cli, but my 2.0b13 doesnāt have no such command returning the error Error: No such command āstorageā.
Should I create the storage using this doc ? There is no example for GCP, i found this one in the community. But there is no
from prefect.blocks.storage import GoogleCloudStorageBlock
import in my venv šharis khan
07/26/2022, 9:30 AMTyndyll
07/26/2022, 10:20 AMdata = returns_list()
with case(data, len(data) > 1):
do_stuff_with_data(data)
with case(data, len(data) == 0):
do_stuff_with_no_data()
Lucien Fregosi
07/26/2022, 12:00 PMBhupesh Kemar Singh
07/26/2022, 12:28 PMBhupesh Kemar Singh
07/26/2022, 12:33 PMDominik Wagner
07/26/2022, 1:28 PM@flow
def my_flow():
if <somehow_get_state_of_this_flow?> == "Retrying":
do_something()
Divya
07/26/2022, 1:41 PMLucien Fregosi
07/26/2022, 1:46 PMgcsfs
dependency (using GCS as a RemoteFileSystem
)
I guess this dependency should be added to the docker image or maybe itās possible to specify additional libs ?haris khan
07/26/2022, 1:54 PMJyothi
07/26/2022, 2:19 PMJyothi
07/26/2022, 2:21 PMdef escalate(obj, old_state, new_state):
if new_state.is_failed() and new_state.message not in IGNORE_MESSAGES:
msg = f"{obj} {new_state.message}"
slack_post(msg, channel="#errors", username="Prefect")
return new_state
and i would like to
def escalate(obj, old_state, new_state, error_channel="#errors"):
because i need have different channel for some flowsiƱigo
07/26/2022, 2:27 PMAndreas Nigg
07/26/2022, 2:43 PMMichael Reynolds
07/26/2022, 3:11 PMorion
for non-terminating long running workflows?Slackbot
07/26/2022, 3:15 PMChris Reuter
07/26/2022, 4:49 PMChu
07/26/2022, 5:16 PMcreate_flow_run(trigger = all_successful)