Martim Lobao
04/25/2022, 2:58 PMFlow.register("foo", extra_env_variables={"ENV": "foo"})
Flow.register("bar", extra_env_variables={"ENV": "bar"})
Xavier Babu
04/25/2022, 3:44 PMMatthew Roeschke
04/25/2022, 4:46 PMNo heartbeat detected from the remote task; marking the run as failed.
Slackbot
04/25/2022, 6:48 PMAndrey Tatarinov
04/25/2022, 8:54 PMHafsa Junaid
04/26/2022, 2:24 AMHafsa Junaid
04/26/2022, 6:03 AMDave
04/26/2022, 7:30 AMprefect.engine.signals.LOOP
, where the task is suddenly is missing the context on retries.
e.g:
index = prefect.context.get('task_loop_result', {}).get('index', 0)
See more code in the thread đź§µFaheem Khan
04/26/2022, 7:48 AMRhys Mansal
04/26/2022, 9:22 AMparam_a = flow.add_task(Parameter("param_a", default=True))
with case(param_a, False):
task_a = some_task(arg)
task_b = some_task(task_a)
some_task
is being run multiple times with different arguments. When param_a
is false some of these should be skipped. If I do not use @task(skip_on_upstream_skip=False)
in the task decorator on some_task
then all downstream tasks from the first skipped task are skipped, whether they are inside a case or not. If I do, none of them are skipped regardless of what param_a
is set to.
Does anyone have any idea how to get only the tasks inside the with block to skip (and only when param_a
is true)?Florian Guily
04/26/2022, 10:20 AMxyzz
04/26/2022, 11:13 AMRegarding storage the Orion docs say "you can also configure a self-hosted key-value store for testing.".
But what kind of key-value store is compatible and how to set it up for testing purposes?
xyzz
04/26/2022, 11:17 AMxyzz
04/26/2022, 11:20 AMMalthe Karbo
04/26/2022, 12:41 PMNikhil Joseph
04/26/2022, 1:15 PMMarwan Sarieddine
04/26/2022, 1:28 PM{'_schema': 'Invalid data type: None'}
twice over the last week over our many flow runs.
It seems other folks have encountered this due to a version mismatch between the agent and their execution environment.
However that is not the case for us - additionally the same flow run will proceed to run successfully for future runs without any changes from our end.
See more details in the threadLeon Kozlowski
04/26/2022, 1:44 PMRescheduled by a Lazarus process. This is attempt 1.
What would be the best way to me to root cause this issue?Andrey Tatarinov
04/26/2022, 2:01 PMShuchita Tripathi
04/26/2022, 2:28 PMJason
04/26/2022, 2:29 PMreturn os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: 'hello-flow.py'
The S3 storage class is configured in a shared module between flows as such:
storage = S3(
bucket="EDITED-prod-platform-prefect",
key=f"{project}/flows/{flow_name}.py",
stored_as_script=True,
local_script_path=f"projects/Examples/flows/{flow_name}.py",
)
Bruno Murino
04/26/2022, 2:33 PMMilton
04/26/2022, 3:02 PMBruno Murino
04/26/2022, 4:09 PMLukáš Pravda
04/26/2022, 4:19 PM@task
def foo():
....
@task
def bar():
....
with Flow() as flow:
try:
foo()
except:
bar()
test.py
from file import flow
from unittest.mock import patch
@patch("file1.bar")
@patch("file.foo")
def test_flow(mock1, mock2):
mock.side_effect = Exception("throw an error")
flow.run()
assert mock2.assert_called_once()
but the mock is never called, have found this: <https://github.com/PrefectHQ/prefect/issues/1801>
, but could not really mount that solution to my exact problem. What am I missing? Thank youTom Manterfield
04/26/2022, 4:37 PMKubernetesFlowRunner
instance other than building the keys into the image itself. Has anyone else found a solution for this?Xavier Babu
04/26/2022, 4:44 PMKathryn Klarich
04/26/2022, 5:14 PMAttributeError: module 'lib' has no attribute 'X509_V_FLAG_CB_ISSUER_CHECK'
- it seems to be happening during this step RUN pip install pip --upgrade
- has anyone come across this before and know how to fix it? I was able to successfully register this flow a few days ago and haven’t changed much in the requirements since then.Bradley Hurley
04/26/2022, 5:21 PMJai P
04/26/2022, 5:39 PMcase
statement in prefect 2.0: is there a rough timeline for when that may be introduced? Also, are there any major differences that are planned between how they work in prefect 1.0, where i think you can only conditionally go between tasks (to, say, possibly supporting subflows)?Jai P
04/26/2022, 5:39 PMcase
statement in prefect 2.0: is there a rough timeline for when that may be introduced? Also, are there any major differences that are planned between how they work in prefect 1.0, where i think you can only conditionally go between tasks (to, say, possibly supporting subflows)?Anna Geller
04/26/2022, 5:41 PMKevin Kho
04/26/2022, 5:41 PMif
inside a flow now.
@flow
def myflow():
a = task_one()
if a.result() == ...
....
Jai P
04/26/2022, 5:44 PMcase
was coming, and i wasn't sure in what case i'd use that over just native if
Kevin Kho
04/26/2022, 5:47 PMcase
because if
is more flexible. The previous case
only tested for equality. Not greater than or less than so you needed an intermediate task to achieve that.Jai P
04/26/2022, 8:04 PMif
statements more, but im curious if that has the same implication that it did in prefect 1.0 (meaning tasks/subflows not run due to an if
are marked as Skipped
)Kevin Kho
04/26/2022, 8:20 PMJai P
04/26/2022, 9:49 PM.result()
, does that possibly introduce some weirdness in execution/dependencies?@flow
def my_flow():
a = task_one()
if a.result():
task_two()
else:
task_three()
i won't necessarily see that task_one
was `wait_for`d on task_two
or task_three
Kevin Kho
04/26/2022, 9:54 PMwait_for
in task_two
and task_three
but they will wait for a
by default.
.result()
is actually .wait().result()
implicitlyJai P
04/26/2022, 9:54 PMorion
wouldn't necessarily reflect the waitingwait_for
. if you don't care about that particular thing...then it is fine because it implicitly happens anywaysKevin Kho
04/26/2022, 9:56 PMJai P
04/26/2022, 10:03 PMKevin Kho
04/26/2022, 10:06 PM