Danny Vilela
12/17/2021, 9:51 PMtoday
template filled in a result location
or task target
string? I keep getting a `KeyError`:
from prefect.engine.results import LocalResult
# Create a new local result pointing to current working directory.
result = LocalResult(dir=".", location="{today}.txt")
assert result.location == "{today}.txt"
# This raises `KeyError: 'today'`.
result.write(value_="hello!")
I’m following this doc: https://docs.prefect.io/core/concepts/results.html#choose-a-serializer (under “Templating Result
locations”)Ovo Ojameruaye
12/17/2021, 10:44 PMDanny Vilela
12/17/2021, 10:58 PMlocation
or task target
? I know the Prefect context gives you a bunch of variables – notably including parameters
, which looks promising! – but what if we have some data (the strings "foo"
or "bar"
) computed by some task compute_foo_or_bar
and we’d like to reference that output in a subsequent task’s output target?Jelle Vegter
12/18/2021, 12:40 PMAlejandro Sanchez Losa
12/18/2021, 2:30 PMOvo Ojameruaye
12/19/2021, 1:31 AMConnectionRefusedError: [WinError 10061] No connection could be made because the target machine actively refused it
. I can't tell if this is related. I created a config.toml file
# base configuration directory
home_dir = "C:/Users/XXX/.prefect"
backend = "server"
[server]
host = "<http://XXXXXX>"
port = "4200"
host_port = "4200"
endpoint = "${server.host}:${server.port}"
I am certain the server is running on the host ip addressAnh Nguyen
12/19/2021, 12:47 PMYash
12/19/2021, 1:19 PMale
12/20/2021, 9:47 AMSamuel Hinton
12/20/2021, 1:14 PMtimeout
which we can pass in, but Im currently experience some odd issues where tasks seem to be lost in dask somewhere (they are submitted to dask but never come back, never time out), and this means my flows never end. Ideally Ill try to dig into our env and dask and prefect and figure out what is causing silent untracked failure, but as an interim solution, does anyone know of a way I can say “Cancel the flows and all tasks if its been an hour since you started?”Brian Phillips
12/20/2021, 1:52 PMjars
12/20/2021, 1:54 PMAnna Geller
Anna Geller
jars
12/20/2021, 2:29 PMDaniel Komisar
12/20/2021, 3:21 PMDekel R
12/20/2021, 3:25 PMraise InterruptedError(line.get("error"))
InterruptedError: name invalid: Request contains an invalid argument.
In order to register my flow I use the following command -
prefect register --project "Project_name" --path path_to_flow_file.py --name "brands-recognition"
Project_name is the project I have at Prefect cloud
path_to_flow_file is the path to the file which contains my flow
brands-recognition is the flow name.
This is my flow snippet (for debug purposes - just 2 tasks)-
schedule = IntervalSchedule(interval=timedelta(days=7))
with Flow("brands-recognition",
storage=Docker(registry_url="us-central1-docker.pkg.dev/xxx/",
dockerfile="./Dockerfile"), schedule=schedule) as flow: # , schedule=schedule
mode = Parameter('FULL_UPDATE', default=None)
task_a(mode)
flow.run_config = VertexRun(machine_type='e2-standard-8', labels=["ml"],
service_account='prefect-integration@xx')
# flow.run()
Now when running locally - the flow runs smoothly and generates a result.
It seems like the problem is only at the pushing phase (when I register the flow).
What am I missing?
Thanks.Constantino Schillebeeckx
12/20/2021, 3:35 PMRun History
keeps re-materializing as I scrollAlejandro Sanchez Losa
12/20/2021, 4:39 PMAlejandro Sanchez Losa
12/20/2021, 4:41 PMBilly McMonagle
12/20/2021, 4:51 PMVipul
12/20/2021, 5:00 PMKyle Heath
12/20/2021, 9:01 PMVince
12/20/2021, 9:35 PMBen Muller
12/20/2021, 11:00 PMHead <https://registry-1.docker.io/v2/prefecthq/prefect/manifests/0.15.5-python3.8>: received unexpected HTTP status: 503 Service Unavailable
Yusuf Khan
12/21/2021, 2:21 AMYehor Sikachov
12/21/2021, 11:41 AMLiri Rozenthal
12/21/2021, 2:56 PMJohn-Craig Borman
12/21/2021, 4:03 PMJason Motley
12/21/2021, 4:27 PM