Pekka
10/02/2022, 3:56 PMpypy 3.9
since it has JIT. I'm trying to install prefect as the minimal dependency but there are some problems that will probably be outside of the 'supported things' -- prefect has orjson
as a dependency which is not pypy-supported. I wonder how big of a role that dependency plays in prefect and whether there's some way to hack a bit to make it use some other lib?Tony Popov
10/02/2022, 5:39 PMPREFECT_LOCAL_STORAGE_PATH
does in this context, I guess points to pod’s filesystem and persistent storage/bucket has to be mounted to a pathWilliam Wolfe-McGuire
10/02/2022, 7:26 PMis_serializable
to check if entire flows can be serialized but that doesnt allow you to narrow down which tasks are responsible for your serialization issues. what is the best way to debug in this situation?Tony Popov
10/03/2022, 1:16 AMclass Result:
pass
@task
async def my_task_1(arg: str) -> Result:
...
@task
async def my_task_2(arg: Result) -> None:
...
Question
Doc says I can do await my_task_1('arg')
in a flow, although mypy says my_task_1('arg')
is not awaitable
Is following a best practice?
task_result = await my_task.submit('arg')
result = await task_result.result()
await my_task_2.submit(result)
Jessica Smith
10/03/2022, 2:00 AMZac Hooper
10/03/2022, 2:41 AMKrzysztof Ciesielski
10/03/2022, 8:39 AMThomas Opsomer
10/03/2022, 8:40 AMMichal Luščon
10/03/2022, 8:41 AMJoshua Greenhalgh
10/03/2022, 8:42 AMException raised while calling state handlers: ClientError([{'path': ['secret_value'], 'message': 'Unable to complete operation. An internal API error occurred.', 'extensions': {'code': 'API_ERROR'}}])
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/prefect/client/secrets.py", line 140, in get
value = secrets[self.name]
KeyError: 'SLACK_WEBHOOK_URL'
Stefan
10/03/2022, 8:42 AMfrom prefect import task, flow
@task
def task1(arg1):
pass
@flow
def main_flow():
task1(arg1_wrong=1)
main_flow()
Logs on Prefect Cloud:Alberto Fernández Zazo
10/03/2022, 10:00 AMStéphanie Cérulli
10/03/2022, 10:05 AMKrzysztof Ciesielski
10/03/2022, 10:10 AMMalavika S Menon
10/03/2022, 10:31 AMprefect config set PREFECT_API_URL=<https://example.com/api>
. However when I try to run the server it defaults back to http://127.0.0.1:4200/apiHedgar
10/03/2022, 12:48 PMsecret-block = Secret.load(“api-key”)
I want to use this block in the body of my flow how can I go about this? Should I just pass secret-block
? Do I need to use the get method anywhere?Igor Kotua
10/03/2022, 1:48 PMStefan Rasmussen
10/03/2022, 2:43 PM@task
decorator after that task has been defined? Say I use a task from a collection that and want to use a custom cache_key_fn
.
It looks like i could do it by
from copy import copy
from some_collection import some_task
some_task_cache = copy(some_task)
some_task_cache.cache_key_fn = my_cache_fn
but that seems a bit hacky.
The actual problem is the other way around - I want to provide a collection for users, but they would want to modify the task decorator arguments.Hedgar
10/03/2022, 3:08 PMSean Malone
10/03/2022, 3:13 PMFailed to delete flow run
message in the UI. Is this a known issue? Or any thought as to why this occurs?Farooque Shaikh
10/03/2022, 3:27 PMGhassan Hallaq
10/03/2022, 4:53 PMJeff Quinn
10/03/2022, 5:13 PMChristian Juhl
10/03/2022, 6:54 PMDarin Douglass
10/03/2022, 7:05 PMNace Plesko
10/03/2022, 7:47 PMShellTasks
. Setting timeout like it says in the documentation doesn't have any effect, the task doesn't get terminated after 10 seconds in this case. Is that a bug in Prefect or is it an issue on my part and I'm somehow misconfiguring ShellTask
?
I really appreciate any help on this and thank you in advance!Florian Giroud
10/03/2022, 8:15 PMAustin Anderson
10/03/2022, 8:38 PMname: prefect-service
channels:
- defaults
dependencies:
- python=3.9.13
- pip=22.1.2
- pip:
- prefect==2.4.5
I am hitting an error after running prefect deployment apply log_flow-deployment.yaml
:
Exception ignored in: <function _ProactorBasePipeTransport.__del__ at 0x00000226A897BEE0>
... redacted for readability ...
RuntimeError: Event loop is closed
Any idea what is happening here? Please let me know if I can provide any additional info.Lukáš Polák
10/03/2022, 8:59 PMquery { api { core_version } }We ran into a problem with version 1.4.0 when prefect API reports version "1.3.0+13.g4142953a5". Is that intended?
Alfred Martinez
10/03/2022, 9:08 PMAlfred Martinez
10/03/2022, 9:08 PMAlfred Martinez
10/03/2022, 10:41 PM