Benoit Chabord
07/23/2022, 4:46 AM# type: ignore
on every task call because the task returns the type of the wrapped function so I cannot do .wait() on it without raising an issue with mypy. Not sure how we can do better thoughAndreas Nigg
07/23/2022, 6:46 AMFound 1 invalid deployments:
1 validation error for deployment with name 'sync_goodread_score_to_volat_bigquery'
infrastructure
Can't instantiate abstract class Infrastructure with abstract methods preview, run (type=type_error)
Please find my deployment in the threadOliver Mannion
07/23/2022, 7:56 AM.submit()
, eg:
@flow
def greetings(names: List[str]) -> None:
for name in names:
say_hello.submit(name)
say_goodbye.submit(name)
but the flow still works without using .submit()
. What are the implications of not using .submit()
?yu zeng
07/23/2022, 10:16 AMPrasanth Kothuri
07/23/2022, 2:22 PMNoam Cohen
07/23/2022, 7:06 PM(finance-lGLYToYy-py3.9) ➜ finance git:(master) ✗ prefect storage create
No storage types are available.
(finance-lGLYToYy-py3.9) ➜ finance git:(master) ✗ prefect version
Version: 2.0b10
API version: 0.7.0
Python version: 3.9.10
Git commit: e71ef86c
Any idea what changed?Sander
07/23/2022, 8:38 PMChu
07/23/2022, 8:38 PMflow.run_config = KubernetesRun()
)
2. Where can I attach LocalDaskExecutor? Only to the parent flow? (Maybe for flow A, B, I just set their parameters using unmapped()
function?)
3. Is there a way for me to test my project locally (to make sure the design works as wished) without registering every flow to the Cloud?
4. (Optional) for my use case, is there a better design to achieve my goals? Since I’m quite new to Prefect, but really astonished by its cool functionality, maybe there is some place I can make great improvements for our company
Thanks! It’s a long question, but really appreciate for any help!Vipul
07/23/2022, 8:40 PMTom Klein
07/24/2022, 4:39 PMChu
07/24/2022, 7:39 PMA -> B
, both A and B will take a list of same org_ids as parameters (need to use map function for parallel running)
when I use a parent flow to schedule flow A and B, can I use map function to pass parameters like this way? or is there a better way to do that?
code in the threadDivya
07/24/2022, 10:51 PMJames Constable
07/25/2022, 3:41 AMAndreas
07/25/2022, 9:55 AMprefect deployment ls
. I tried a reset on orion's database and running the deployment create script again with no luck. This happened after upgrading from b11 to b12Justin Trautmann
07/25/2022, 10:17 AMprefect deployment execute ...
fails with RuntimeWarning: coroutine 'create_then_begin_flow_run' was never awaited
. see thread for my flow code. thanks a lot for your support.Slackbot
07/25/2022, 10:17 AMTom Thurstan
07/25/2022, 10:23 AMFlorian Guily
07/25/2022, 10:26 AMRiccardo Tesselli
07/25/2022, 11:08 AMDeployment
) Pycharm can not provide autocompletion suggestions for the class arguments (like name
, tags
…). I think this is because of the decorators applied to the classes which “mask” the arguments (like @PrefectObjectRegistry.register_instances
). To improve the development experience it could be nice to find a way to expose the arguments so Pycharm and IDEs can provide autosuggestionsJoshua Greenhalgh
07/25/2022, 11:51 AMVadym Dytyniak
07/25/2022, 12:31 PMEvent: 'FailedScheduling' on pod 'prefect-job-79c82cd5-w6nfd'
Message: 0/7 nodes are available: 2 node(s) had taint {<http://dask.corp.com/component|dask.corp.com/component>: scheduler}, that the pod didn't tolerate, 5 node(s) didn't match Pod's node affinity/selector
Do you have ideas how to disable them?Steph Clacksman
07/25/2022, 1:20 PMTom Klein
07/25/2022, 1:28 PMSubmitted
and nothing seems to be happening with itDavid
07/25/2022, 1:47 PMDavid
07/25/2022, 1:47 PMRajvir Jhawar
07/25/2022, 2:01 PMPrass
07/25/2022, 2:13 PMmlops
section, I've added prefect - pip install productivity-stack[mlops]
Chu
07/25/2022, 2:54 PMAndrew Pruchinski
07/25/2022, 3:34 PMConnection aborted
issue. Even if there are some failures, we do want the flow to continue and the task triggers are set accordingly. Thank youLeon Kozlowski
07/25/2022, 4:13 PM