Rik
07/22/2022, 2:10 PMharis khan
07/22/2022, 3:52 PMSteph Clacksman
07/22/2022, 4:30 PMRuntimeError: no validator found for <class 'pandas.core.frame.DataFrame'>
, so I tried to use validate_parameters=False
in the flow annotation, but it made no difference. What am I doing wrong?JR Carneiro
07/22/2022, 4:48 PMprefect docker agent
on a single server;
• then we run several flows;
• we make updates to flows, and each update creates a new version of docker image; with each run the docker images are pulled onto the machine. After some point we run out of disk spaceJR Carneiro
07/22/2022, 4:49 PMAndrew Pruchinski
07/22/2022, 5:13 PMDivya
07/22/2022, 5:33 PMChris Reuter
07/22/2022, 7:48 PMnow available▾
Mike Vanbuskirk
07/22/2022, 10:14 PMECSRun
config or can it not infer the correct cluster from providing agent labels?Cole Murray
07/23/2022, 12:45 AMroot@c0713100a1dd:/opt/app# python
Python 3.8.13 (default, Jul 13 2022, 05:54:24)
[GCC 10.2.1 20210110] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import prefect
>>> import prefect.flow_runners
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ModuleNotFoundError: No module named 'prefect.flow_runners'
>>> prefect.__version__
'2.0b12'
>>>
It looks like we’ve removed the flow_runners module, but it doesn’t appear reflected in the documentation. Version was published earlier todayBenoit Chabord
07/23/2022, 4:46 AM# type: ignore
on every task call because the task returns the type of the wrapped function so I cannot do .wait() on it without raising an issue with mypy. Not sure how we can do better thoughAndreas Nigg
07/23/2022, 6:46 AMFound 1 invalid deployments:
1 validation error for deployment with name 'sync_goodread_score_to_volat_bigquery'
infrastructure
Can't instantiate abstract class Infrastructure with abstract methods preview, run (type=type_error)
Please find my deployment in the threadOliver Mannion
07/23/2022, 7:56 AM.submit()
, eg:
@flow
def greetings(names: List[str]) -> None:
for name in names:
say_hello.submit(name)
say_goodbye.submit(name)
but the flow still works without using .submit()
. What are the implications of not using .submit()
?yu zeng
07/23/2022, 10:16 AMPrasanth Kothuri
07/23/2022, 2:22 PMNoam Cohen
07/23/2022, 7:06 PM(finance-lGLYToYy-py3.9) ➜ finance git:(master) ✗ prefect storage create
No storage types are available.
(finance-lGLYToYy-py3.9) ➜ finance git:(master) ✗ prefect version
Version: 2.0b10
API version: 0.7.0
Python version: 3.9.10
Git commit: e71ef86c
Any idea what changed?Sander
07/23/2022, 8:38 PMChu
07/23/2022, 8:38 PMflow.run_config = KubernetesRun()
)
2. Where can I attach LocalDaskExecutor? Only to the parent flow? (Maybe for flow A, B, I just set their parameters using unmapped()
function?)
3. Is there a way for me to test my project locally (to make sure the design works as wished) without registering every flow to the Cloud?
4. (Optional) for my use case, is there a better design to achieve my goals? Since I’m quite new to Prefect, but really astonished by its cool functionality, maybe there is some place I can make great improvements for our company
Thanks! It’s a long question, but really appreciate for any help!Vipul
07/23/2022, 8:40 PMTom Klein
07/24/2022, 4:39 PMChu
07/24/2022, 7:39 PMA -> B
, both A and B will take a list of same org_ids as parameters (need to use map function for parallel running)
when I use a parent flow to schedule flow A and B, can I use map function to pass parameters like this way? or is there a better way to do that?
code in the threadDivya
07/24/2022, 10:51 PMJames Constable
07/25/2022, 3:41 AMAndreas
07/25/2022, 9:55 AMprefect deployment ls
. I tried a reset on orion's database and running the deployment create script again with no luck. This happened after upgrading from b11 to b12Justin Trautmann
07/25/2022, 10:17 AMprefect deployment execute ...
fails with RuntimeWarning: coroutine 'create_then_begin_flow_run' was never awaited
. see thread for my flow code. thanks a lot for your support.Slackbot
07/25/2022, 10:17 AMTom Thurstan
07/25/2022, 10:23 AMFlorian Guily
07/25/2022, 10:26 AMRiccardo Tesselli
07/25/2022, 11:08 AMDeployment
) Pycharm can not provide autocompletion suggestions for the class arguments (like name
, tags
…). I think this is because of the decorators applied to the classes which “mask” the arguments (like @PrefectObjectRegistry.register_instances
). To improve the development experience it could be nice to find a way to expose the arguments so Pycharm and IDEs can provide autosuggestionsJoshua Greenhalgh
07/25/2022, 11:51 AMJoshua Greenhalgh
07/25/2022, 11:51 AMquery Task_run($where: task_run_bool_exp) {
task_run(where: $where) {
id
flow_run_id
state
task {
name
}
}
}
With variables;
{
"where": {
"start_time": {
"_gte": "2022-07-20",
"_lt": "2022-07-21"
}
}
Always times out;
{
"errors": [
{
"path": [
"task_run"
],
"message": "Operation timed out",
"extensions": {
"code": "API_ERROR"
}
}
],
"data": null
}
Mason Menges
07/25/2022, 10:11 PMJoshua Greenhalgh
07/29/2022, 6:20 PM