Anjaneyulu K
11/08/2022, 10:30 PM@flow(name="Status check")
def run():
a= "hello"
if(condition):
success
else:
run()
if __name__ == "__main__":
run()
Can anyone help. This is more like recursive funtionAnjaneyulu K
11/09/2022, 9:15 PMGiuliano Mega
11/10/2022, 11:54 AMclass FlowParameters(BaseModel):
requests_per_minute: int = 10
ids: Optional[List[str]] = None
@flow(
description='Imports and enriches Entities.',
task_runner=SequentialTaskRunner()
)
def token_pipeline(parameters: FlowParameters):
new_entities = fetch_new_entities(parameters.ids)
enrich_entity.map(new_entities, parameters.requests_per_minute)
If I call my flow from Prefect Cloud and pass it some parameters (run Custom), all runs smoothly. If, on the other hand, I try to run it with the default parameters, I get:
Validation of flow parameters failed with error:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 275, in retrieve_flow_then_begin_flow_run
parameters = flow.validate_parameters(flow_run.parameters)
File "/usr/local/lib/python3.10/site-packages/prefect/flows.py", line 324, in validate_parameters
raise ParameterTypeError.from_validation_error(exc) from None
prefect.exceptions.ParameterTypeError: Flow run received invalid parameters:
- parameters: field required
Which is weird. Expected behavior would be having the flow run with default parameters. Can't seem to understand what I'm doing wrong from reading the docs, any ideas? đGiuliano Mega
11/10/2022, 12:12 PMmap
with a custom task runner?Anjaneyulu K
11/10/2022, 7:47 PMStéphan Taljaard
11/15/2022, 5:19 AMSlackbot
11/15/2022, 2:56 PMAnjaneyulu K
11/16/2022, 12:22 AMRevanth
11/16/2022, 9:41 AMStéphan Taljaard
11/17/2022, 11:16 AMJoshua Fink
11/17/2022, 11:15 PMRevanth
11/21/2022, 6:05 AMashish karan
11/30/2022, 5:57 PMbotocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the PutObject operation: Access Denied
Alex Turek
11/30/2022, 8:42 PMPhĂșc Äinh Minh
12/02/2022, 4:38 AMPhĂșc Äinh Minh
12/02/2022, 11:16 AMAlex Turek
12/02/2022, 7:06 PMSangeetha Sivalingam
12/04/2022, 9:15 AMPhĂșc Äinh Minh
12/05/2022, 11:48 AMModuleNotFoundError: No module named 'prefect_airbyte
I did install prefect airbyte in my local machine (as global system). Did I miss anythings?PhĂșc Äinh Minh
12/07/2022, 2:02 AMFile "/usr/local/lib/python3.10/site-packages/anyio/_core/_tasks.py", line 118, in __exit__
raise TimeoutError
TimeoutError
During handling of the above exception, another exception occurred:
File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc)
httpcore.ReadTimeout
I run prefect to orchestrate airbyte connection (airbyte local)Anthony
12/07/2022, 8:28 PMDocuments/prefect/prefect_env
What do I need to do so that the path doesn't point to my local file system?PhĂșc Äinh Minh
12/08/2022, 1:27 AMCrash detected! Request to <https://api.prefect.cloud/api/accounts/xxxx/workspaces/xxxx/task_runs/xxxx/set_state> failed: Traceback (most recent call last):
ssl.SSLSyscallError: Some I/O error occurred (_ssl.c:997)
The above exception was the direct cause of the following exception:
anyio.BrokenResourceError
During handling of the above exception, another exception occurred:
File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc)
httpcore.ConnectError
The above exception was the direct cause of the following exception:
File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ConnectError
Worker information:
Approximate queue length: 0
Pending log batch length: 6
Pending log batch size: 2160
The log worker is stopping and these logs will not be sent.
Does anyone have ideas to fix this error?Sean Malone
12/09/2022, 3:59 PM....
File "/home/ubuntu/.local/lib/python3.8/site-packages/prefect/blocks/core.py", line 175, in __init__
super().__init__(*args, **kwargs)
File "pydantic/main.py", line 342, in pydantic.main.BaseModel.__init__
pydantic.error_wrappers.ValidationError: 1 validation error for SnowflakeConnector
credentials
field required (type=value_error.missing)
This was resolved by switching the credential field back to the correct block instead of the âNoneâ value. Additionally our Slack Webhook URL was âunset/blankedâ, leading to alerts not firing off. Is this a known issue? Trying to understand what would cause these fields to be nulled overnight.quassy
12/15/2022, 10:44 AMimproved timeout handling on theWhen I now try to run a pipeline without having that parameter explicitly set to a not-None value in KubernetesJob(...), I get this error from Prefect Cloud.block - this timeout is now disabled by default (i.e.KubernetesJob
is set tojob_watch_timeout_seconds
)None
Submission failed. pydantic.error_wrappers.ValidationError: 1 validation error for KubernetesJob job_watch_timeout_seconds none is not an allowed value (type=type_error.none.not_allowed)Is this intended?
Gows Shaik
12/21/2022, 5:55 AMThet Naing
12/27/2022, 6:37 PMGcpCredentials
block in both the Prefect UI and the Python API. I am able to save the credentials on the UI, but when I load the credentials, I get a Pydantic JSONDecodeError
. When I try to save the credentials from Python, I get the same error. Anybody know a solution or workaround?Alireza
01/02/2023, 12:47 PMSteven Jiang
01/02/2023, 7:32 PMTom Klein
01/04/2023, 12:24 PMTibs
01/04/2023, 2:13 PM