Kishan
10/25/2022, 3:33 AMpip install prefect[gcp]
as per the documentation but I'm getting WARNING: prefect 2.6.4 does not provide the extra 'gcp'
. Maybe the docs are not up to date? Anyone know how to install the vertex agent now?Jake Loo
10/25/2022, 3:54 AMJon Ruhnke
10/25/2022, 4:11 AMKhyaati Jindal
10/25/2022, 5:23 AMraise PrefectHTTPStatusError.from_httpx_error(exc) from exc.__cause__
prefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/xxxxxx>
return asynclib.run(func, *args, **backend_options)
Usually re - running the agent works fine but given the sensitive nature of my prjects, I would like to avoid this in future, hence i am trying to understand why is this happeningvholmer
10/25/2022, 8:32 AMPrefectHTTPStatusError: Client error '403 Forbidden' for url
'<https://api.prefect.cloud/api/accounts/><ACCOUNTGUID>/wor
kspaces/<WORKSPACEGUID>/work_queues/<WORKQUEUEGUID>/get_runs'
At /usr/local/lib/python3.8/dist-packages/prefect/client/base.py:125. Submitting any flows after this exception leads to them being visible in the Prefect cloud web interface as "Scheduled" or "Late", basically the agent completely dies after this. Is this a known issue or could this be due to something else I'm doing incorrectly?Lukasz Pakula
10/25/2022, 9:32 AMINFO - Retiring workers [154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185]
INFO - Adaptive stop
INFO - Adaptive stop
ERROR - prefect.CloudFlowRunner | Unexpected error: KilledWorker('<name>', <WorkerState 'tcp://<ip>', name: 47, status: closed, memory: 0, processing: <number>, 3)
Restarting the flow is resolving the issue.
Is there any sensible explanation of why upgrading kubernetes cluster could cause it? Or i must be missing something elsewhere ?Stanislav Kotsiievskyi
10/25/2022, 12:45 PMFlow could not be retrieved from deployment.
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 247, in retrieve_flow_then_begin_flow_run
flow = await load_flow_from_flow_run(flow_run, client=client)
File "/usr/local/lib/python3.10/site-packages/prefect/client/utilities.py", line 47, in with_injected_client
return await fn(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/prefect/deployments.py", line 159, in load_flow_from_flow_run
await storage_block.get_directory(from_path=deployment.path, local_path=".")
File "/usr/local/lib/python3.10/site-packages/prefect/filesystems.py", line 146, in get_directory
shutil.copytree(from_path, local_path, dirs_exist_ok=True)
File "/usr/local/lib/python3.10/shutil.py", line 556, in copytree
with os.scandir(src) as itr:
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp2ywchethprefect/flows/hello_world'
Have you got experience with such issues?Jessica Smith
10/25/2022, 1:41 PMNic
10/25/2022, 1:52 PMNic
10/25/2022, 2:23 PMA list of volume mount strings in the format of "local_path:container_path".
Would following bind my Local G:/ Drive to a G:/ in the docker, or should I write it differently?Tim Enders
10/25/2022, 2:53 PMTraceback (most recent call last):
File "/home/tenders/Documents/code/prefect-orion/platform_prefect/accounts/accounts_subscriptions.py", line 359, in <module>
flow_result = main()
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/flows.py", line 439, in __call__
return enter_flow_run_engine_from_flow_call(
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/engine.py", line 150, in enter_flow_run_engine_from_flow_call
return anyio.run(begin_run)
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/anyio/_core/_eventloop.py", line 70, in run
return asynclib.run(func, *args, **backend_options)
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 292, in run
return native_run(wrapper(), debug=debug)
File "/usr/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete
return future.result()
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 287, in wrapper
return await func(*args)
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/client/utilities.py", line 47, in with_injected_client
return await fn(*args, **kwargs)
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/engine.py", line 229, in create_then_begin_flow_run
return await state.result(fetch=True)
File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/states.py", line 86, in _get_state_result
raise MissingResult(
prefect.exceptions.MissingResult: State data is missing. Typically, this occurs when result persistence is disabled and the state has been retrieved from the API.
It seems like Prefect is still expecting the State data to exist, even though it doesn't by default? (I may be misunderstanding things too)Mary Clair Thompson
10/25/2022, 3:41 PM@dataclass
class Config(YamlDataClassConfig):
EMAIL_FROM: str = None
EMAIL_TO: List[str] = None
as well as a task intended to instantiate the instance of the class and load data to it:
@task(name='load-configs')
def load_configs(config_path: str) -> Config:
configs = Config()
configs.load(config_path)
return configs
The task seems to instantiate the config object, but breaks when we try to actually load configs from the provided path. Again, this works perfectly fine outside of the context of a task, so presumably there is some internal prefect logic I’m futzing with here. I’d appreciate any thoughts!David Elliott
10/25/2022, 3:47 PMCarlo
10/25/2022, 4:55 PMClaire Herdeman
10/25/2022, 8:27 PMDavid Stern
10/26/2022, 4:40 AMDavid Huang
10/26/2022, 7:09 AMlink89
10/26/2022, 7:27 AMsignal
by themselves, and due to this limitation
When threads are enabled, this function can only be called from the main thread of the main interpreter; attempting to call it from other threads will cause ahttps://docs.python.org/3/library/signal.html#signal.signal It will fail when execute as task of prefect.exception to be raised.ValueError
Khyaati Jindal
10/26/2022, 8:11 AMAndreas Tsangarides
10/26/2022, 8:20 AMStarting task run...
[2022-10-25 15:23:07+0100] INFO - prefect.TaskRunner | Task 'read_features_config[1]': Starting task run...
[2022-10-25 15:23:07+0100] INFO - prefect.TaskRunner | Task 'read_features_config[3]': Finished task run for task with final state: 'Success'
iKeepo w
10/26/2022, 9:20 AMiKeepo w
10/26/2022, 9:26 AMDeepanshu Aggarwal
10/26/2022, 9:41 AMDaniel Komisar
10/26/2022, 11:46 AMlocation
field may be (i.e. for use with PrefectResults
)? Thanks!Adam
10/26/2022, 2:21 PMSunjay
10/26/2022, 2:36 PMFarooque Shaikh
10/26/2022, 3:02 PMHamza Naanani
10/26/2022, 3:04 PMprefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/xxxxxxxx/workspaces/xxxxx/work_queues/name/dev-prem-wq>'
I tried changing the api keys (service account) / giving ownership to the agent on the workspace, but nothing worked so far.
I tried deploying the agents on the cloud on a kubernetes cluster and it works just fine, but when I try to do the same thing on our on prem environment, it returns me this error. Can I have some insights please ?
ThanksYD
10/26/2022, 3:30 PMKhuyen Tran
10/26/2022, 4:01 PM