Kishan10/25/2022, 3:33 AM
as per the documentation but I'm getting
pip install prefect[gcp]
. Maybe the docs are not up to date? Anyone know how to install the vertex agent now?
WARNING: prefect 2.6.4 does not provide the extra 'gcp'
Jake Loo10/25/2022, 3:54 AM
Jon Ruhnke10/25/2022, 4:11 AM
Khyaati Jindal10/25/2022, 5:23 AM
Usually re - running the agent works fine but given the sensitive nature of my prjects, I would like to avoid this in future, hence i am trying to understand why is this happening
raise PrefectHTTPStatusError.from_httpx_error(exc) from exc.__cause__ prefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/xxxxxx> return asynclib.run(func, *args, **backend_options)
vholmer10/25/2022, 8:32 AM
At /usr/local/lib/python3.8/dist-packages/prefect/client/base.py:125. Submitting any flows after this exception leads to them being visible in the Prefect cloud web interface as "Scheduled" or "Late", basically the agent completely dies after this. Is this a known issue or could this be due to something else I'm doing incorrectly?
PrefectHTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/><ACCOUNTGUID>/wor kspaces/<WORKSPACEGUID>/work_queues/<WORKQUEUEGUID>/get_runs'
Lukasz Pakula10/25/2022, 9:32 AM
Restarting the flow is resolving the issue. Is there any sensible explanation of why upgrading kubernetes cluster could cause it? Or i must be missing something elsewhere ?
INFO - Retiring workers [154, 155, 156, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 184, 185] INFO - Adaptive stop INFO - Adaptive stop ERROR - prefect.CloudFlowRunner | Unexpected error: KilledWorker('<name>', <WorkerState 'tcp://<ip>', name: 47, status: closed, memory: 0, processing: <number>, 3)
Stanislav Kotsiievskyi10/25/2022, 12:45 PM
Have you got experience with such issues?
Flow could not be retrieved from deployment. Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 247, in retrieve_flow_then_begin_flow_run flow = await load_flow_from_flow_run(flow_run, client=client) File "/usr/local/lib/python3.10/site-packages/prefect/client/utilities.py", line 47, in with_injected_client return await fn(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/prefect/deployments.py", line 159, in load_flow_from_flow_run await storage_block.get_directory(from_path=deployment.path, local_path=".") File "/usr/local/lib/python3.10/site-packages/prefect/filesystems.py", line 146, in get_directory shutil.copytree(from_path, local_path, dirs_exist_ok=True) File "/usr/local/lib/python3.10/shutil.py", line 556, in copytree with os.scandir(src) as itr: FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp2ywchethprefect/flows/hello_world'
Jessica Smith10/25/2022, 1:41 PM
Nic10/25/2022, 1:52 PM
Nic10/25/2022, 2:23 PM
Would following bind my Local G:/ Drive to a G:/ in the docker, or should I write it differently?
A list of volume mount strings in the format of "local_path:container_path".
Tim Enders10/25/2022, 2:53 PM
It seems like Prefect is still expecting the State data to exist, even though it doesn't by default? (I may be misunderstanding things too)
Traceback (most recent call last): File "/home/tenders/Documents/code/prefect-orion/platform_prefect/accounts/accounts_subscriptions.py", line 359, in <module> flow_result = main() File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/flows.py", line 439, in __call__ return enter_flow_run_engine_from_flow_call( File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/engine.py", line 150, in enter_flow_run_engine_from_flow_call return anyio.run(begin_run) File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/anyio/_core/_eventloop.py", line 70, in run return asynclib.run(func, *args, **backend_options) File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 292, in run return native_run(wrapper(), debug=debug) File "/usr/lib/python3.10/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/usr/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete return future.result() File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 287, in wrapper return await func(*args) File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/client/utilities.py", line 47, in with_injected_client return await fn(*args, **kwargs) File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/engine.py", line 229, in create_then_begin_flow_run return await state.result(fetch=True) File "/home/tenders/.cache/pypoetry/virtualenvs/prefect-orion-HonJDUqB-py3.10/lib/python3.10/site-packages/prefect/states.py", line 86, in _get_state_result raise MissingResult( prefect.exceptions.MissingResult: State data is missing. Typically, this occurs when result persistence is disabled and the state has been retrieved from the API.
Mary Clair Thompson10/25/2022, 3:41 PM
as well as a task intended to instantiate the instance of the class and load data to it:
@dataclass class Config(YamlDataClassConfig): EMAIL_FROM: str = None EMAIL_TO: List[str] = None
The task seems to instantiate the config object, but breaks when we try to actually load configs from the provided path. Again, this works perfectly fine outside of the context of a task, so presumably there is some internal prefect logic I’m futzing with here. I’d appreciate any thoughts!
@task(name='load-configs') def load_configs(config_path: str) -> Config: configs = Config() configs.load(config_path) return configs
David Elliott10/25/2022, 3:47 PM
Carlo10/25/2022, 4:55 PM
Claire Herdeman10/25/2022, 8:27 PM
David Stern10/26/2022, 4:40 AM
David Huang10/26/2022, 7:09 AM
link8910/26/2022, 7:27 AM
by themselves, and due to this limitation
When threads are enabled, this function can only be called from the main thread of the main interpreter; attempting to call it from other threads will cause ahttps://docs.python.org/3/library/signal.html#signal.signal It will fail when execute as task of prefect.exception to be raised.
Khyaati Jindal10/26/2022, 8:11 AM
Andreas Tsangarides10/26/2022, 8:20 AM
Starting task run... [2022-10-25 15:23:07+0100] INFO - prefect.TaskRunner | Task 'read_features_config': Starting task run... [2022-10-25 15:23:07+0100] INFO - prefect.TaskRunner | Task 'read_features_config': Finished task run for task with final state: 'Success'
iKeepo w10/26/2022, 9:20 AM
Deepanshu Aggarwal10/26/2022, 9:41 AM
Daniel Komisar10/26/2022, 11:46 AM
field may be (i.e. for use with
Adam10/26/2022, 2:21 PM
Sunjay10/26/2022, 2:36 PM
Farooque Shaikh10/26/2022, 3:02 PM
Hamza Naanani10/26/2022, 3:04 PM
I tried changing the api keys (service account) / giving ownership to the agent on the workspace, but nothing worked so far. I tried deploying the agents on the cloud on a kubernetes cluster and it works just fine, but when I try to do the same thing on our on prem environment, it returns me this error. Can I have some insights please ? Thanks
prefect.exceptions.PrefectHTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/xxxxxxxx/workspaces/xxxxx/work_queues/name/dev-prem-wq>'
Khuyen Tran10/26/2022, 4:01 PM