Hi there I want to use GCP Google Compute Engine as prefect

Question

Hi there I want to use GCP Google Compute Engine as prefect agent and run a flow through prefect cloud api I have deployed my code to a gcs bucket My code is all working fine locally However when I run prefect agent start p mypool on the VM the flow fails as follows ```14 14 30 142 | ERROR | prefect infrastructure process Process psi6 vanden sector exited with status code 9 This indicates that the process exited due to a SIGKILL signal Typically this is either caused by manual cancellation or high memory usage causing the operating system to terminate the process ``` The above error is not a memory issue memory did not spike when I monitored it nor did I manually terminate it One peculiarity is that retrying this failed flow results in a new error message ```prefect exceptions MissingResult State data is missing Typically this occurs when result persistence is disabled and the state has been retrieved from the API 14 22 03 283 | ERROR | Flow run psi6 vanden sector Finished in state Failed Flow run encountered an exception MissingResult State data is missing Typically this occurs when result persistence is disabled and the state has been retrieved from the API n ```

kade · Answer

If I don t deploy my code and run it in the VM like `python etl py` it works fine What is the problem I have been suffering for days because of this

kade · Answer

whole error code ```Agent started Looking for work from work pool gh agent pool 14 12 32 114 | INFO | prefect agent Submitting flow run d7146be9 3824 4c04 bb0d 71b88bfbccf5 14 12 33 068 | INFO | prefect infrastructure process Opening process psi6 vanden sector 14 12 33 297 | INFO | prefect agent Completed submission of flow run d7146be9 3824 4c04 bb0d 71b88bfbccf5 lt frozen runpy gt 128 RuntimeWarning prefect engine found in sys modules after import of package prefect but prior to execution of prefect engine this may result in unpredictable behaviour 14 12 37 062 | INFO | Flow run psi6 vanden sector Downloading flow code from storage at home kade gh prefect 14 13 02 706 | INFO | Flow run psi6 vanden sector Created task run extract data from web 0 for task extract data from web 14 13 02 707 | INFO | Flow run psi6 vanden sector Executing extract data from web 0 immediately 14 14 30 142 | ERROR | prefect infrastructure process Process psi6 vanden sector exited with status code 9 This indicates that the process exited due to a SIGKILL signal Typically this is either caused by manual cancellation or high memory usage causing the operating system to terminate the process 14 14 30 518 | INFO | prefect agent Reported flow run d7146be9 3824 4c04 bb0d 71b88bfbccf5 as crashed Flow run infrastructure exited with non zero status code 9 14 21 27 854 | INFO | prefect agent Submitting flow run d7146be9 3824 4c04 bb0d 71b88bfbccf5 14 21 28 885 | INFO | prefect infrastructure process Opening process psi6 vanden sector 14 21 29 172 | INFO | prefect agent Completed submission of flow run d7146be9 3824 4c04 bb0d 71b88bfbccf5 lt frozen runpy gt 128 RuntimeWarning prefect engine found in sys modules after import of package prefect but prior to execution of prefect engine this may result in unpredictable behaviour 14 21 36 018 | INFO | Flow run psi6 vanden sector Downloading flow code from storage at home kade gh prefect 14 22 01 874 | INFO | Flow run psi6 vanden sector Created task run extract data from web 0 for task extract data from web 14 22 01 876 | INFO | Flow run psi6 vanden sector Executing extract data from web 0 immediately 14 22 02 970 | WARNING | Task run extract data from web 0 Task run edc91b43 2ef6 4de9 b78c 70825dc38d35 received abort during orchestration This run cannot transition to the RUNNING state from the RUNNING state Task run is in RUNNING state 14 22 02 972 | ERROR | Flow run psi6 vanden sector Encountered exception during execution Traceback most recent call last File home kade gh prefect venv lib python3 11 site packages prefect engine py line 665 in orchestrate flow run result = await run sync flow call ^^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages prefect utilities asyncutils py line 154 in run sync in interruptible worker thread async with anyio create task group as tg File home kade gh prefect venv lib python3 11 site packages anyio backends asyncio py line 662 in aexit raise exceptions 0 File home kade gh prefect venv lib python3 11 site packages anyio to thread py line 31 in run sync return await get asynclib run sync in worker thread ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages anyio backends asyncio py line 937 in run sync in worker thread return await future ^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages anyio backends asyncio py line 867 in run result = context run func args ^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages prefect utilities asyncutils py line 135 in capture worker thread and result result = fn args kwargs ^^^^^^^^^^^^^^^^^^^^^ File tmp tmppa8w lpdprefect etl etl web to gcs py line 81 in etl web to gcs extract data from web year month day hour File home kade gh prefect venv lib python3 11 site packages prefect tasks py line 469 in call return enter task run engine ^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages prefect engine py line 965 in enter task run engine return run async from worker thread begin run ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages prefect utilities asyncutils py line 177 in run async from worker thread return anyio from thread run call ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages anyio from thread py line 49 in run return asynclib run async from thread func args ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages anyio backends asyncio py line 970 in run async from thread return f result ^^^^^^^^^^ File usr local lib python3 11 concurrent futures base py line 456 in result return self get result ^^^^^^^^^^^^^^^^^^^ File usr local lib python3 11 concurrent futures base py line 401 in get result raise self exception File home kade gh prefect venv lib python3 11 site packages prefect engine py line 1114 in get task call return value return await future result ^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages prefect futures py line 237 in result return await final state result raise on failure=raise on failure fetch=True ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File home kade gh prefect venv lib python3 11 site packages prefect states py line 103 in get state result raise MissingResult prefect exceptions MissingResult State data is missing Typically this occurs when result persistence is disabled and the state has been retrieved from the API 14 22 03 283 | ERROR | Flow run psi6 vanden sector Finished in state Failed Flow run encountered an exception MissingResult State data is missing Typically this occurs when result persistence is disabled and the state has been retrieved from the API n execution date 2023 03 16 13 14 22 05 093 | INFO | prefect infrastructure process Process psi6 vanden sector exited cleanly ```

Ryan Peden · Answer

Is there anything in your task code that might not work properly when running in a subproccess It looks like something is happening in the task causing abrupt termination of the process running the flow It happened so quickly that the task disappeared while its state was still `RUNNING` as indicated by this error message that appeared when Prefect tried to re run the flow ```14 22 02 970 | WARNING | Task run extract data from web 0 Task run edc91b43 2ef6 4de9 b78c 70825dc38d35 received abort during orchestration This run cannot transition to the RUNNING state from the RUNNING state Task run is in RUNNING state ``` We have <https github com PrefectHQ prefect pull 8802|an update> going out today allow the RUNNING to RUNNING transition but I don t think it will solve the underlying problem here if the task keeps terminating the flow subprocess It s hard to diagnose more without knowing what s happening in the `extract data from web` task I ve seen occasional issues when launching a headless browser tool like Puppeteer from a subprocess are you using anything like that to extract web data

kade · Answer

hi < Ryan Peden> Thanks for response I didn t use the headless tool I just using request url to download here is my code `etract data from web` ``` task retries=3 cache key fn=task input hash cache expiration=timedelta days=1 def extract data from web year int month int day int hour int gt None headers = User Agent Mozilla 5 0 hour is 0 23 url = f print f Extracting data from url req = request Request url headers=headers response = request urlopen req data = gzip decompress response read decode dicts = data strip split n data list = for d in dicts remove payload key in dict d = json loads d d pop payload data list append d file name = f data year month 02d day 02d hour 02d json gz with gzip open file name wt encoding= utf 8 as f json dump data list f ```