When I use REST API with Scheduler enabled e g RRULE I get t

Question

When I use REST API with Scheduler enabled e g RRULE I get the following error in Prefect Orion 2 4 It was working fine in 2 0 Even though I have dedicated storage directory and REST API way of running workflow is pointing to default tmp folder not the one I have it using the parameter PREFECT LOCAL STORAGE PATH But If I run using yml it uses the path specified in PREFECT LOCAL STORAGE PATH and it works fine Please let me know what am I missing in the payload Flow could not be retrieved from deployment Traceback most recent call last File lt frozen importlib bootstrap external gt line 879 in exec module File lt frozen importlib bootstrap external gt line 1016 in get code File lt frozen importlib bootstrap external gt line 1073 in get data FileNotFoundError Errno 2 No such file or directory tmp tmpz0cmn1ddprefect AOPS SQL Workflow v1 py

Khuyen Tran · Answer

Hi < Xavier Babu> thanks for raising the issue My teammates might be able to help Can you move the error to the comment so that it is easier for others to follow other threads

Xavier Babu · Answer

Payload used 2022 09 24 16 40 54 170 DEBUG 18568 http nio 5080 exec 962 com aops waves service FlowService jsonObject toJSONString parameter openapi schema type object title Parameters properties kwargs type string title kwargs required kwargs infrastructure document id 736c6e6f 6c03 40fa 8ea4 71f946a05343 infra overrides description AOPS SQL Workflow DS 12 version 1 work queue name waves q tags waves q path localpart0 aop shared WAVES workflows schedule rrule DTSTART 20220924T124300 nRRULE FREQ=HOURLY INTERVAL=1 COUNT=1 UNTIL=20220924T124500 timezone US Eastern flow id d7202f6b b929 4139 9e4d 73e2636a3fe0 entrypoint AOPS SQL Workflow v1 py AOPS SQL Workflow name AOPS SQL Workflow DS 12 parameters kwargs sqltype 1 date range CURRENT DATE INTERVAL 1 months dbname gpprod selection count flow name AOPS SQL Workflow rpt flag 1 tab1 whse dim company schd run name AOPS SQL Workflow DS 12 sql SELECT selection FROM tab1 WHERE show in report flag = rpt flag and creation date gt date range API Response id ba109826 6846 4e0e 815b ee905c593dab created 2022 09 23T19 49 43 563714+00 00 updated 2022 09 24T16 40 54 208488+00 00 name AOPS SQL Workflow DS 12 version 1 description AOPS SQL Workflow DS 12 flow id d7202f6b b929 4139 9e4d 73e2636a3fe0 schedule rrule DTSTART 20220924T124300 nRRULE FREQ=HOURLY INTERVAL=1 COUNT=1 UNTIL=20220924T124500 timezone US Eastern is schedule active true infra overrides parameters kwargs sql SELECT selection FROM tab1 WHERE show in report flag = rpt flag and creation date gt date range tab1 whse dim company dbname gpprod sqltype 1 rpt flag 1 flow name AOPS SQL Workflow selection count date range CURRENT DATE INTERVAL 1 months schd run name AOPS SQL Workflow DS 12 tags waves q work queue name waves q parameter openapi schema type object title Parameters required kwargs properties kwargs type string title kwargs path localpart0 aop shared WAVES workflows entrypoint AOPS SQL Workflow v1 py AOPS SQL Workflow manifest path null storage document id null infrastructure document id 736c6e6f 6c03 40fa 8ea4 71f946a05343 is schedule active true

Xavier Babu · Answer

Moved

Xavier Babu · Answer

If we run a workflow for every minute for 5 minutes it fails sporadically by showing the following error Flow could not be retrieved from deployment Traceback most recent call last File lt frozen importlib bootstrap external gt line 879 in exec module File lt frozen importlib bootstrap external gt line 1016 in get code File lt frozen importlib bootstrap external gt line 1073 in get data FileNotFoundError Errno 2 No such file or directory tmp tmp7v3me6ytprefect AOPS SQL Workflow v1 py The above exception was the direct cause of the following exception Traceback most recent call last File localpart0 aop shared WAVES prefect2 lib python3 10 site packages prefect engine py line 257 in retrieve flow then begin flow run flow = await load flow from flow run flow run client=client File localpart0 aop shared WAVES prefect2 lib python3 10 site packages prefect client orion py line 82 in with injected client return await fn args kwargs File localpart0 aop shared WAVES prefect2 lib python3 10 site packages prefect deployments py line 70 in load flow from flow run flow = await run sync in worker thread import object str import path File localpart0 aop shared WAVES prefect2 lib python3 10 site packages prefect utilities asyncutils py line 57 in run sync in worker thread return await <http anyio to|anyio to> thread run sync call cancellable=True File localpart0 aop shared WAVES prefect2 lib python3 10 site packages anyio to thread py line 31 in run sync return await get asynclib run sync in worker thread File localpart0 aop shared WAVES prefect2 lib python3 10 site packages anyio backends asyncio py line 937 in run sync in worker thread return await future File localpart0 aop shared WAVES prefect2 lib python3 10 site packages anyio backends asyncio py line 867 in run result = context run func args File localpart0 aop shared WAVES prefect2 lib python3 10 site packages prefect utilities importtools py line 193 in import object module = load script as module script path File localpart0 aop shared WAVES prefect2 lib python3 10 site packages prefect utilities importtools py line 156 in load script as module raise ScriptError user exc=exc path=path from exc prefect exceptions ScriptError Script at AOPS SQL Workflow v1 py encountered an exception

Xavier Babu · Answer

Khuyen Any quick tip to resolve this issue It has stopped the entire DEV work Impacting our application release date Please help

Khuyen Tran · Answer

Hmm I m not sure how to solve this issue Do you mind opening <https github com PrefectHQ prefect|this issue on Prefect GitHub >so the engineers can take a look at this

Xavier Babu · Answer

Good morning Khuyen I opened a issue defect yesterday Since it made our entire system down could you please expedite if possible <https github com PrefectHQ prefect issues 6979>