Mihai H11/29/2022, 1:32 PM
Kelvin Garcia11/29/2022, 1:51 PM
function handler either from the
variable or the
variable are passed to that function?
Mihai H11/29/2022, 2:41 PM
Mihai H11/29/2022, 2:42 PM
Mihai H11/29/2022, 2:42 PM
Slackbot11/29/2022, 2:42 PM
FuETL11/29/2022, 2:45 PM
But sometimes when theres nothing to run or running, the flow is scheduled to run in like 20~30 min, even when i'm not providing the scheduled_start_time parameter, how can i make my flows always get reschedule immediately? (I was think that this is the default behaviour), maybe is the amount of agent that i'm running? Thanks.
Sunjay11/29/2022, 3:04 PM
Matt Delacour11/29/2022, 3:34 PM
Jean-Michel Provencher11/29/2022, 4:40 PM
Patrick Tan11/29/2022, 4:59 PM
Mac11/29/2022, 10:01 PM
RegisterTaskDefinition operation: Too many concurrent attempts to create a new revision of the specified family.
Bradley Hurley11/30/2022, 4:17 AM
, but I don’t think
are actually supported. I searched for existing GitHub issues, but wasn’t able to find anything.
Tim Galvin11/30/2022, 8:51 AM
mechanism? I am running a DaskTaskExecutor with a
backend to create the set of
. I can see that the loggers in modules I am using in my prefect2 pipeline are beingreported in the
stderr output that is written to disk through the
argument. These messages are following the prefect log handler configurtion ("Time | State | _ name _ - Message"), but they are not being saved to the orion database / presented by the orion UI.
sbatch --error log.err
Vadym Dytyniak11/30/2022, 9:43 AM
Christopher11/30/2022, 2:29 PM
Vadym Dytyniak11/30/2022, 2:46 PM
Prefect does not guarantee that in
l1 = task1.map([1, 2, 3]) l2 = task2.map(l1) task3.map(l1=l1, l2=l2)
elements will be passed with corresponding
Nate Roberts11/30/2022, 6:28 PM
Ashley Felber11/30/2022, 7:06 PM
Kevin McCraney11/30/2022, 8:15 PM
method in an assert in our testing, and to move that to Prefect 2, we were thinking we might call
to get the flow run state and return some value (likely 'Completed' from the
parameter). We've observed that calling
within a flow's context causes the flow to hang. Has anyone observed this, or does anyone have any suggestions for remedy?
Simon Macklin11/30/2022, 8:20 PM
Sean Conroy11/30/2022, 9:34 PM
method from Prefect 1 for Prefect 2? In other words, is testing the state name = 'Completed' the best way to check for success?
myflow_state = my_flow(return_state=True) # Test if state is successfull: if not myflow_state.name == 'Completed': raise Exception("myflow failed")
Michael K11/30/2022, 10:00 PM
to trigger syncs on Airbyte Cloud? Or is it only for open source hosted instances?
Boggdan Barrientos11/30/2022, 10:07 PM
for execute two deployments that has to be completed the next subflow. I'm having issues in the execution of the seconds subflows, the agent dies after one hour of waiting. How can I apply this logic successfully? I need to execute n deployments and when the n deployments has been completed, execute another flow. Image 1: The deployments runs properly. Image 2: The tasks that runs the deployments never ends.
wonsun12/01/2022, 4:09 AM
Khyaati Jindal12/01/2022, 5:01 AM
Any idea why this is happening ? I have deployed lot of deployments before, and never had such a issue
The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/prefect/agent.py", line 154, in get_and_submit_flow_runs queue_runs = await self.client.get_runs_in_work_queue( File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/prefect/client/orion.py", line 763, in get_runs_in_work_queue response = await <http://self._client.post|self._client.post>( File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_client.py", line 1848, in post return await self.request( File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_client.py", line 1533, in request return await self.send(request, auth=auth, follow_redirects=follow_redirects) File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/prefect/client/base.py", line 160, in send await super().send(*args, **kwargs) File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_client.py", line 1620, in send response = await self._send_handling_auth( File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_client.py", line 1648, in _send_handling_auth File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_client.py", line 1685, in _send_handling_redirects response = await self._send_single_request(request) File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_client.py", line 1722, in _send_single_request response = await transport.handle_async_request(request) File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_transports/default.py", line 352, in handle_async_request with map_httpcore_exceptions(): File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/ubuntu/5c-ed-sumary-telegram-bot/env/lib/python3.10/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.LocalProtocolError: Invalid input ConnectionInputs.SEND_HEADERS in state ConnectionState.CLOSED