Hello I have a docker image that contains several flows and

Question

Hello I have a docker image that contains several flows and one of them is the one that gets invoked by Prefect as a docker container or k8s Job How can I call other flows from the first one if the list of flows to run is dynamic a list of ` lt prefect flows Flow object at gt ` when I call the `prefect flows Flow ` I get a traceback see thread Thank you

Paco Ibañez · Answer

```RuntimeError Task lt Task pending name= anyio from thread BlockingPortal call func coro= lt BlockingPortal call func running at usr local lib python3 8 site packages anyio from thread py 219 gt cb= TaskGroup spawn lt locals gt task done at usr local lib python3 8 site packages anyio backends asyncio py 726 gt got Future lt Future pending gt attached to a different loop```

Zanie · Answer

I d recommend trying the latest version where we no longer use blocking portals

Zanie · Answer

If that doesn t resolve your issue I d be curious to see a minimal example

Paco Ibañez · Answer

I am on 2 8 7

Zanie · Answer

Oh interesting

Zanie · Answer

Can you share the full traceback

Paco Ibañez · Answer

```Encountered exception during execution Traceback most recent call last File usr local lib python3 8 site packages prefect engine py line 643 in orchestrate flow run result = await flow call File cdp orchestrator flow py line 55 in cdp orchestrator await orchestrator run File src pipelines orchestrator core orchestrator py line 227 in run flow fn call File usr local lib python3 8 site packages prefect flows py line 456 in call return enter flow run engine from flow call File usr local lib python3 8 site packages prefect engine py line 180 in enter flow run engine from flow call return parent flow run context sync portal call begin run File usr local lib python3 8 site packages anyio from thread py line 283 in call return cast T Retval self start task soon func args result File usr local lib python3 8 concurrent futures base py line 444 in result return self get result File usr local lib python3 8 concurrent futures base py line 389 in get result raise self exception File usr local lib python3 8 site packages anyio from thread py line 219 in call func retval = await retval File usr local lib python3 8 site packages prefect client utilities py line 47 in with injected client return await fn args kwargs File usr local lib python3 8 site packages prefect engine py line 448 in create and begin subflow run parent task run = await client create task run File usr local lib python3 8 site packages prefect client orion py line 1779 in create task run response = await <http self client post|self client post> File usr local lib python3 8 site packages httpx client py line 1848 in post return await self request File usr local lib python3 8 site packages httpx client py line 1533 in request return await self send request auth=auth follow redirects=follow redirects File usr local lib python3 8 site packages prefect client base py line 229 in send response = await self send with retry File usr local lib python3 8 site packages prefect client base py line 187 in send with retry response = await request File usr local lib python3 8 site packages httpx client py line 1620 in send response = await self send handling auth File usr local lib python3 8 site packages httpx client py line 1648 in send handling auth response = await self send handling redirects File usr local lib python3 8 site packages httpx client py line 1685 in send handling redirects response = await self send single request request File usr local lib python3 8 site packages httpx client py line 1722 in send single request response = await transport handle async request request File usr local lib python3 8 site packages httpx transports default py line 353 in handle async request resp = await self pool handle async request req File usr local lib python3 8 site packages httpcore async connection pool py line 253 in handle async request raise exc File usr local lib python3 8 site packages httpcore async connection pool py line 237 in handle async request response = await connection handle async request request File usr local lib python3 8 site packages httpcore async connection py line 90 in handle async request return await self connection handle async request request File usr local lib python3 8 site packages httpcore async http11 py line 112 in handle async request raise exc File usr local lib python3 8 site packages httpcore async http11 py line 91 in handle async request = await self receive response headers kwargs File usr local lib python3 8 site packages httpcore async http11 py line 155 in receive response headers event = await self receive event timeout=timeout File usr local lib python3 8 site packages httpcore async http11 py line 191 in receive event data = await self network stream read File usr local lib python3 8 site packages httpcore backends asyncio py line 34 in read return await self stream receive max bytes=max bytes File usr local lib python3 8 site packages anyio backends asyncio py line 1265 in receive await self protocol read event wait File usr local lib python3 8 asyncio locks py line 309 in wait await fut RuntimeError Task lt Task pending name= anyio from thread BlockingPortal call func coro= lt BlockingPortal call func running at usr local lib python3 8 site packages anyio from thread py 219 gt cb= TaskGroup spawn lt locals gt task done at usr local lib python3 8 site packages anyio backends asyncio py 726 gt got Future lt Future pending gt attached to a different loop```

Zanie · Answer

Hm that doesn t look like 2 8 7

Paco Ibañez · Answer

ohh the docker image may have an older version server + agent is 2 8 7 Let me rebuild the docker image with the flows

Paco Ibañez · Answer

```raceback most recent call last File usr local lib python3 8 site packages prefect engine py line 673 in orchestrate flow run result = await flow call aresult File usr local lib python3 8 site packages prefect internal concurrency calls py line 181 in aresult return await asyncio wrap future self future File usr local lib python3 8 site packages prefect internal concurrency calls py line 218 in run async result = await coro File cdp orchestrator flow py line 55 in cdp orchestrator await orchestrator run File src pipelines orchestrator core orchestrator py line 218 in run self step prefect info = await self load step prefect info File src pipelines orchestrator core orchestrator py line 152 in load step prefect info deployments = await self prefect client read deployments File usr local lib python3 8 site packages prefect client orchestration py line 1567 in read deployments response = await <http self client post|self client post> deployments filter json=body File usr local lib python3 8 site packages httpx client py line 1848 in post return await self request File usr local lib python3 8 site packages httpx client py line 1533 in request return await self send request auth=auth follow redirects=follow redirects File usr local lib python3 8 site packages prefect client base py line 243 in send response = await self send with retry File usr local lib python3 8 site packages prefect client base py line 189 in send with retry response = await request File usr local lib python3 8 site packages httpx client py line 1620 in send response = await self send handling auth File usr local lib python3 8 site packages httpx client py line 1648 in send handling auth response = await self send handling redirects File usr local lib python3 8 site packages httpx client py line 1685 in send handling redirects response = await self send single request request File usr local lib python3 8 site packages httpx client py line 1722 in send single request response = await transport handle async request request File usr local lib python3 8 site packages httpx transports default py line 353 in handle async request resp = await self pool handle async request req File usr local lib python3 8 site packages httpcore async connection pool py line 253 in handle async request raise exc File usr local lib python3 8 site packages httpcore async connection pool py line 237 in handle async request response = await connection handle async request request File usr local lib python3 8 site packages httpcore async connection py line 90 in handle async request return await self connection handle async request request File usr local lib python3 8 site packages httpcore async http11 py line 112 in handle async request raise exc File usr local lib python3 8 site packages httpcore async http11 py line 91 in handle async request = await self receive response headers kwargs File usr local lib python3 8 site packages httpcore async http11 py line 155 in receive response headers event = await self receive event timeout=timeout File usr local lib python3 8 site packages httpcore async http11 py line 191 in receive event data = await self network stream read File usr local lib python3 8 site packages httpcore backends asyncio py line 34 in read return await self stream receive max bytes=max bytes File usr local lib python3 8 site packages anyio backends asyncio py line 1265 in receive await self protocol read event wait File usr local lib python3 8 asyncio locks py line 309 in wait await fut RuntimeError Task lt Task pending name= Task 8 coro= lt Call run async running at usr local lib python3 8 site packages prefect internal concurrency calls py 218 gt cb= Call run lt locals gt lt lambda gt at usr local lib python3 8 site packages prefect internal concurrency calls py 155 gt got Future lt Future pending gt attached to a different loop```

Paco Ibañez · Answer

```root 768c17c91454 src pipelines orchestrator flows prefect version Version 2 8 7 API version 0 8 4 Python version 3 8 16 Git commit a6d6c6fc Built Thu Mar 23 2023 3 27 PM OS Arch linux x86 64 Profile default Server type server```

Paco Ibañez · Answer

actually this traceback is happening before reaching the point where I call the subflow

Paco Ibañez · Answer

I have no idea what is going on bc that call was working before I get the prefect client from the flow run ``` from prefect context import get run context prefect client = get run context client``` and I use it to gather info about the subflows the current flow needs to call

Zanie · Answer

Ah you can t use the client from the context in 2 8 7

Zanie · Answer

We re working on fixing that but it s running in a separate event loop than your tasks flows now

Paco Ibañez · Answer

getting the client with ```async with get client as client ``` fixed it Thank you

Zanie · Answer

No problem