Hi, while passing a large DataFrame to a subflow i...
# ask-community
c
Hi, while passing a large DataFrame to a subflow i get the error "httpx.LocalProtocolError: 1". This is the traceback: response = await self._send_single_request(request) File "C:\Users\ChristophSchäferLHIA\AppData\Local\pypoetry\Cache\virtualenvs\linkedin-scrape-daten-bereinigen-4Zhw2IsJ-py3.10\lib\site-packages\httpx\_client.py", line 1719, in _send_single_request response = await transport.handle_async_request(request) File "C:\Users\ChristophSchäferLHIA\AppData\Local\pypoetry\Cache\virtualenvs\linkedin-scrape-daten-bereinigen-4Zhw2IsJ-py3.10\lib\site-packages\httpx\_transports\default.py", line 365, in handle_async_request with map_httpcore_exceptions(): File "C:\Python310\lib\contextlib.py", line 153, in exit self.gen.throw(typ, value, traceback) File "C:\Users\ChristophSchäferLHIA\AppData\Local\pypoetry\Cache\virtualenvs\linkedin-scrape-daten-bereinigen-4Zhw2IsJ-py3.10\lib\site-packages\httpx\_transports\default.py", line 83, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.LocalProtocolError: 1 It seems like this is nothing new as on Stackoverflow someone ran into the same issue: https://stackoverflow.com/questions/75260006/error-in-prefect-flow-when-passing-large-dataframe-as-argument Any idea how to fix this?
I converted the DataFrame to a dict, about 100.000 entries, and i get the same error. What is the recommended way to pass data to a subflow?