Alex Furrier
07/13/2021, 4:00 PMFailed to set task state with error: HTTPError('413 Client Error: Payload Too Large for url: <http://prefect-apollo.prefect:4200/graphql/graphql>')
Traceback (most recent call last):
File "/opt/conda/lib/python3.8/site-packages/prefect/engine/cloud/task_runner.py", line 91, in call_runner_target_handlers
state = self.client.set_task_run_state(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 1518, in set_task_run_state
result = self.graphql(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 298, in graphql
result = <http://self.post|self.post>(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 213, in post
response = self._request(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 459, in _request
response = self._send_request(
File "/opt/conda/lib/python3.8/site-packages/prefect/client/client.py", line 375, in _send_request
response.raise_for_status()
File "/opt/conda/lib/python3.8/site-packages/requests/models.py", line 943, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 413 Client Error: Payload Too Large for url: <http://prefect-apollo.prefect:4200/graphql/graphql>
nicholas
07/13/2021, 10:00 PMAlex Furrier
07/13/2021, 10:03 PMnicholas
07/13/2021, 10:09 PMPostgresFetch
or something) you can always wrap that in your own task, make the query as you'd like, write the results, and then return maybe the bucket reference to your downstream so they know where to look@task
def postgres_wrapper(**args):
results = PostgresFetch(**args).run()
location = write_to_bucket(results)
return location
Alex Furrier
07/13/2021, 10:41 PM