I'm registering a number of flows, and this seems to be failing non-deterministically. The error is:

[2022-05-10 17:38:40+0000] INFO - prefect.S3 | Uploading script /codebuild/output/src317307747/src/schedule.py to finance/2022-05-10t17-38-40-057549-00-00 in <bucket>
Traceback (most recent call last):
  File "/codebuild/output/src317307747/src/datascience/register.py", line 110, in <module>
    register_flow(flow)
  File "/codebuild/output/src317307747/src/datascience/register.py", line 93, in register_flow
    flow.register(
  File "/root/.pyenv/versions/3.9.5/lib/python3.9/site-packages/prefect/core/flow.py", line 1727, in register
    registered_flow = client.register(
  File "/root/.pyenv/versions/3.9.5/lib/python3.9/site-packages/prefect/client/client.py", line 1244, in register
    self.graphql(
  File "/root/.pyenv/versions/3.9.5/lib/python3.9/site-packages/prefect/client/client.py", line 570, in graphql
    raise ClientError(result["errors"])
prefect.exceptions.ClientError: [{'path': ['set_schedule_active'], 'message': 'unable to perform operation on <TCPTransport closed=True reading=False 0x555efa0e7420>; the handler is closed', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}]

running prefect version 0.15.13

No luck, different error. Again, some flows registered successfully, but:

[2022-05-10 18:13:13+0000] INFO - prefect.S3 | Uploading script /codebuild/output/src944635918/src/schedule.py to path/2022-05-10t18-13-13-230406-00-00 in <bucket>
Traceback (most recent call last):
  File "/codebuild/output/src944635918/src/datascience/register.py", line 110, in <module>
    register_flow(flow)
  File "/codebuild/output/src944635918/src/datascience/register.py", line 93, in register_flow
    flow.register(
  File "/root/.pyenv/versions/3.9.5/lib/python3.9/site-packages/prefect/core/flow.py", line 1727, in register
    registered_flow = client.register(
  File "/root/.pyenv/versions/3.9.5/lib/python3.9/site-packages/prefect/client/client.py", line 1176, in register
    res = self.graphql(
  File "/root/.pyenv/versions/3.9.5/lib/python3.9/site-packages/prefect/client/client.py", line 570, in graphql
    raise ClientError(result["errors"])
prefect.exceptions.ClientError: [{'path': ['create_flow_from_compressed_string'], 'message': 'Unable to complete operation', 'extensions': {'code': 'API_ERROR'}}]

For instance, here is the output of

prefect run

with `--watch`:

Looking up flow metadata... Done
Creating run for flow 'bag_wildfire_perimeters_log'... Done
└── Name: axiomatic-kestrel
└── UUID: ca7b3443-26e8-4864-a01f-9a8c4e23cbd0
└── Labels: []
└── Parameters: {'shapefile_url': '<http://opendata.arcgis.com/api/v3/datasets/6bd5dd4e93154f6fae0de1f2c82d95bf_0/downloads/data?format=shp&spatialRefId=4326>'}
└── Context: {}
└── URL: <https://cloud.prefect.io/zesty-ai/flow-run/ca7b3443-26e8-4864-a01f-9a8c4e23cbd0>
Watching flow run execution...
└── 11:32:35 | INFO    | Entered state <Scheduled>: Flow run scheduled.
└── 11:32:39 | INFO    | Entered state <Submitted>: Submitted for execution
└── 11:33:21 | INFO    | Entered state <Running>: Running flow.
└── 11:34:31 | INFO    | Entered state <Success>: All reference tasks succeeded.
Flow run succeeded!

...none of the logging my tasks do is showing up, nor is it even logging which tasks are running.

I also can't see logs in the UI, for any flows -- old, new, or currently running. E.g. https://cloud.prefect.io/zesty-ai/flow-run/ca7b3443-26e8-4864-a01f-9a8c4e23cbd0?logs

No logs found. Try expanding or resetting your search.

Click here to retrieve archived logs - please allow up to 30 seconds for the retrieval to take effect.

...if I click there, it says "Retrieving archived logs from glacial storage......" for a while. ...and then eventually just says:

Sorry, we couldn't get the logs from glacial storage... Retry?