kevin04/08/2022, 7:36 AM
it fails with error message:
which makes sense. My Prefect infrastructure is sitting on a KubernetesJobEnvironment. My understanding is that to store this large result correctly I should follow the documentation here: https://docs.prefect.io/core/concepts/results.html#result-objects Are there any additional considerations I should take into account with setting up correct result storage with this infrastructure?
'State payload is too large.'
For the SnowflakeQuery task you could set it when you initialize the task:
query = SnowflakeQuery(checkpoint=False) with Flow("yourflow") as flow: query(*run_args)
kevin04/08/2022, 3:15 PM
kevin04/08/2022, 6:05 PM
kevin04/08/2022, 6:21 PM