kevin
04/08/2022, 7:36 AMset_task_result()
it fails with error message: 'State payload is too large.'
which makes sense.
My Prefect infrastructure is sitting on a KubernetesJobEnvironment. My understanding is that to store this large result correctly I should follow the documentation here: https://docs.prefect.io/core/concepts/results.html#result-objects
Are there any additional considerations I should take into account with setting up correct result storage with this infrastructure?Anna Geller
04/08/2022, 9:34 AM@task(checkpoint=False)
For the SnowflakeQuery task you could set it when you initialize the task:
query = SnowflakeQuery(checkpoint=False)
with Flow("yourflow") as flow:
query(*run_args)
kevin
04/08/2022, 3:15 PMAnna Geller
04/08/2022, 6:04 PMkevin
04/08/2022, 6:05 PMAnna Geller
04/08/2022, 6:20 PMkevin
04/08/2022, 6:21 PM