Hi Team,
I am trying to acquire the result of a deployment using run_deployment. The flow deployed have persist_result=True. The deployment is executed by a process worker and I noticed that the result (acquired by flowrun.state.result()) can not be retrieved when the worker is initiated in another computer. This makes sense as I am aware the result is stored locally and thus cannot be accessed by other file systems. To solve this, should I use something like a cloud drive? Curious to learn what is the best way to solve this issue
k
Kevin Grismore
06/15/2024, 1:24 PM
Setting your result storage location to a blob storage system like S3 or GCS is absolutely the right approach
❤️ 1
j
Jackie
06/15/2024, 4:19 PM
Thank you!
Jackie
06/16/2024, 4:34 AM
@Kevin Grismore Hi Kevin, Thank you for your kind reply. Is there a tutorial for doing so? I am trying to use S3 bucket to persist result but I learned that "from prefect.filesystems import S3" will be depreciated which is what shown in the persisting result tutorial on the website. I am trying to use "from prefect_aws.s3 import S3Bucket" but unable to do so with result_storage=S3Bucket.load(<block_name>)
n
Nate
06/17/2024, 4:21 AM
I learned that
from prefect.filesystems import S3
will be deprecated which is what shown in the persisting result tutorial on the website.
we'll get this updated - thank you!
I am trying to use
from prefect_aws.s3 import S3Bucket
but unable to do so with
result_storage=S3Bucket.load(<block_name>)
whats going wrong with that? that seems right to me
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.